-- Logs begin at Thu 2022-04-07 05:32:18 UTC, end at Thu 2022-04-07 06:52:41 UTC. -- Apr 07 06:04:59.854026 dv-cinder-831776-6-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Apr 07 06:04:59.862811 dv-cinder-831776-6-iscsi devstack@keystone.service[80154]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Apr 07 06:04:59.864705 dv-cinder-831776-6-iscsi devstack@keystone.service[80154]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Apr 7 06:04:59 2022] *** Apr 07 06:04:59.864705 dv-cinder-831776-6-iscsi devstack@keystone.service[80154]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 07 06:04:59.864705 dv-cinder-831776-6-iscsi devstack@keystone.service[80154]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 07 06:04:59.864705 dv-cinder-831776-6-iscsi devstack@keystone.service[80154]: nodename: dv-cinder-831776-6-iscsi Apr 07 06:04:59.864705 dv-cinder-831776-6-iscsi devstack@keystone.service[80154]: machine: x86_64 Apr 07 06:04:59.864705 dv-cinder-831776-6-iscsi devstack@keystone.service[80154]: clock source: unix Apr 07 06:04:59.864705 dv-cinder-831776-6-iscsi devstack@keystone.service[80154]: pcre jit disabled Apr 07 06:04:59.864705 dv-cinder-831776-6-iscsi devstack@keystone.service[80154]: detected number of CPU cores: 4 Apr 07 06:04:59.864705 dv-cinder-831776-6-iscsi devstack@keystone.service[80154]: current working directory: / Apr 07 06:04:59.864705 dv-cinder-831776-6-iscsi devstack@keystone.service[80154]: detected binary path: /usr/bin/uwsgi-core Apr 07 06:04:59.864705 dv-cinder-831776-6-iscsi devstack@keystone.service[80154]: your processes number limit is 47680 Apr 07 06:04:59.864705 dv-cinder-831776-6-iscsi devstack@keystone.service[80154]: your memory page size is 4096 bytes Apr 07 06:04:59.864705 dv-cinder-831776-6-iscsi devstack@keystone.service[80154]: detected max file descriptor number: 2048 Apr 07 06:04:59.864705 dv-cinder-831776-6-iscsi devstack@keystone.service[80154]: lock engine: pthread robust mutexes Apr 07 06:04:59.870536 dv-cinder-831776-6-iscsi devstack@keystone.service[80154]: thunder lock: enabled Apr 07 06:04:59.870536 dv-cinder-831776-6-iscsi devstack@keystone.service[80154]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Apr 07 06:04:59.870536 dv-cinder-831776-6-iscsi devstack@keystone.service[80154]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 07 06:04:59.910386 dv-cinder-831776-6-iscsi devstack@keystone.service[80154]: Python main interpreter initialized at 0x558c26d429c0 Apr 07 06:04:59.910386 dv-cinder-831776-6-iscsi devstack@keystone.service[80154]: python threads support enabled Apr 07 06:04:59.910386 dv-cinder-831776-6-iscsi devstack@keystone.service[80154]: your server socket listen backlog is limited to 100 connections Apr 07 06:04:59.910386 dv-cinder-831776-6-iscsi devstack@keystone.service[80154]: your mercy for graceful operations on workers is 90 seconds Apr 07 06:04:59.910712 dv-cinder-831776-6-iscsi devstack@keystone.service[80154]: mapped 403077 bytes (393 KB) for 2 cores Apr 07 06:04:59.910810 dv-cinder-831776-6-iscsi devstack@keystone.service[80154]: *** Operational MODE: preforking *** Apr 07 06:04:59.911080 dv-cinder-831776-6-iscsi devstack@keystone.service[80154]: *** uWSGI is running in multiple interpreter mode *** Apr 07 06:04:59.911080 dv-cinder-831776-6-iscsi devstack@keystone.service[80154]: spawned uWSGI master process (pid: 80154) Apr 07 06:04:59.911279 dv-cinder-831776-6-iscsi systemd[1]: Started Devstack devstack@keystone.service. Apr 07 06:04:59.912199 dv-cinder-831776-6-iscsi devstack@keystone.service[80154]: spawned uWSGI worker 1 (pid: 80167, cores: 1) Apr 07 06:04:59.912199 dv-cinder-831776-6-iscsi devstack@keystone.service[80154]: spawned uWSGI worker 2 (pid: 80168, cores: 1) Apr 07 06:04:59.912353 dv-cinder-831776-6-iscsi devstack@keystone.service[80154]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 07 06:05:05.739910 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 07 06:05:05.739910 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: from cryptography.utils import int_from_bytes Apr 07 06:05:05.740999 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 07 06:05:05.740999 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: from cryptography.utils import int_from_bytes Apr 07 06:05:05.748680 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 07 06:05:05.748680 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: from cryptography.utils import int_from_bytes Apr 07 06:05:05.749166 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 07 06:05:05.749166 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: from cryptography.utils import int_from_bytes Apr 07 06:05:05.797582 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 07 06:05:05.797784 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 07 06:05:05.797982 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] command line args: [] {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 07 06:05:05.798257 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 07 06:05:05.798437 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] ================================================================================ {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 07 06:05:05.798702 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] admin_token = **** {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.798787 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 07 06:05:05.798894 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 07 06:05:05.798980 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] config_dir = [] {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.799088 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] command line args: [] {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 07 06:05:05.799179 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.799306 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] config_source = [] {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.799389 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 07 06:05:05.799490 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] debug = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.799578 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] ================================================================================ {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 07 06:05:05.799692 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.799977 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] admin_token = **** {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.800049 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] config_dir = [] {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.800114 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.800180 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.800246 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.800398 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] config_source = [] {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.800490 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.800553 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] debug = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.800733 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.800821 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.800962 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] list_limit = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.801049 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.801154 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.801232 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] log_config_append = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.801300 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.801408 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.801490 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] log_dir = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.801627 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.801714 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] log_file = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.801859 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] list_limit = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.801945 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.802061 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] log_config_append = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.802149 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.802216 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.802358 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.802438 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] log_dir = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.802550 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] log_file = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.802625 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.802778 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.802898 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.803010 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.803124 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.803233 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.803347 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.803501 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.803615 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.803727 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.803873 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.803978 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.804096 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.804208 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.804321 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.804403 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.804521 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.804643 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.804731 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.804810 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.804933 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.805015 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.805093 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.805220 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.805442 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.805559 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.24/identity {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.805686 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.805765 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] publish_errors = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.805961 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.806050 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.806195 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.806378 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.806505 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.24/identity {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.806615 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] publish_errors = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.806694 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.806848 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.806933 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.807080 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.807245 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] standard_threads = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.807333 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.807413 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.807490 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.807570 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.807708 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.807819 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.807916 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] use_journal = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.808000 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] standard_threads = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.808097 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] use_json = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.808232 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.808315 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] use_stderr = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.808413 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.808493 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] use_syslog = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.808587 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.808672 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.808756 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] use_journal = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.808919 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.809495 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] use_json = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.809683 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.809948 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.810225 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.810485 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.810728 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.810981 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.811223 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.811475 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.811558 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] use_stderr = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.811673 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] use_syslog = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.811777 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.811945 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 06:05:05.812034 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.812236 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.812314 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.812480 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.812559 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.812720 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.812805 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.812971 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.813056 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.813209 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.813283 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.813448 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.813533 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.813698 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.813776 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.813936 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.814015 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.814182 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.814270 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.814422 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.814505 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.814667 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.814751 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.814906 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.814984 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.815154 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.815231 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.815392 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.815471 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.815638 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.815715 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.815899 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.815989 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.816137 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.816216 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.816378 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.816463 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.816630 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.816722 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.816883 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.816963 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.817118 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.817197 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.817353 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.817439 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.817606 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.817691 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.817856 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.817940 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.818095 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.818181 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.818326 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.818431 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.818557 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.818664 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.818801 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.818914 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.819047 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.819155 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.819255 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.819373 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.819493 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.819581 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.819723 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.819861 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.819976 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.820066 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.820221 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.820317 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.820467 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.820553 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.820703 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.820780 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.820946 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.821035 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.821178 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.821272 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.821415 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.821501 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.821650 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.821730 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.821882 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.821962 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.822112 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.822255 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.822339 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.822412 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.822561 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.822644 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.822797 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.822882 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.823042 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.823127 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.823272 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.823394 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.823506 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.823589 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.823734 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.823883 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.823994 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.824081 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.824232 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.824312 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.824468 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.824555 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.825259 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.825355 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.825511 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.825596 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.825749 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.825827 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.825972 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.826053 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.826212 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.826299 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.826451 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.826537 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.826682 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.826768 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.826931 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.827016 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.827168 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.827248 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.827405 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.827485 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.827638 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.827726 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.827913 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.827995 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.828150 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.828236 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.828382 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.828462 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.828621 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.828709 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.828855 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.828944 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.829101 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.829180 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.829344 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.829424 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.829586 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.829665 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.829827 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.829913 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.830065 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.830145 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.830302 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.830381 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.830537 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.830618 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.830786 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.830865 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.831024 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.831103 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.831262 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.831342 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.831502 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.831581 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.831738 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.831863 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.831994 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.832075 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.832229 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.832307 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.832463 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.832547 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.832697 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.832776 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.832938 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.833024 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.833173 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.833265 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.833421 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.833500 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.833657 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.833736 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.833899 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.833986 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.834137 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.834217 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.834372 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.834452 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.834609 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.834696 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.834840 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.834919 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.835071 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.835150 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] auth.external = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.835307 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.835394 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.835542 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.835621 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.835791 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.835886 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.836036 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.836124 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] auth.password = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.836273 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.836352 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] auth.token = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.836519 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.836604 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.836755 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.836843 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.837005 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.837098 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.837242 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.837323 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.837489 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.837573 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.837720 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] auth.external = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.837808 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.837951 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.838039 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.838189 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] credential.caching = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.838274 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.838441 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.838530 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.838680 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] auth.password = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.838765 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.838910 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] auth.token = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.838992 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.839150 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.839305 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.839387 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.839460 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.839623 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.839704 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.839879 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.839972 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.840125 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.840248 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.840413 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.840493 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.840667 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.840759 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.840905 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] credential.caching = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.840986 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.841150 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.841230 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.841397 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.841486 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.841643 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.841731 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.841878 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.841958 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.842119 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.842207 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] federation.caching = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.842355 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.842435 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.842610 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.842688 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.842859 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.842946 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.843091 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.843172 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.843342 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.843422 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.843583 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.843672 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.843865 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.843948 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.844110 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.844190 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.844361 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.844452 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.844599 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.844678 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.844842 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] federation.caching = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.844920 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.845078 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] identity.caching = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.845165 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.845326 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.845404 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.845570 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.845648 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.845809 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.845889 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.846048 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.846128 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.846282 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.846360 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.846520 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.846600 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.846759 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.846838 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.847008 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.847086 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.847241 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.847321 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.847487 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.847571 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.847721 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] identity.caching = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.847846 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.847981 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.848061 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.848226 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.848312 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.848464 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.848544 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.848698 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.848779 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.848941 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.849021 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.849170 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.849250 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.849406 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.849493 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.849652 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.849731 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.849901 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.849981 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.850132 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.850220 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.850363 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.850450 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.850591 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.850671 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.850829 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.850908 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.851076 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.851155 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.851319 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.851398 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.851570 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.851650 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.851827 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.851910 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.852080 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.852159 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.852323 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.852405 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.852563 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.852642 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.852801 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.852880 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.853038 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.853118 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.853268 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.853364 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.853503 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.853583 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.853734 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.853814 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.853968 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.854046 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.854207 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.854286 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.854435 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.854521 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.854679 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.854759 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.854917 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.854995 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.855151 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.855231 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.855400 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.855478 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.855634 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.855713 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.856405 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.856489 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.856644 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.856724 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.856872 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.856960 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.857108 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.857187 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.857345 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.857424 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.857581 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.857668 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.857818 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.user = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.857897 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.858054 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.858133 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.858304 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.858392 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.858537 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.858616 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.858770 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.858855 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.858999 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.859087 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.859245 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.859326 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.859489 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.859567 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.859722 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.859832 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.859980 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.860065 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.860215 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.860294 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.860445 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.user = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.860531 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.860675 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.860760 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.860926 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.861006 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.861154 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.861241 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.861398 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.861478 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.861641 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.861721 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.861885 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.861973 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.862117 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.862196 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.862352 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.862430 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.862594 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.862745 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.862822 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.862894 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.863049 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.863129 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.863278 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.863356 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.863522 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.863602 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.863786 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.863870 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.864030 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.864121 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.864270 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.864354 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.864512 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.864592 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.864741 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.864830 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.864985 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.865063 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.865217 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.865295 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.865716 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.865810 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.865953 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.866033 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.866188 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.866268 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.866422 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.866508 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.866662 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.866741 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.866893 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.866972 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] resource.caching = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.867144 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.867233 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.867372 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.867452 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.867614 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.867699 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.867869 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.867962 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.868104 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.868184 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.868339 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.868418 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.868583 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.868671 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.868821 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.868900 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.869057 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.869135 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.869294 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] role.caching = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.869381 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.869530 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] resource.caching = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.869609 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] role.driver = sql {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.869769 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.869847 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.870012 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.870098 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.870246 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.870326 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.870493 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.870573 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.870740 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.870828 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.870974 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.871054 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.871217 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.871296 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.871451 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.872173 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.872279 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.872360 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.872515 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.872593 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] role.caching = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.872760 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] role.driver = sql {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.872840 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.872992 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.873072 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.873239 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.873319 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.873486 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.873568 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.873730 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.873885 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.873971 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.874123 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.874212 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.874374 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.874454 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.874627 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.874715 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.874878 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.874966 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.875114 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.875193 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.875357 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.875437 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.875613 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.875701 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.875888 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.875970 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.876134 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.876215 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.876368 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.876545 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.876626 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.876780 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.876861 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.877027 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.877116 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.877276 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.877356 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.877521 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.877600 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.877769 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.877857 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.878002 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.878082 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.878235 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.878313 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.878474 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] token.caching = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.878562 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.878715 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.878796 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.878944 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.879023 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.879176 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.879264 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.879407 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.879488 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.879677 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.879775 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.879943 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.880034 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.880190 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.880269 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.880427 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.880507 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.880664 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.880752 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.880895 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.880975 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.881131 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] token.caching = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.881211 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.881367 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.881455 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.881613 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.881691 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.881848 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.881927 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.882084 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.882182 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.882330 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.882410 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.882564 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.882642 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.882807 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.882895 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] database.connection = **** {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.883049 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.883139 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.883294 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.883374 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.883529 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.883609 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.883815 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.883900 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.884016 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.884095 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.884260 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.884340 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.884491 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.884566 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.884723 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.884801 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.884964 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.885044 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.885229 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.885315 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.885447 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.885527 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] database.connection = **** {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.885688 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.885777 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.885939 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.886019 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.886177 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.886257 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.886423 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.886503 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.886656 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.886735 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.886889 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.886968 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.887144 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.887228 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.887325 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 07 06:05:05.887404 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.887614 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.887870 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.888112 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.888348 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.888592 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.888826 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.889068 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.889295 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.889533 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.889764 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 06:05:05.889933 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 07 06:05:05.917009 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 07 06:05:05.917246 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 07 06:05:05.917476 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 07 06:05:05.918924 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 07 06:05:05.919157 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 07 06:05:05.919383 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 07 06:05:05.926543 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 07 06:05:05.928035 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 07 06:05:05.955290 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 07 06:05:05.955523 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 07 06:05:05.956385 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 07 06:05:05.956620 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 07 06:05:06.010526 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 07 06:05:06.010773 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 07 06:05:06.060201 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 07 06:05:06.060427 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 07 06:05:06.061025 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 07 06:05:06.061269 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 07 06:05:06.127610 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 07 06:05:06.127874 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 07 06:05:06.127960 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 07 06:05:06.128108 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 07 06:05:06.128193 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 07 06:05:06.128330 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 07 06:05:06.128413 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 07 06:05:06.128549 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 07 06:05:06.128632 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 07 06:05:06.128765 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 07 06:05:06.128848 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 07 06:05:06.128982 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 07 06:05:06.152171 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 07 06:05:06.152402 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 07 06:05:06.152569 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 07 06:05:06.152664 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 07 06:05:06.152866 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 07 06:05:06.152956 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 07 06:05:06.153098 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 07 06:05:06.153191 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 07 06:05:06.153314 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 07 06:05:06.153397 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 07 06:05:06.153530 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 07 06:05:06.153612 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 07 06:05:06.153760 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 07 06:05:06.153986 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 07 06:05:06.164757 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 07 06:05:06.165131 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 07 06:05:06.177813 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 07 06:05:06.177990 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 07 06:05:06.178098 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 07 06:05:06.178230 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 07 06:05:06.178317 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 07 06:05:06.178452 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 07 06:05:06.178537 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 07 06:05:06.178672 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 07 06:05:06.178756 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 07 06:05:06.178887 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 07 06:05:06.178970 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 07 06:05:06.179100 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 07 06:05:06.179190 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 07 06:05:06.179312 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 07 06:05:06.196462 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.196678 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 07 06:05:06.197023 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.197105 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.197227 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 07 06:05:06.197311 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 07 06:05:06.197499 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.197583 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.197746 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 07 06:05:06.197836 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.198011 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.198093 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.198267 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.198348 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.198526 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.198777 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.209915 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.210198 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.210280 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.210472 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.210567 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.210748 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.210830 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.211030 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.218976 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 07 06:05:06.219191 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 07 06:05:06.222329 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 07 06:05:06.222484 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 07 06:05:06.222618 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.222762 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.222905 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.223042 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.223188 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.223322 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.223588 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.223719 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.223882 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.224010 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.224158 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.224281 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.224437 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.224555 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.224712 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.224832 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.224989 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.225106 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.225260 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.225376 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.252490 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.252825 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.254090 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 07 06:05:06.254367 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.254462 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 07 06:05:06.254752 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.259598 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 07 06:05:06.259898 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.260130 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 07 06:05:06.260226 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.260415 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.260740 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.267409 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 07 06:05:06.267687 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.268162 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 07 06:05:06.268450 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.272362 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 07 06:05:06.272649 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.272930 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.273144 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 07 06:05:06.273239 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.273434 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.273517 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.273723 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.273805 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.273990 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.274073 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.274253 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.274339 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.274627 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.274834 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.275105 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.293480 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.293766 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.294685 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.294966 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.298809 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 07 06:05:06.299557 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 07 06:05:06.302461 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.302757 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.303254 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.303554 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.307736 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 07 06:05:06.308635 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 07 06:05:06.311914 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 07 06:05:06.312803 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 07 06:05:06.317002 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.317299 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.317583 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.317863 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.317954 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.318147 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.318261 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.318431 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.318553 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.318849 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.319132 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.319414 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.337388 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 07 06:05:06.337679 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.338418 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 07 06:05:06.338710 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.439976 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.440258 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.440412 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.440706 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.448405 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.448894 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.450337 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.450609 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.450818 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.451103 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.453641 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 07 06:05:06.453922 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.454201 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.454285 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 07 06:05:06.454488 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.454636 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.454780 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.454916 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.455236 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.455521 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.468553 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 07 06:05:06.468831 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.469108 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.469373 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 07 06:05:06.469461 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.469652 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.469737 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.469934 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.470016 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.470219 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.470303 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.470501 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.470778 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.471057 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.488149 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 07 06:05:06.489286 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 07 06:05:06.491639 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 07 06:05:06.492885 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 07 06:05:06.494959 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.496367 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.497101 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.498523 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.498841 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 07 06:05:06.499117 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.499410 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.500324 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 07 06:05:06.500610 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.500909 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.506670 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.508283 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.508369 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 07 06:05:06.509904 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 07 06:05:06.511517 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.511775 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.512072 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.512394 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.513227 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.513519 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.513817 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.514098 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.521540 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 07 06:05:06.521825 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.522110 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.523373 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 07 06:05:06.523661 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.523974 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.530531 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 07 06:05:06.530812 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.531091 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.531366 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.531638 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.531946 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.532222 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.532468 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 07 06:05:06.532551 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.532753 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.532835 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.533039 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.533124 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.533328 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.533410 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.533604 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.533686 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.533897 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.533980 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.534164 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.534247 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.534446 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.534728 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.535099 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.535390 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.535668 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.535965 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.536240 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 07 06:05:06.572623 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x558c26d429c0 pid: 80168 (default app) Apr 07 06:05:06.576622 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4713a3a8-aaaf-4098-a130-843e059c253b None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:06.576916 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4713a3a8-aaaf-4098-a130-843e059c253b None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:06.577060 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x558c26d429c0 pid: 80167 (default app) Apr 07 06:05:06.577193 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4713a3a8-aaaf-4098-a130-843e059c253b None None] PATH_INFO: `/v3` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:06.581393 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1/1] 10.222.0.24 () {50 vars in 791 bytes} [Thu Apr 7 06:05:06 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:15.808019 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d1185-74cf-4125-bff6-030e1d836978 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:15.808505 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d1185-74cf-4125-bff6-030e1d836978 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:15.808627 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d1185-74cf-4125-bff6-030e1d836978 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:15.813504 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1/2] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:05:15 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 07 06:05:15.818754 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e2fcd-fda3-40b8-8689-c78570a6e140 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:15.819142 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e2fcd-fda3-40b8-8689-c78570a6e140 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:15.819312 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e2fcd-fda3-40b8-8689-c78570a6e140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:15.848490 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG oslo_db.sqlalchemy.engines [None req-6b1e2fcd-fda3-40b8-8689-c78570a6e140 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80168) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 07 06:05:16.034286 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG passlib.handlers.bcrypt [None req-6b1e2fcd-fda3-40b8-8689-c78570a6e140 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=80168) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Apr 07 06:05:16.034712 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG passlib.handlers.bcrypt [None req-6b1e2fcd-fda3-40b8-8689-c78570a6e140 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80168) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Apr 07 06:05:16.089693 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-6b1e2fcd-fda3-40b8-8689-c78570a6e140 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:05:16.091940 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-6b1e2fcd-fda3-40b8-8689-c78570a6e140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:05:16.220662 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 2/3] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:05:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Apr 07 06:05:16.373717 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d1185-74cf-4125-bff6-030e1d836978 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:16.405881 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG oslo_db.sqlalchemy.engines [None req-372d1185-74cf-4125-bff6-030e1d836978 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80167) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 07 06:05:16.530717 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d1185-74cf-4125-bff6-030e1d836978 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:16.534944 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440babd1-890a-4d59-b88a-bc4cc23c4c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:16.535598 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440babd1-890a-4d59-b88a-bc4cc23c4c3c admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:16.535910 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440babd1-890a-4d59-b88a-bc4cc23c4c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:16.536189 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440babd1-890a-4d59-b88a-bc4cc23c4c3c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:16.544759 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440babd1-890a-4d59-b88a-bc4cc23c4c3c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:16.594384 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.common.rbac_enforcer.enforcer [None req-440babd1-890a-4d59-b88a-bc4cc23c4c3c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Apr 07 06:05:16.594727 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440babd1-890a-4d59-b88a-bc4cc23c4c3c admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:16.603984 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 2/4] 10.222.0.24 () {58 vars in 1324 bytes} [Thu Apr 7 06:05:16 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 07 06:05:16.611723 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e2fcd-fda3-40b8-8689-c78570a6e140 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:16.626729 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e2fcd-fda3-40b8-8689-c78570a6e140 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:16.631071 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b160db22-3eff-4c8c-bb81-084e140dcdb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:16.632224 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160db22-3eff-4c8c-bb81-084e140dcdb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:16.632519 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160db22-3eff-4c8c-bb81-084e140dcdb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:16.632816 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160db22-3eff-4c8c-bb81-084e140dcdb1 admin admin] PATH_INFO: `/v3/projects/166c17adce104ad88442ca1e7dd22799` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:16.634319 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b160db22-3eff-4c8c-bb81-084e140dcdb1 admin admin] RBAC: Authorizing `identity:get_project(project_id=166c17adce104ad88442ca1e7dd22799)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:16.685803 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b160db22-3eff-4c8c-bb81-084e140dcdb1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Apr 07 06:05:16.686149 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b160db22-3eff-4c8c-bb81-084e140dcdb1 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:16.690774 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 3/5] 10.222.0.24 () {56 vars in 1207 bytes} [Thu Apr 7 06:05:16 2022] GET /identity/v3/projects/166c17adce104ad88442ca1e7dd22799 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:18.940672 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6246e0-f8bd-47e7-8f91-d621c340e6a4 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:18.941242 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6246e0-f8bd-47e7-8f91-d621c340e6a4 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:18.941242 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6246e0-f8bd-47e7-8f91-d621c340e6a4 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:18.945348 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 3/6] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:05:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:05:18.951180 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a5b19-993a-4dae-899b-12926a8aea73 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:18.951574 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a5b19-993a-4dae-899b-12926a8aea73 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:18.951739 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a5b19-993a-4dae-899b-12926a8aea73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:18.970376 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-db1a5b19-993a-4dae-899b-12926a8aea73 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:05:18.971923 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-db1a5b19-993a-4dae-899b-12926a8aea73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:05:18.979647 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 4/7] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:05:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Apr 07 06:05:19.002399 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6246e0-f8bd-47e7-8f91-d621c340e6a4 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:19.016387 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6246e0-f8bd-47e7-8f91-d621c340e6a4 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:19.020645 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f55a3fe-e881-4380-bb7c-07be7a2498b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:19.021236 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55a3fe-e881-4380-bb7c-07be7a2498b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:19.021523 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55a3fe-e881-4380-bb7c-07be7a2498b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:19.021801 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55a3fe-e881-4380-bb7c-07be7a2498b1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:19.029393 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f55a3fe-e881-4380-bb7c-07be7a2498b1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:19.031165 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f55a3fe-e881-4380-bb7c-07be7a2498b1 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:19.039611 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 4/8] 10.222.0.24 () {58 vars in 1324 bytes} [Thu Apr 7 06:05:19 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 07 06:05:19.046321 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1a5b19-993a-4dae-899b-12926a8aea73 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:19.055066 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1a5b19-993a-4dae-899b-12926a8aea73 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:19.059907 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd0f1a7-5cab-42b7-8ccc-a2c4459cb5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:19.060765 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0f1a7-5cab-42b7-8ccc-a2c4459cb5f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:19.061048 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0f1a7-5cab-42b7-8ccc-a2c4459cb5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:19.061324 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0f1a7-5cab-42b7-8ccc-a2c4459cb5f3 admin admin] PATH_INFO: `/v3/users/91c1e479128840248c7c0e4e51af60ff` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:19.062696 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd0f1a7-5cab-42b7-8ccc-a2c4459cb5f3 admin admin] RBAC: Authorizing `identity:get_user(user_id=91c1e479128840248c7c0e4e51af60ff)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:19.064540 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd0f1a7-5cab-42b7-8ccc-a2c4459cb5f3 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:19.066092 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 5/9] 10.222.0.24 () {56 vars in 1198 bytes} [Thu Apr 7 06:05:19 2022] GET /identity/v3/users/91c1e479128840248c7c0e4e51af60ff => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:05:21.412351 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd1f8d6-0c8b-4996-90ad-43c7dac36506 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:21.412891 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd1f8d6-0c8b-4996-90ad-43c7dac36506 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:21.412891 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd1f8d6-0c8b-4996-90ad-43c7dac36506 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:21.414257 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 5/10] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:05:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:05:21.419812 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c8da10-5905-4613-afe7-48296c02fa49 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:21.420186 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c8da10-5905-4613-afe7-48296c02fa49 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:21.420385 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c8da10-5905-4613-afe7-48296c02fa49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:21.436489 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-77c8da10-5905-4613-afe7-48296c02fa49 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:05:21.437675 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-77c8da10-5905-4613-afe7-48296c02fa49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:05:21.437768 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13595b9e-ab30-48f6-b662-2f2b101ce0d4 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:21.438003 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13595b9e-ab30-48f6-b662-2f2b101ce0d4 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:21.438293 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13595b9e-ab30-48f6-b662-2f2b101ce0d4 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:21.439620 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 6/11] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:05:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 07 06:05:21.444624 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed85b4-7df7-4853-b61c-a0ae457239e3 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:21.444914 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed85b4-7df7-4853-b61c-a0ae457239e3 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:21.445198 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed85b4-7df7-4853-b61c-a0ae457239e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:21.485746 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG passlib.handlers.bcrypt [None req-c7ed85b4-7df7-4853-b61c-a0ae457239e3 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=80167) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Apr 07 06:05:21.486167 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG passlib.handlers.bcrypt [None req-c7ed85b4-7df7-4853-b61c-a0ae457239e3 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80167) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Apr 07 06:05:21.515051 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 6/12] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:05:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:05:21.533009 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-c7ed85b4-7df7-4853-b61c-a0ae457239e3 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:05:21.534600 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c7ed85b4-7df7-4853-b61c-a0ae457239e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:05:21.539369 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c8da10-5905-4613-afe7-48296c02fa49 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:21.629823 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 7/13] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:05:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 07 06:05:21.633537 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c8da10-5905-4613-afe7-48296c02fa49 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:21.652858 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ed85b4-7df7-4853-b61c-a0ae457239e3 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:21.666797 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323003e2-e61b-4499-9579-4c8fa11662d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:21.667537 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323003e2-e61b-4499-9579-4c8fa11662d2 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:21.667896 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323003e2-e61b-4499-9579-4c8fa11662d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:21.668184 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323003e2-e61b-4499-9579-4c8fa11662d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:21.678915 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323003e2-e61b-4499-9579-4c8fa11662d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:05:21.685802 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-323003e2-e61b-4499-9579-4c8fa11662d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 07 06:05:21.687017 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 7/14] 10.222.0.24 () {56 vars in 1096 bytes} [Thu Apr 7 06:05:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 07 06:05:21.692648 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323003e2-e61b-4499-9579-4c8fa11662d2 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:21.749461 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ed85b4-7df7-4853-b61c-a0ae457239e3 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:21.784759 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e06109-d845-4301-96a1-920dbfc707a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:21.785671 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e06109-d845-4301-96a1-920dbfc707a3 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:21.785975 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e06109-d845-4301-96a1-920dbfc707a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:21.786259 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e06109-d845-4301-96a1-920dbfc707a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:21.788439 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323003e2-e61b-4499-9579-4c8fa11662d2 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:21.819827 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e84d419-3b5b-4606-a2d9-d9883bac4137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:21.820498 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e84d419-3b5b-4606-a2d9-d9883bac4137 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:21.820789 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e84d419-3b5b-4606-a2d9-d9883bac4137 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:21.821141 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e84d419-3b5b-4606-a2d9-d9883bac4137 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:21.821913 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e84d419-3b5b-4606-a2d9-d9883bac4137 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:05:21.822224 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e84d419-3b5b-4606-a2d9-d9883bac4137 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:21.823629 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e84d419-3b5b-4606-a2d9-d9883bac4137 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:21.835376 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 8/15] 10.222.0.24 () {56 vars in 1099 bytes} [Thu Apr 7 06:05:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:05:21.841486 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e84d419-3b5b-4606-a2d9-d9883bac4137 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:21.849563 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e06109-d845-4301-96a1-920dbfc707a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:21.851098 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e06109-d845-4301-96a1-920dbfc707a3 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:21.932428 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e84d419-3b5b-4606-a2d9-d9883bac4137 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:21.942565 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 8/16] 10.222.0.24 () {58 vars in 1282 bytes} [Thu Apr 7 06:05:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 07 06:05:21.949888 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e06109-d845-4301-96a1-920dbfc707a3 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:21.964196 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338afd04-82e0-4814-b802-bce979be7c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:21.965685 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338afd04-82e0-4814-b802-bce979be7c0b None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:21.965969 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338afd04-82e0-4814-b802-bce979be7c0b None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:21.966243 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338afd04-82e0-4814-b802-bce979be7c0b None admin] PATH_INFO: `/v3/users/91c1e479128840248c7c0e4e51af60ff` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:21.967432 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338afd04-82e0-4814-b802-bce979be7c0b None admin] RBAC: Authorizing `identity:get_user(user_id=91c1e479128840248c7c0e4e51af60ff)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:21.968937 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338afd04-82e0-4814-b802-bce979be7c0b None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:21.970697 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 9/17] 10.222.0.24 () {56 vars in 1177 bytes} [Thu Apr 7 06:05:21 2022] GET /identity/v3/users/91c1e479128840248c7c0e4e51af60ff => generated 247 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:05:21.975723 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338afd04-82e0-4814-b802-bce979be7c0b None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:22.040696 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e06109-d845-4301-96a1-920dbfc707a3 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:22.068138 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338afd04-82e0-4814-b802-bce979be7c0b None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:22.074570 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8076777-076f-4a09-ab27-063d2adaabe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:22.075374 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8076777-076f-4a09-ab27-063d2adaabe5 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:22.075658 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8076777-076f-4a09-ab27-063d2adaabe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:22.075961 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8076777-076f-4a09-ab27-063d2adaabe5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:22.093511 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8076777-076f-4a09-ab27-063d2adaabe5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:22.094964 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8076777-076f-4a09-ab27-063d2adaabe5 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:22.100622 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1383d7b-0a30-4bb7-87ca-974ef928f0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:22.101419 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1383d7b-0a30-4bb7-87ca-974ef928f0bd None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:22.101708 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1383d7b-0a30-4bb7-87ca-974ef928f0bd None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:22.101986 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1383d7b-0a30-4bb7-87ca-974ef928f0bd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:22.103172 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1383d7b-0a30-4bb7-87ca-974ef928f0bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:22.104640 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1383d7b-0a30-4bb7-87ca-974ef928f0bd None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:22.106344 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 10/18] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:05:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:05:22.111355 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-b8076777-076f-4a09-ab27-063d2adaabe5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:05:22.111834 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1383d7b-0a30-4bb7-87ca-974ef928f0bd None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:22.117359 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 9/19] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:05:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 07 06:05:22.118307 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8076777-076f-4a09-ab27-063d2adaabe5 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:22.207051 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1383d7b-0a30-4bb7-87ca-974ef928f0bd None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:22.211144 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8076777-076f-4a09-ab27-063d2adaabe5 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:22.240227 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026ce41-4e68-41a8-b2e1-704d1452f6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:22.241182 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026ce41-4e68-41a8-b2e1-704d1452f6a6 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:22.241418 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026ce41-4e68-41a8-b2e1-704d1452f6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:22.241689 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026ce41-4e68-41a8-b2e1-704d1452f6a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:22.242515 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026ce41-4e68-41a8-b2e1-704d1452f6a6 None admin] RBAC: Adding query filter params (role.id=0fab680bc76f4a73826e9beb59e8129b, scope.domain.id=default, user.id=91c1e479128840248c7c0e4e51af60ff) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:05:22.242833 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026ce41-4e68-41a8-b2e1-704d1452f6a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:22.244179 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e319b3-88f8-470e-9473-1166c5aaa7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:22.244297 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026ce41-4e68-41a8-b2e1-704d1452f6a6 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:22.244843 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e319b3-88f8-470e-9473-1166c5aaa7b2 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:22.245132 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e319b3-88f8-470e-9473-1166c5aaa7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:22.245410 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e319b3-88f8-470e-9473-1166c5aaa7b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:22.246228 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e319b3-88f8-470e-9473-1166c5aaa7b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:05:22.246535 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e319b3-88f8-470e-9473-1166c5aaa7b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:22.247935 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e319b3-88f8-470e-9473-1166c5aaa7b2 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:22.250775 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 11/20] 10.222.0.24 () {56 vars in 1322 bytes} [Thu Apr 7 06:05:22 2022] GET /identity/v3/role_assignments?user.id=91c1e479128840248c7c0e4e51af60ff&scope.domain.id=default&role.id=0fab680bc76f4a73826e9beb59e8129b => generated 233 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:05:22.266098 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 10/21] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:05:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:24.989885 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb58c8e7-11a0-4012-8f17-4480d7fee92e None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:24.991151 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb58c8e7-11a0-4012-8f17-4480d7fee92e None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:24.991639 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb58c8e7-11a0-4012-8f17-4480d7fee92e None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:24.993484 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 12/22] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:05:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:05:24.999311 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b538a7-b73e-468a-b395-7575acb1a737 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:25.000176 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b538a7-b73e-468a-b395-7575acb1a737 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:25.000657 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b538a7-b73e-468a-b395-7575acb1a737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:25.019240 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-64b538a7-b73e-468a-b395-7575acb1a737 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:05:25.020825 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-64b538a7-b73e-468a-b395-7575acb1a737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:05:25.101406 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 11/23] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:05:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:05:25.143053 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb58c8e7-11a0-4012-8f17-4480d7fee92e None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:25.218620 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332a3bc-0567-4b20-8f41-fbe0e9181b83 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:25.218903 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332a3bc-0567-4b20-8f41-fbe0e9181b83 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:25.219343 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332a3bc-0567-4b20-8f41-fbe0e9181b83 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:25.221122 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 12/24] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:05:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:05:25.226273 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5628d6e-42c8-4ff9-8a5f-9e23ae75d5b6 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:25.226715 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5628d6e-42c8-4ff9-8a5f-9e23ae75d5b6 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:25.227132 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5628d6e-42c8-4ff9-8a5f-9e23ae75d5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:25.260288 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-a5628d6e-42c8-4ff9-8a5f-9e23ae75d5b6 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:05:25.261778 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a5628d6e-42c8-4ff9-8a5f-9e23ae75d5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:05:25.297155 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb58c8e7-11a0-4012-8f17-4480d7fee92e None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:25.374428 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 13/25] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:05:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 07 06:05:25.376657 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dad9a6-be53-43cc-a6f7-e28eed310c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:25.377522 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dad9a6-be53-43cc-a6f7-e28eed310c95 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:25.377818 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dad9a6-be53-43cc-a6f7-e28eed310c95 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:25.378101 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dad9a6-be53-43cc-a6f7-e28eed310c95 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:25.394756 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ae0e5-5631-4046-855e-d6e63b078853 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:25.395258 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ae0e5-5631-4046-855e-d6e63b078853 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:25.395692 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ae0e5-5631-4046-855e-d6e63b078853 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:25.397522 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 14/26] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:05:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 07 06:05:25.398323 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dad9a6-be53-43cc-a6f7-e28eed310c95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:05:25.406057 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fead8f-d759-4f55-a48f-c91e4742131b None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:25.406528 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fead8f-d759-4f55-a48f-c91e4742131b None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:25.406954 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fead8f-d759-4f55-a48f-c91e4742131b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:25.410485 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-b7dad9a6-be53-43cc-a6f7-e28eed310c95 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 07 06:05:25.413002 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 13/27] 10.222.0.24 () {56 vars in 1096 bytes} [Thu Apr 7 06:05:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:05:25.415488 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dad9a6-be53-43cc-a6f7-e28eed310c95 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:25.434735 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-84fead8f-d759-4f55-a48f-c91e4742131b None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:05:25.436183 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-84fead8f-d759-4f55-a48f-c91e4742131b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:05:25.527495 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 15/28] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:05:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 07 06:05:25.528728 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fead8f-d759-4f55-a48f-c91e4742131b None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:25.552203 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dad9a6-be53-43cc-a6f7-e28eed310c95 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:25.587564 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce88c3-cdcc-4db2-bfad-b97be7add60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:25.588622 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce88c3-cdcc-4db2-bfad-b97be7add60c None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:25.589074 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce88c3-cdcc-4db2-bfad-b97be7add60c None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:25.590055 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce88c3-cdcc-4db2-bfad-b97be7add60c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:25.600538 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcce88c3-cdcc-4db2-bfad-b97be7add60c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:25.602180 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcce88c3-cdcc-4db2-bfad-b97be7add60c None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:25.619781 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-dcce88c3-cdcc-4db2-bfad-b97be7add60c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:05:25.621639 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 14/29] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:05:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:05:25.623007 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856f60e-7217-4cd0-8e24-edd9f2fe7d1e None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:25.623469 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856f60e-7217-4cd0-8e24-edd9f2fe7d1e None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:25.623917 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856f60e-7217-4cd0-8e24-edd9f2fe7d1e None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:25.625569 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 15/30] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:05:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:05:25.626405 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856f60e-7217-4cd0-8e24-edd9f2fe7d1e None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:25.641266 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fead8f-d759-4f55-a48f-c91e4742131b None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:25.675775 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b2e39b-0f47-44c5-9e18-22079026755b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:25.676637 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2e39b-0f47-44c5-9e18-22079026755b None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:25.677025 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2e39b-0f47-44c5-9e18-22079026755b None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:25.677415 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2e39b-0f47-44c5-9e18-22079026755b None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:25.678340 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b2e39b-0f47-44c5-9e18-22079026755b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:05:25.678702 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b2e39b-0f47-44c5-9e18-22079026755b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:25.680237 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b2e39b-0f47-44c5-9e18-22079026755b None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:25.692753 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 16/31] 10.222.0.24 () {56 vars in 1099 bytes} [Thu Apr 7 06:05:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:25.693836 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b2e39b-0f47-44c5-9e18-22079026755b None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:25.731662 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856f60e-7217-4cd0-8e24-edd9f2fe7d1e None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:25.774508 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240fe73b-83db-4248-aa22-5a9b758572bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:25.775504 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240fe73b-83db-4248-aa22-5a9b758572bd None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:25.775964 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240fe73b-83db-4248-aa22-5a9b758572bd None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:25.776384 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240fe73b-83db-4248-aa22-5a9b758572bd None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:25.778587 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240fe73b-83db-4248-aa22-5a9b758572bd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:25.779057 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240fe73b-83db-4248-aa22-5a9b758572bd None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:25.797121 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b2e39b-0f47-44c5-9e18-22079026755b None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:25.831027 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e906b-c823-464f-bd35-54b2bf1fe0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:25.831633 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e906b-c823-464f-bd35-54b2bf1fe0a0 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:25.831961 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e906b-c823-464f-bd35-54b2bf1fe0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:25.832241 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e906b-c823-464f-bd35-54b2bf1fe0a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:25.832976 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853e906b-c823-464f-bd35-54b2bf1fe0a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:05:25.833290 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853e906b-c823-464f-bd35-54b2bf1fe0a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:25.834673 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853e906b-c823-464f-bd35-54b2bf1fe0a0 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:25.853422 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 17/32] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:05:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:25.853422 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00558e3a-bf31-4025-83ab-0de4d3c7f642 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:25.853422 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00558e3a-bf31-4025-83ab-0de4d3c7f642 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:25.853422 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00558e3a-bf31-4025-83ab-0de4d3c7f642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:25.876164 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-00558e3a-bf31-4025-83ab-0de4d3c7f642 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:05:25.877653 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-00558e3a-bf31-4025-83ab-0de4d3c7f642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:05:25.952101 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 18/33] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:05:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:05:25.953322 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00558e3a-bf31-4025-83ab-0de4d3c7f642 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:25.998090 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 16/34] 10.222.0.24 () {60 vars in 1131 bytes} [Thu Apr 7 06:05:25 2022] POST /identity/v3/roles => generated 219 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:05:26.001688 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240fe73b-83db-4248-aa22-5a9b758572bd None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:26.074177 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00558e3a-bf31-4025-83ab-0de4d3c7f642 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:26.110585 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a079ff07-d61f-4c28-a2b0-3069e69643c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:26.111402 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079ff07-d61f-4c28-a2b0-3069e69643c2 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:26.111685 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079ff07-d61f-4c28-a2b0-3069e69643c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:26.111992 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079ff07-d61f-4c28-a2b0-3069e69643c2 None admin] PATH_INFO: `/v3/users/91c1e479128840248c7c0e4e51af60ff` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:26.113686 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a079ff07-d61f-4c28-a2b0-3069e69643c2 None admin] RBAC: Authorizing `identity:get_user(user_id=91c1e479128840248c7c0e4e51af60ff)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:26.115126 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a079ff07-d61f-4c28-a2b0-3069e69643c2 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:26.117450 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240fe73b-83db-4248-aa22-5a9b758572bd None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:26.117572 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 19/35] 10.222.0.24 () {56 vars in 1177 bytes} [Thu Apr 7 06:05:25 2022] GET /identity/v3/users/91c1e479128840248c7c0e4e51af60ff => generated 247 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:26.118310 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a079ff07-d61f-4c28-a2b0-3069e69643c2 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:26.156710 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae031d5-1a6f-4408-8c1d-1f6b86e71eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:26.157809 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae031d5-1a6f-4408-8c1d-1f6b86e71eb7 None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:26.158312 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae031d5-1a6f-4408-8c1d-1f6b86e71eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:26.158800 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae031d5-1a6f-4408-8c1d-1f6b86e71eb7 None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:26.159853 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae031d5-1a6f-4408-8c1d-1f6b86e71eb7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:26.161860 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae031d5-1a6f-4408-8c1d-1f6b86e71eb7 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:26.235535 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a079ff07-d61f-4c28-a2b0-3069e69643c2 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:26.275203 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4216a-5a5a-4d47-be8e-a3933a12218e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:26.275947 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4216a-5a5a-4d47-be8e-a3933a12218e None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:26.276234 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4216a-5a5a-4d47-be8e-a3933a12218e None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:26.276526 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4216a-5a5a-4d47-be8e-a3933a12218e None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:26.277862 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b4216a-5a5a-4d47-be8e-a3933a12218e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:26.279794 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b4216a-5a5a-4d47-be8e-a3933a12218e None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:26.288925 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 17/36] 10.222.0.24 () {60 vars in 1141 bytes} [Thu Apr 7 06:05:25 2022] POST /identity/v3/projects => generated 301 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:05:26.290261 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae031d5-1a6f-4408-8c1d-1f6b86e71eb7 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:26.470274 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae031d5-1a6f-4408-8c1d-1f6b86e71eb7 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:26.525686 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628ee16d-5003-46e4-babf-91bd9651f09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:26.526501 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ee16d-5003-46e4-babf-91bd9651f09c None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:26.527332 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ee16d-5003-46e4-babf-91bd9651f09c None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:26.527627 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ee16d-5003-46e4-babf-91bd9651f09c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:26.528870 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628ee16d-5003-46e4-babf-91bd9651f09c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:26.530137 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 20/37] 10.222.0.24 () {60 vars in 1131 bytes} [Thu Apr 7 06:05:26 2022] POST /identity/v3/roles => generated 225 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:05:26.530429 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628ee16d-5003-46e4-babf-91bd9651f09c None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:26.532189 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 18/38] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:05:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:26.538315 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4216a-5a5a-4d47-be8e-a3933a12218e None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:26.631169 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87466cf-133d-4535-bf09-11bfc9fc4012 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:26.631571 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87466cf-133d-4535-bf09-11bfc9fc4012 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:26.631962 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87466cf-133d-4535-bf09-11bfc9fc4012 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:26.633701 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 19/39] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:05:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:05:26.639702 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf8346-e95c-46aa-b293-fd3b8212bae5 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:26.640099 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf8346-e95c-46aa-b293-fd3b8212bae5 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:26.640500 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf8346-e95c-46aa-b293-fd3b8212bae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:26.659336 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-40cf8346-e95c-46aa-b293-fd3b8212bae5 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:05:26.661049 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-40cf8346-e95c-46aa-b293-fd3b8212bae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:05:26.675671 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4216a-5a5a-4d47-be8e-a3933a12218e None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:26.720764 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92a4da3-b402-4efb-a1c1-3cb6179a85d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:26.722233 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a4da3-b402-4efb-a1c1-3cb6179a85d3 None admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:26.722626 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a4da3-b402-4efb-a1c1-3cb6179a85d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:26.723143 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a4da3-b402-4efb-a1c1-3cb6179a85d3 None admin] PATH_INFO: `/v3/domains/default/users/91c1e479128840248c7c0e4e51af60ff/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:26.726457 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92a4da3-b402-4efb-a1c1-3cb6179a85d3 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=91c1e479128840248c7c0e4e51af60ff, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:26.730099 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92a4da3-b402-4efb-a1c1-3cb6179a85d3 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:26.751665 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 20/40] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:05:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 07 06:05:26.776314 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf8346-e95c-46aa-b293-fd3b8212bae5 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:26.840507 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 21/41] 10.222.0.24 () {58 vars in 1361 bytes} [Thu Apr 7 06:05:26 2022] PUT /identity/v3/domains/default/users/91c1e479128840248c7c0e4e51af60ff/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:05:26.842115 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046e487-3746-4c8a-8129-9374caada4ac None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:26.842417 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046e487-3746-4c8a-8129-9374caada4ac None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:26.842702 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046e487-3746-4c8a-8129-9374caada4ac None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:26.844397 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 22/42] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:05:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:05:26.850337 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0ed09-09cf-49a5-a10c-72b513c0459e None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:26.850636 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0ed09-09cf-49a5-a10c-72b513c0459e None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:26.850969 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0ed09-09cf-49a5-a10c-72b513c0459e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:26.870655 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-0fe0ed09-09cf-49a5-a10c-72b513c0459e None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:05:26.872512 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-0fe0ed09-09cf-49a5-a10c-72b513c0459e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:05:26.887265 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf8346-e95c-46aa-b293-fd3b8212bae5 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:26.923588 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c2458-692b-4d47-aa29-1aaf26bfe52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:26.924359 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c2458-692b-4d47-aa29-1aaf26bfe52a None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:26.924658 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c2458-692b-4d47-aa29-1aaf26bfe52a None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:26.924940 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c2458-692b-4d47-aa29-1aaf26bfe52a None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:26.925716 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9c2458-692b-4d47-aa29-1aaf26bfe52a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:26.927154 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9c2458-692b-4d47-aa29-1aaf26bfe52a None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:26.945191 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 23/43] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:05:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 07 06:05:26.971303 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0ed09-09cf-49a5-a10c-72b513c0459e None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:27.001895 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 21/44] 10.222.0.24 () {60 vars in 1131 bytes} [Thu Apr 7 06:05:26 2022] POST /identity/v3/roles => generated 223 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:05:27.077481 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0ed09-09cf-49a5-a10c-72b513c0459e None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:27.112927 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7eafe7-80f9-424a-a7d9-14c916b6afc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:27.113751 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7eafe7-80f9-424a-a7d9-14c916b6afc0 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:27.114044 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7eafe7-80f9-424a-a7d9-14c916b6afc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:27.114325 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7eafe7-80f9-424a-a7d9-14c916b6afc0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:27.115852 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7eafe7-80f9-424a-a7d9-14c916b6afc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:27.117395 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7eafe7-80f9-424a-a7d9-14c916b6afc0 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:27.119288 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 24/45] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:05:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:05:27.125421 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c2458-692b-4d47-aa29-1aaf26bfe52a None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:27.233048 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c2458-692b-4d47-aa29-1aaf26bfe52a None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:27.265595 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85f6cd4-2253-4381-8ec3-92106efbf97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:27.266267 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f6cd4-2253-4381-8ec3-92106efbf97b None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:27.266559 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f6cd4-2253-4381-8ec3-92106efbf97b None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:27.266842 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f6cd4-2253-4381-8ec3-92106efbf97b None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:27.267556 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85f6cd4-2253-4381-8ec3-92106efbf97b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:27.269047 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85f6cd4-2253-4381-8ec3-92106efbf97b None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:27.382923 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 22/46] 10.222.0.24 () {60 vars in 1141 bytes} [Thu Apr 7 06:05:27 2022] POST /identity/v3/projects => generated 312 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:05:29.143144 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb57b4f-2f45-45c9-9bb6-55766585b423 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:29.143654 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb57b4f-2f45-45c9-9bb6-55766585b423 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:29.143856 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb57b4f-2f45-45c9-9bb6-55766585b423 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:29.145233 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 25/47] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:05:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:05:29.150442 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b9a08-dd24-4600-95c6-a56a04ceaecb None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:29.150846 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b9a08-dd24-4600-95c6-a56a04ceaecb None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:29.151013 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b9a08-dd24-4600-95c6-a56a04ceaecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:29.167048 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-2e5b9a08-dd24-4600-95c6-a56a04ceaecb None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:05:29.170756 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-2e5b9a08-dd24-4600-95c6-a56a04ceaecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:05:29.232586 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 23/48] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:05:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:05:29.256928 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb57b4f-2f45-45c9-9bb6-55766585b423 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:29.354337 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb57b4f-2f45-45c9-9bb6-55766585b423 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:29.386881 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60b555-7ee6-401f-b510-64590c38bb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:29.387672 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60b555-7ee6-401f-b510-64590c38bb38 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:29.387983 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60b555-7ee6-401f-b510-64590c38bb38 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:29.388257 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60b555-7ee6-401f-b510-64590c38bb38 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:29.398912 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b60b555-7ee6-401f-b510-64590c38bb38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:05:29.406159 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-2b60b555-7ee6-401f-b510-64590c38bb38 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 07 06:05:29.407515 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 26/49] 10.222.0.24 () {56 vars in 1096 bytes} [Thu Apr 7 06:05:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:05:29.413109 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b9a08-dd24-4600-95c6-a56a04ceaecb None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:29.506408 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b9a08-dd24-4600-95c6-a56a04ceaecb None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:29.538693 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f4519-5b7f-4f4a-98f9-4fb07d5ade85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:29.539360 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f4519-5b7f-4f4a-98f9-4fb07d5ade85 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:29.539644 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f4519-5b7f-4f4a-98f9-4fb07d5ade85 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:29.539955 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f4519-5b7f-4f4a-98f9-4fb07d5ade85 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:29.540698 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5f4519-5b7f-4f4a-98f9-4fb07d5ade85 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:05:29.541010 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5f4519-5b7f-4f4a-98f9-4fb07d5ade85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:29.542413 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5f4519-5b7f-4f4a-98f9-4fb07d5ade85 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:29.550124 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 24/50] 10.222.0.24 () {56 vars in 1099 bytes} [Thu Apr 7 06:05:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:29.555563 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60b555-7ee6-401f-b510-64590c38bb38 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:29.649818 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60b555-7ee6-401f-b510-64590c38bb38 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:29.674211 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b2ad3-88c8-405f-b378-e444dbb11805 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:29.674510 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b2ad3-88c8-405f-b378-e444dbb11805 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:29.674799 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b2ad3-88c8-405f-b378-e444dbb11805 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:29.676219 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 25/51] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:05:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 07 06:05:29.681091 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78817b0c-8744-46b2-9da3-c548b03f142b None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:29.681388 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78817b0c-8744-46b2-9da3-c548b03f142b None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:29.681673 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78817b0c-8744-46b2-9da3-c548b03f142b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:29.684151 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd39cd-dd89-4eda-bf19-b5393be835e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:29.685107 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd39cd-dd89-4eda-bf19-b5393be835e8 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:29.685565 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd39cd-dd89-4eda-bf19-b5393be835e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:29.686061 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd39cd-dd89-4eda-bf19-b5393be835e8 None admin] PATH_INFO: `/v3/users/91c1e479128840248c7c0e4e51af60ff` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:29.688018 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bd39cd-dd89-4eda-bf19-b5393be835e8 None admin] RBAC: Authorizing `identity:get_user(user_id=91c1e479128840248c7c0e4e51af60ff)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:29.690166 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bd39cd-dd89-4eda-bf19-b5393be835e8 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:29.692414 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 27/52] 10.222.0.24 () {56 vars in 1177 bytes} [Thu Apr 7 06:05:29 2022] GET /identity/v3/users/91c1e479128840248c7c0e4e51af60ff => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:29.697774 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd39cd-dd89-4eda-bf19-b5393be835e8 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:29.698246 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-78817b0c-8744-46b2-9da3-c548b03f142b None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:05:29.700108 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-78817b0c-8744-46b2-9da3-c548b03f142b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:05:29.763399 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 26/53] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:05:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 07 06:05:29.787146 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78817b0c-8744-46b2-9da3-c548b03f142b None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:29.795043 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd39cd-dd89-4eda-bf19-b5393be835e8 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:29.827885 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c8100-0a2c-4dd2-a037-af6d4cbc3002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:29.828676 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c8100-0a2c-4dd2-a037-af6d4cbc3002 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:29.828966 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c8100-0a2c-4dd2-a037-af6d4cbc3002 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:29.829241 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c8100-0a2c-4dd2-a037-af6d4cbc3002 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:29.830412 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c8100-0a2c-4dd2-a037-af6d4cbc3002 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:29.831892 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c8100-0a2c-4dd2-a037-af6d4cbc3002 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:29.833502 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 28/54] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:05:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:05:29.839838 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c8100-0a2c-4dd2-a037-af6d4cbc3002 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:29.880904 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78817b0c-8744-46b2-9da3-c548b03f142b None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:29.913290 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4ced3-f598-49f0-b4cd-d1666bcf6c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:29.914022 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4ced3-f598-49f0-b4cd-d1666bcf6c35 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:29.914309 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4ced3-f598-49f0-b4cd-d1666bcf6c35 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:29.914587 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4ced3-f598-49f0-b4cd-d1666bcf6c35 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:29.915783 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a4ced3-f598-49f0-b4cd-d1666bcf6c35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:29.917227 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a4ced3-f598-49f0-b4cd-d1666bcf6c35 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:29.919067 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 27/55] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:05:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:05:29.924294 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4ced3-f598-49f0-b4cd-d1666bcf6c35 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:29.934474 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c8100-0a2c-4dd2-a037-af6d4cbc3002 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:29.966450 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d269871-ec6f-4d09-a82e-37976a10e9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:29.967125 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d269871-ec6f-4d09-a82e-37976a10e9d6 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:29.967417 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d269871-ec6f-4d09-a82e-37976a10e9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:29.967701 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d269871-ec6f-4d09-a82e-37976a10e9d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:29.968580 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d269871-ec6f-4d09-a82e-37976a10e9d6 None admin] RBAC: Adding query filter params (role.id=0fab680bc76f4a73826e9beb59e8129b, scope.domain.id=default, user.id=91c1e479128840248c7c0e4e51af60ff) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:05:29.968900 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d269871-ec6f-4d09-a82e-37976a10e9d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:29.970354 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d269871-ec6f-4d09-a82e-37976a10e9d6 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:29.978286 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 29/56] 10.222.0.24 () {56 vars in 1322 bytes} [Thu Apr 7 06:05:29 2022] GET /identity/v3/role_assignments?user.id=91c1e479128840248c7c0e4e51af60ff&scope.domain.id=default&role.id=0fab680bc76f4a73826e9beb59e8129b => generated 530 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:05:30.021116 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4ced3-f598-49f0-b4cd-d1666bcf6c35 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:30.056406 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d3cabc-f1ef-4b04-aa02-ab6f0b86561a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:30.057094 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3cabc-f1ef-4b04-aa02-ab6f0b86561a None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:30.057378 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3cabc-f1ef-4b04-aa02-ab6f0b86561a None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:30.057654 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3cabc-f1ef-4b04-aa02-ab6f0b86561a None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:30.058416 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d3cabc-f1ef-4b04-aa02-ab6f0b86561a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:30.059905 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d3cabc-f1ef-4b04-aa02-ab6f0b86561a None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:30.230815 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 28/57] 10.222.0.24 () {60 vars in 1140 bytes} [Thu Apr 7 06:05:29 2022] POST /identity/v3/projects => generated 298 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:05:32.496332 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358928cc-67a0-415d-81b3-0bc60b58a551 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:32.496865 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358928cc-67a0-415d-81b3-0bc60b58a551 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:32.496946 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358928cc-67a0-415d-81b3-0bc60b58a551 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:32.498293 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 30/58] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:05:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:05:32.503381 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd45c1-2a5d-40cc-a87c-e4db01844a0c None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:32.503776 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd45c1-2a5d-40cc-a87c-e4db01844a0c None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:32.503986 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd45c1-2a5d-40cc-a87c-e4db01844a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:32.520012 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-97cd45c1-2a5d-40cc-a87c-e4db01844a0c None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:05:32.521171 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-97cd45c1-2a5d-40cc-a87c-e4db01844a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:05:32.582558 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 29/59] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:05:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:05:32.609257 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358928cc-67a0-415d-81b3-0bc60b58a551 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:32.704915 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358928cc-67a0-415d-81b3-0bc60b58a551 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:32.741505 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3137b22a-6215-4147-a38c-5cdc287815b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:32.742305 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137b22a-6215-4147-a38c-5cdc287815b9 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:32.742688 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137b22a-6215-4147-a38c-5cdc287815b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:32.742976 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137b22a-6215-4147-a38c-5cdc287815b9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:32.744183 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3137b22a-6215-4147-a38c-5cdc287815b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:32.745672 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3137b22a-6215-4147-a38c-5cdc287815b9 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:32.747371 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 31/60] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:05:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:32.753918 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cd45c1-2a5d-40cc-a87c-e4db01844a0c None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:32.847314 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cd45c1-2a5d-40cc-a87c-e4db01844a0c None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:32.879365 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bab180-3e2d-4bdc-88cb-8ed912c80dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:32.880067 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bab180-3e2d-4bdc-88cb-8ed912c80dd2 None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:32.880361 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bab180-3e2d-4bdc-88cb-8ed912c80dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:32.880644 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bab180-3e2d-4bdc-88cb-8ed912c80dd2 None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:32.881359 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bab180-3e2d-4bdc-88cb-8ed912c80dd2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:32.882823 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bab180-3e2d-4bdc-88cb-8ed912c80dd2 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:32.983608 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 30/61] 10.222.0.24 () {60 vars in 1132 bytes} [Thu Apr 7 06:05:32 2022] POST /identity/v3/users => generated 275 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:05:36.394234 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93e44e-ad82-40b1-940b-f3e42698a328 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:36.394776 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93e44e-ad82-40b1-940b-f3e42698a328 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:36.394776 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93e44e-ad82-40b1-940b-f3e42698a328 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:36.396193 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 32/62] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:05:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:05:36.406640 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc8adc-2106-498a-955d-9645de7532b4 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:36.407113 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc8adc-2106-498a-955d-9645de7532b4 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:36.407203 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc8adc-2106-498a-955d-9645de7532b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:36.432817 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-d0bc8adc-2106-498a-955d-9645de7532b4 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:05:36.434013 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d0bc8adc-2106-498a-955d-9645de7532b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:05:36.528359 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 31/63] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:05:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:05:36.554395 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba979cdc-a5df-4704-97ce-d9fc07f6605e None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:36.554679 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba979cdc-a5df-4704-97ce-d9fc07f6605e None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:36.554959 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba979cdc-a5df-4704-97ce-d9fc07f6605e None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:36.556355 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 33/64] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:05:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:05:36.566583 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba979cdc-a5df-4704-97ce-d9fc07f6605e None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:36.567199 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c17ea-14e0-45ec-8c3c-ab896488a039 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:36.567498 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c17ea-14e0-45ec-8c3c-ab896488a039 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:36.569134 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c17ea-14e0-45ec-8c3c-ab896488a039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:36.596856 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-c38c17ea-14e0-45ec-8c3c-ab896488a039 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:05:36.598310 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-c38c17ea-14e0-45ec-8c3c-ab896488a039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:05:36.677655 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba979cdc-a5df-4704-97ce-d9fc07f6605e None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:36.734144 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df7620-3e10-471b-9cd0-532babacca1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:36.735398 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df7620-3e10-471b-9cd0-532babacca1a None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:36.736104 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 32/65] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:05:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:05:36.737681 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938fe5f4-a22f-48be-9725-031f57a2ce13 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:36.738180 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938fe5f4-a22f-48be-9725-031f57a2ce13 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:36.738659 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938fe5f4-a22f-48be-9725-031f57a2ce13 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:36.740930 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 33/66] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:05:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:05:36.745978 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df7620-3e10-471b-9cd0-532babacca1a None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:36.745978 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df7620-3e10-471b-9cd0-532babacca1a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:36.747819 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf93ec5-426b-4ace-bfae-d5be6dd2f05b None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:36.748325 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf93ec5-426b-4ace-bfae-d5be6dd2f05b None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:36.749132 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf93ec5-426b-4ace-bfae-d5be6dd2f05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:36.765733 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77df7620-3e10-471b-9cd0-532babacca1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:05:36.776490 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-77df7620-3e10-471b-9cd0-532babacca1a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 07 06:05:36.782190 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 34/67] 10.222.0.24 () {56 vars in 1096 bytes} [Thu Apr 7 06:05:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 07 06:05:36.782190 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df7620-3e10-471b-9cd0-532babacca1a None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:36.788034 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-6bf93ec5-426b-4ace-bfae-d5be6dd2f05b None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:05:36.789230 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-6bf93ec5-426b-4ace-bfae-d5be6dd2f05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:05:36.879481 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 34/68] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:05:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 07 06:05:36.880901 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf93ec5-426b-4ace-bfae-d5be6dd2f05b None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:36.913980 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df7620-3e10-471b-9cd0-532babacca1a None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:36.948973 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f79dc52-0877-4cc5-94e9-55d23d586857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:36.949993 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f79dc52-0877-4cc5-94e9-55d23d586857 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:36.950448 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f79dc52-0877-4cc5-94e9-55d23d586857 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:36.950872 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f79dc52-0877-4cc5-94e9-55d23d586857 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:36.968267 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f79dc52-0877-4cc5-94e9-55d23d586857 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:05:36.975369 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-7f79dc52-0877-4cc5-94e9-55d23d586857 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 07 06:05:36.977091 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 35/69] 10.222.0.24 () {56 vars in 1099 bytes} [Thu Apr 7 06:05:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:05:36.978021 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f79dc52-0877-4cc5-94e9-55d23d586857 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:37.001647 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf93ec5-426b-4ace-bfae-d5be6dd2f05b None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:37.042148 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee1c40-0de8-41bd-b59b-135176441ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:37.042831 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee1c40-0de8-41bd-b59b-135176441ec0 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:37.043119 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee1c40-0de8-41bd-b59b-135176441ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:37.043397 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee1c40-0de8-41bd-b59b-135176441ec0 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:37.044187 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee1c40-0de8-41bd-b59b-135176441ec0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:05:37.044498 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee1c40-0de8-41bd-b59b-135176441ec0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:37.045878 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee1c40-0de8-41bd-b59b-135176441ec0 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:37.053753 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 35/70] 10.222.0.24 () {56 vars in 1099 bytes} [Thu Apr 7 06:05:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:37.054537 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee1c40-0de8-41bd-b59b-135176441ec0 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:37.078213 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f79dc52-0877-4cc5-94e9-55d23d586857 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:37.108933 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b52fda-25c2-482f-8c3e-54e264d4f62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:37.109735 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b52fda-25c2-482f-8c3e-54e264d4f62c None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:37.110025 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b52fda-25c2-482f-8c3e-54e264d4f62c None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:37.110309 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b52fda-25c2-482f-8c3e-54e264d4f62c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:37.120676 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b52fda-25c2-482f-8c3e-54e264d4f62c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:05:37.127470 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-e6b52fda-25c2-482f-8c3e-54e264d4f62c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 07 06:05:37.128680 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 36/71] 10.222.0.24 () {56 vars in 1099 bytes} [Thu Apr 7 06:05:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:05:37.129863 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41162782-d903-4073-9081-c093ad393dbf None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:37.130154 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41162782-d903-4073-9081-c093ad393dbf None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:37.130436 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41162782-d903-4073-9081-c093ad393dbf None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:37.131889 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 37/72] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:05:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:05:37.133533 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e932649-c16d-440e-8893-836579e0619f None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:37.134030 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e932649-c16d-440e-8893-836579e0619f None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:37.134318 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e932649-c16d-440e-8893-836579e0619f None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:37.136888 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 38/73] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:05:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:05:37.136888 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e932649-c16d-440e-8893-836579e0619f None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:37.149629 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee1c40-0de8-41bd-b59b-135176441ec0 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:37.181270 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5e6bfc-2eb1-4b9b-8123-9f4fd3a0c7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:37.181931 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e6bfc-2eb1-4b9b-8123-9f4fd3a0c7f8 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:37.182245 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e6bfc-2eb1-4b9b-8123-9f4fd3a0c7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:37.183023 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e6bfc-2eb1-4b9b-8123-9f4fd3a0c7f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:37.183814 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5e6bfc-2eb1-4b9b-8123-9f4fd3a0c7f8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:05:37.184127 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5e6bfc-2eb1-4b9b-8123-9f4fd3a0c7f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:37.185513 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5e6bfc-2eb1-4b9b-8123-9f4fd3a0c7f8 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:37.197500 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 36/74] 10.222.0.24 () {56 vars in 1101 bytes} [Thu Apr 7 06:05:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:37.197500 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5e6bfc-2eb1-4b9b-8123-9f4fd3a0c7f8 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:37.236275 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e932649-c16d-440e-8893-836579e0619f None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:37.268526 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206803e3-27e2-40d4-92f1-fe0139a818e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:37.269393 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206803e3-27e2-40d4-92f1-fe0139a818e9 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:37.269681 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206803e3-27e2-40d4-92f1-fe0139a818e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:37.269961 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206803e3-27e2-40d4-92f1-fe0139a818e9 None admin] PATH_INFO: `/v3/users/91c1e479128840248c7c0e4e51af60ff` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:37.271154 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206803e3-27e2-40d4-92f1-fe0139a818e9 None admin] RBAC: Authorizing `identity:get_user(user_id=91c1e479128840248c7c0e4e51af60ff)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:37.272638 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206803e3-27e2-40d4-92f1-fe0139a818e9 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:37.274255 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 39/75] 10.222.0.24 () {56 vars in 1177 bytes} [Thu Apr 7 06:05:37 2022] GET /identity/v3/users/91c1e479128840248c7c0e4e51af60ff => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:37.274255 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839b3e8-cec2-49d2-8cb9-19501cce2054 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:37.274255 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839b3e8-cec2-49d2-8cb9-19501cce2054 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:37.274255 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839b3e8-cec2-49d2-8cb9-19501cce2054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:37.290456 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5e6bfc-2eb1-4b9b-8123-9f4fd3a0c7f8 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:37.291148 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-d839b3e8-cec2-49d2-8cb9-19501cce2054 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:05:37.292357 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d839b3e8-cec2-49d2-8cb9-19501cce2054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:05:37.322571 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d506dc90-b71e-4c6f-a379-2978d1f1575e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:37.323861 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506dc90-b71e-4c6f-a379-2978d1f1575e None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:37.324152 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506dc90-b71e-4c6f-a379-2978d1f1575e None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:37.324430 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506dc90-b71e-4c6f-a379-2978d1f1575e None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:37.325179 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d506dc90-b71e-4c6f-a379-2978d1f1575e None admin] RBAC: Adding query filter params (name=member) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:05:37.325492 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d506dc90-b71e-4c6f-a379-2978d1f1575e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:37.326887 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d506dc90-b71e-4c6f-a379-2978d1f1575e None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:37.334793 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 37/76] 10.222.0.24 () {56 vars in 1101 bytes} [Thu Apr 7 06:05:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:37.335853 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad31fc-cdfe-4ef9-9836-09e6bf8489e9 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:37.336148 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad31fc-cdfe-4ef9-9836-09e6bf8489e9 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:37.336435 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad31fc-cdfe-4ef9-9836-09e6bf8489e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:37.352273 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-79ad31fc-cdfe-4ef9-9836-09e6bf8489e9 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:05:37.353444 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-79ad31fc-cdfe-4ef9-9836-09e6bf8489e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:05:37.360205 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 40/77] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:05:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:05:37.361052 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d839b3e8-cec2-49d2-8cb9-19501cce2054 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:37.419140 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 38/78] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:05:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:05:37.419828 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad31fc-cdfe-4ef9-9836-09e6bf8489e9 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:37.455100 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d839b3e8-cec2-49d2-8cb9-19501cce2054 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:37.486474 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cf1363-26c5-48d3-86f5-ec045492d4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:37.487285 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf1363-26c5-48d3-86f5-ec045492d4a3 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:37.487571 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf1363-26c5-48d3-86f5-ec045492d4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:37.487881 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf1363-26c5-48d3-86f5-ec045492d4a3 None admin] PATH_INFO: `/v3/users/e3ccb23df7814ee8bbd9a0cd75ed58d6` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:37.502602 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cf1363-26c5-48d3-86f5-ec045492d4a3 None admin] RBAC: Authorizing `identity:get_user(user_id=e3ccb23df7814ee8bbd9a0cd75ed58d6)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:37.504091 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cf1363-26c5-48d3-86f5-ec045492d4a3 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:37.505732 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 41/79] 10.222.0.24 () {56 vars in 1177 bytes} [Thu Apr 7 06:05:37 2022] GET /identity/v3/users/e3ccb23df7814ee8bbd9a0cd75ed58d6 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:37.506496 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cf1363-26c5-48d3-86f5-ec045492d4a3 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:37.513541 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad31fc-cdfe-4ef9-9836-09e6bf8489e9 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:37.545463 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f443f2f-1cf6-4f83-9023-cc497ea47da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:37.546116 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f443f2f-1cf6-4f83-9023-cc497ea47da1 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:37.546405 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f443f2f-1cf6-4f83-9023-cc497ea47da1 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:37.546682 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f443f2f-1cf6-4f83-9023-cc497ea47da1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:37.596212 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cf1363-26c5-48d3-86f5-ec045492d4a3 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:37.609173 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f443f2f-1cf6-4f83-9023-cc497ea47da1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:37.610652 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f443f2f-1cf6-4f83-9023-cc497ea47da1 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:37.627887 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd87bc9-9c1d-4ffc-9683-4ae68cd163e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:37.628740 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd87bc9-9c1d-4ffc-9683-4ae68cd163e2 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:37.629027 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd87bc9-9c1d-4ffc-9683-4ae68cd163e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:37.629302 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd87bc9-9c1d-4ffc-9683-4ae68cd163e2 None admin] PATH_INFO: `/v3/users/e3ccb23df7814ee8bbd9a0cd75ed58d6` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:37.630477 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd87bc9-9c1d-4ffc-9683-4ae68cd163e2 None admin] RBAC: Authorizing `identity:get_user(user_id=e3ccb23df7814ee8bbd9a0cd75ed58d6)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:37.631903 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd87bc9-9c1d-4ffc-9683-4ae68cd163e2 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:37.633499 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 42/80] 10.222.0.24 () {56 vars in 1177 bytes} [Thu Apr 7 06:05:37 2022] GET /identity/v3/users/e3ccb23df7814ee8bbd9a0cd75ed58d6 => generated 275 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:37.633499 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd87bc9-9c1d-4ffc-9683-4ae68cd163e2 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:37.702524 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 39/81] 10.222.0.24 () {58 vars in 1282 bytes} [Thu Apr 7 06:05:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 07 06:05:37.703279 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f443f2f-1cf6-4f83-9023-cc497ea47da1 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:37.725983 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd87bc9-9c1d-4ffc-9683-4ae68cd163e2 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:37.760947 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d21b08-1cd0-404a-803d-6ec92d8f2346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:37.760947 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d21b08-1cd0-404a-803d-6ec92d8f2346 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:37.760947 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d21b08-1cd0-404a-803d-6ec92d8f2346 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:37.760947 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d21b08-1cd0-404a-803d-6ec92d8f2346 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:37.769953 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d21b08-1cd0-404a-803d-6ec92d8f2346 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:05:37.777718 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-16d21b08-1cd0-404a-803d-6ec92d8f2346 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 07 06:05:37.778950 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 43/82] 10.222.0.24 () {56 vars in 1114 bytes} [Thu Apr 7 06:05:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:05:37.779725 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d21b08-1cd0-404a-803d-6ec92d8f2346 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:37.803090 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f443f2f-1cf6-4f83-9023-cc497ea47da1 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:37.834190 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a4b8f-8b9a-4f6c-9fc6-cba0ae92c774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:37.834974 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a4b8f-8b9a-4f6c-9fc6-cba0ae92c774 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:37.835259 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a4b8f-8b9a-4f6c-9fc6-cba0ae92c774 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:37.835536 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a4b8f-8b9a-4f6c-9fc6-cba0ae92c774 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:37.836720 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391a4b8f-8b9a-4f6c-9fc6-cba0ae92c774 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:37.838472 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391a4b8f-8b9a-4f6c-9fc6-cba0ae92c774 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:37.840644 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 40/83] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:05:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:37.841405 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a4b8f-8b9a-4f6c-9fc6-cba0ae92c774 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:37.875544 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d21b08-1cd0-404a-803d-6ec92d8f2346 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:37.907071 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb52b1b-1515-4670-a0db-5e24b409cd7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:37.907728 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb52b1b-1515-4670-a0db-5e24b409cd7b None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:37.908049 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb52b1b-1515-4670-a0db-5e24b409cd7b None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:37.908336 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb52b1b-1515-4670-a0db-5e24b409cd7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:37.933666 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a4b8f-8b9a-4f6c-9fc6-cba0ae92c774 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:37.965296 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3437cd71-70de-45cc-af9a-ac4cf021564f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:37.965935 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437cd71-70de-45cc-af9a-ac4cf021564f None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:37.966228 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437cd71-70de-45cc-af9a-ac4cf021564f None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:37.966507 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437cd71-70de-45cc-af9a-ac4cf021564f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:37.971134 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb52b1b-1515-4670-a0db-5e24b409cd7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:37.972632 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb52b1b-1515-4670-a0db-5e24b409cd7b None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:38.029146 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3437cd71-70de-45cc-af9a-ac4cf021564f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:38.030608 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3437cd71-70de-45cc-af9a-ac4cf021564f None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:38.064273 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 44/84] 10.222.0.24 () {58 vars in 1282 bytes} [Thu Apr 7 06:05:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 07 06:05:38.065104 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb52b1b-1515-4670-a0db-5e24b409cd7b None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:38.122642 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 41/85] 10.222.0.24 () {58 vars in 1282 bytes} [Thu Apr 7 06:05:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 07 06:05:38.123493 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3437cd71-70de-45cc-af9a-ac4cf021564f None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:38.156947 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb52b1b-1515-4670-a0db-5e24b409cd7b None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:38.188554 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3c8ffb-3814-41c2-8444-c37810ab1882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:38.189422 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c8ffb-3814-41c2-8444-c37810ab1882 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:38.189713 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c8ffb-3814-41c2-8444-c37810ab1882 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:38.189993 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c8ffb-3814-41c2-8444-c37810ab1882 None admin] PATH_INFO: `/v3/projects/f2feaca3faed4ec0a547bb377a6f494e` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:38.191178 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3c8ffb-3814-41c2-8444-c37810ab1882 None admin] RBAC: Authorizing `identity:get_project(project_id=f2feaca3faed4ec0a547bb377a6f494e)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:38.192666 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3c8ffb-3814-41c2-8444-c37810ab1882 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:38.194517 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 45/86] 10.222.0.24 () {56 vars in 1186 bytes} [Thu Apr 7 06:05:38 2022] GET /identity/v3/projects/f2feaca3faed4ec0a547bb377a6f494e => generated 298 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:38.195107 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3c8ffb-3814-41c2-8444-c37810ab1882 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:38.215240 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3437cd71-70de-45cc-af9a-ac4cf021564f None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:38.247598 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1203812-fded-46aa-be9a-6d1dc3f83bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:38.248290 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1203812-fded-46aa-be9a-6d1dc3f83bde None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:38.248581 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1203812-fded-46aa-be9a-6d1dc3f83bde None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:38.248862 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1203812-fded-46aa-be9a-6d1dc3f83bde None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:38.249613 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1203812-fded-46aa-be9a-6d1dc3f83bde None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:05:38.249928 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1203812-fded-46aa-be9a-6d1dc3f83bde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:38.251295 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1203812-fded-46aa-be9a-6d1dc3f83bde None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:38.258823 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 42/87] 10.222.0.24 () {56 vars in 1111 bytes} [Thu Apr 7 06:05:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:38.260674 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1203812-fded-46aa-be9a-6d1dc3f83bde None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:38.286858 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3c8ffb-3814-41c2-8444-c37810ab1882 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:38.318805 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363d44d-9265-4e9b-aca7-6fa91b66621c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:38.319478 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363d44d-9265-4e9b-aca7-6fa91b66621c None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:38.319787 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363d44d-9265-4e9b-aca7-6fa91b66621c None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:38.320072 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363d44d-9265-4e9b-aca7-6fa91b66621c None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:38.320781 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f363d44d-9265-4e9b-aca7-6fa91b66621c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:38.322210 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f363d44d-9265-4e9b-aca7-6fa91b66621c None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:38.352991 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1203812-fded-46aa-be9a-6d1dc3f83bde None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:38.385103 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cdd43a-64c5-491a-afc8-c3eba394579c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:38.386002 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cdd43a-64c5-491a-afc8-c3eba394579c None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:38.386292 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cdd43a-64c5-491a-afc8-c3eba394579c None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:38.386572 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cdd43a-64c5-491a-afc8-c3eba394579c None admin] PATH_INFO: `/v3/projects/f2feaca3faed4ec0a547bb377a6f494e` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:38.387773 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cdd43a-64c5-491a-afc8-c3eba394579c None admin] RBAC: Authorizing `identity:get_project(project_id=f2feaca3faed4ec0a547bb377a6f494e)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:38.389231 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cdd43a-64c5-491a-afc8-c3eba394579c None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:38.390931 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 43/88] 10.222.0.24 () {56 vars in 1186 bytes} [Thu Apr 7 06:05:38 2022] GET /identity/v3/projects/f2feaca3faed4ec0a547bb377a6f494e => generated 298 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:38.391699 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cdd43a-64c5-491a-afc8-c3eba394579c None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:38.411769 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 46/89] 10.222.0.24 () {60 vars in 1132 bytes} [Thu Apr 7 06:05:38 2022] POST /identity/v3/users => generated 289 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:05:38.412610 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363d44d-9265-4e9b-aca7-6fa91b66621c None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:38.493756 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cdd43a-64c5-491a-afc8-c3eba394579c None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:38.517869 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363d44d-9265-4e9b-aca7-6fa91b66621c None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:38.528971 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f189bb79-486d-4181-97c9-d56f1d95b394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:38.529849 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189bb79-486d-4181-97c9-d56f1d95b394 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:38.530229 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189bb79-486d-4181-97c9-d56f1d95b394 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:38.530440 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189bb79-486d-4181-97c9-d56f1d95b394 None admin] PATH_INFO: `/v3/projects/84640c32095b4e75b3c06b07a4e11f7b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:38.531640 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f189bb79-486d-4181-97c9-d56f1d95b394 None admin] RBAC: Authorizing `identity:get_project(project_id=84640c32095b4e75b3c06b07a4e11f7b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:38.533138 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f189bb79-486d-4181-97c9-d56f1d95b394 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:38.540326 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 44/90] 10.222.0.24 () {56 vars in 1186 bytes} [Thu Apr 7 06:05:38 2022] GET /identity/v3/projects/84640c32095b4e75b3c06b07a4e11f7b => generated 312 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:38.540326 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f189bb79-486d-4181-97c9-d56f1d95b394 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:38.552968 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e17938a-f0f7-455f-a8f9-a89e5b40797e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:38.554011 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17938a-f0f7-455f-a8f9-a89e5b40797e None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:38.554519 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17938a-f0f7-455f-a8f9-a89e5b40797e None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:38.555041 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17938a-f0f7-455f-a8f9-a89e5b40797e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:38.556017 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e17938a-f0f7-455f-a8f9-a89e5b40797e None admin] RBAC: Adding query filter params (role.id=0fab680bc76f4a73826e9beb59e8129b, scope.project.id=f2feaca3faed4ec0a547bb377a6f494e, user.id=91c1e479128840248c7c0e4e51af60ff) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:05:38.556340 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e17938a-f0f7-455f-a8f9-a89e5b40797e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:38.558369 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e17938a-f0f7-455f-a8f9-a89e5b40797e None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:38.564268 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 47/91] 10.222.0.24 () {56 vars in 1374 bytes} [Thu Apr 7 06:05:38 2022] GET /identity/v3/role_assignments?user.id=91c1e479128840248c7c0e4e51af60ff&scope.project.id=f2feaca3faed4ec0a547bb377a6f494e&role.id=0fab680bc76f4a73826e9beb59e8129b => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:38.564268 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e17938a-f0f7-455f-a8f9-a89e5b40797e None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:38.649534 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f189bb79-486d-4181-97c9-d56f1d95b394 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:38.675689 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e17938a-f0f7-455f-a8f9-a89e5b40797e None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:38.686713 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6036ce72-ee1d-4eb5-a00c-24831f9dcf4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:38.687713 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6036ce72-ee1d-4eb5-a00c-24831f9dcf4b None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:38.688051 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6036ce72-ee1d-4eb5-a00c-24831f9dcf4b None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:38.688322 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6036ce72-ee1d-4eb5-a00c-24831f9dcf4b None admin] PATH_INFO: `/v3/users/e3ccb23df7814ee8bbd9a0cd75ed58d6` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:38.689615 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6036ce72-ee1d-4eb5-a00c-24831f9dcf4b None admin] RBAC: Authorizing `identity:get_user(user_id=e3ccb23df7814ee8bbd9a0cd75ed58d6)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:38.691101 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6036ce72-ee1d-4eb5-a00c-24831f9dcf4b None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:38.692895 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 45/92] 10.222.0.24 () {56 vars in 1177 bytes} [Thu Apr 7 06:05:38 2022] GET /identity/v3/users/e3ccb23df7814ee8bbd9a0cd75ed58d6 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:38.693703 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6036ce72-ee1d-4eb5-a00c-24831f9dcf4b None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:38.721085 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffaccdf-e1c8-4ac0-9b8b-cb6501842116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:38.721777 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffaccdf-e1c8-4ac0-9b8b-cb6501842116 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:38.722064 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffaccdf-e1c8-4ac0-9b8b-cb6501842116 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:38.722342 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffaccdf-e1c8-4ac0-9b8b-cb6501842116 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:38.723199 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffaccdf-e1c8-4ac0-9b8b-cb6501842116 None admin] RBAC: Adding query filter params (role.id=7abd6a5977df4ff4a5476c2d95a1934b, scope.project.id=f2feaca3faed4ec0a547bb377a6f494e, user.id=e3ccb23df7814ee8bbd9a0cd75ed58d6) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:05:38.723512 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffaccdf-e1c8-4ac0-9b8b-cb6501842116 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:38.725065 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffaccdf-e1c8-4ac0-9b8b-cb6501842116 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:38.733499 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 48/93] 10.222.0.24 () {56 vars in 1374 bytes} [Thu Apr 7 06:05:38 2022] GET /identity/v3/role_assignments?user.id=e3ccb23df7814ee8bbd9a0cd75ed58d6&scope.project.id=f2feaca3faed4ec0a547bb377a6f494e&role.id=7abd6a5977df4ff4a5476c2d95a1934b => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:38.733676 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffaccdf-e1c8-4ac0-9b8b-cb6501842116 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:38.834111 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6036ce72-ee1d-4eb5-a00c-24831f9dcf4b None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:38.886692 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffaccdf-e1c8-4ac0-9b8b-cb6501842116 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:38.896566 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2568b514-f95a-4bff-8ab8-fdbbacbebdb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:38.897271 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568b514-f95a-4bff-8ab8-fdbbacbebdb9 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:38.897562 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568b514-f95a-4bff-8ab8-fdbbacbebdb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:38.897843 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568b514-f95a-4bff-8ab8-fdbbacbebdb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:38.898705 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2568b514-f95a-4bff-8ab8-fdbbacbebdb9 None admin] RBAC: Adding query filter params (role.id=7abd6a5977df4ff4a5476c2d95a1934b, scope.project.id=84640c32095b4e75b3c06b07a4e11f7b, user.id=e3ccb23df7814ee8bbd9a0cd75ed58d6) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:05:38.899031 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2568b514-f95a-4bff-8ab8-fdbbacbebdb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:38.900574 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2568b514-f95a-4bff-8ab8-fdbbacbebdb9 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:38.906771 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 46/94] 10.222.0.24 () {56 vars in 1374 bytes} [Thu Apr 7 06:05:38 2022] GET /identity/v3/role_assignments?user.id=e3ccb23df7814ee8bbd9a0cd75ed58d6&scope.project.id=84640c32095b4e75b3c06b07a4e11f7b&role.id=7abd6a5977df4ff4a5476c2d95a1934b => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:38.936703 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482aa788-726a-4eb6-a73d-b5fac027361d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:38.937408 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482aa788-726a-4eb6-a73d-b5fac027361d None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:38.937695 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482aa788-726a-4eb6-a73d-b5fac027361d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:38.937976 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482aa788-726a-4eb6-a73d-b5fac027361d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:39.018233 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482aa788-726a-4eb6-a73d-b5fac027361d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:39.019848 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482aa788-726a-4eb6-a73d-b5fac027361d None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:39.127158 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 49/95] 10.222.0.24 () {58 vars in 1282 bytes} [Thu Apr 7 06:05:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 07 06:05:39.132603 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2568b514-f95a-4bff-8ab8-fdbbacbebdb9 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:39.251790 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2568b514-f95a-4bff-8ab8-fdbbacbebdb9 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:39.291136 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc69604-1f09-462b-b50e-b28560df2c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:39.292414 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc69604-1f09-462b-b50e-b28560df2c73 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:39.292904 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc69604-1f09-462b-b50e-b28560df2c73 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:39.293401 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc69604-1f09-462b-b50e-b28560df2c73 None admin] PATH_INFO: `/v3/projects/f2feaca3faed4ec0a547bb377a6f494e` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:39.294802 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc69604-1f09-462b-b50e-b28560df2c73 None admin] RBAC: Authorizing `identity:get_project(project_id=f2feaca3faed4ec0a547bb377a6f494e)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:39.296499 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc69604-1f09-462b-b50e-b28560df2c73 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:39.299537 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 47/96] 10.222.0.24 () {56 vars in 1186 bytes} [Thu Apr 7 06:05:39 2022] GET /identity/v3/projects/f2feaca3faed4ec0a547bb377a6f494e => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:39.304366 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482aa788-726a-4eb6-a73d-b5fac027361d None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:39.438687 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482aa788-726a-4eb6-a73d-b5fac027361d None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:39.479198 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76507e4f-ae97-4af3-a9a9-0cccd493ae81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:39.479944 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76507e4f-ae97-4af3-a9a9-0cccd493ae81 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:39.480234 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76507e4f-ae97-4af3-a9a9-0cccd493ae81 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:39.480563 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76507e4f-ae97-4af3-a9a9-0cccd493ae81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:39.481449 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76507e4f-ae97-4af3-a9a9-0cccd493ae81 None admin] RBAC: Adding query filter params (role.id=7ad9776ea3b0430cb02c4599d037c8be, scope.project.id=f2feaca3faed4ec0a547bb377a6f494e, user.id=e3ccb23df7814ee8bbd9a0cd75ed58d6) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:05:39.481769 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76507e4f-ae97-4af3-a9a9-0cccd493ae81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:39.483206 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76507e4f-ae97-4af3-a9a9-0cccd493ae81 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:39.488876 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 50/97] 10.222.0.24 () {56 vars in 1374 bytes} [Thu Apr 7 06:05:39 2022] GET /identity/v3/role_assignments?user.id=e3ccb23df7814ee8bbd9a0cd75ed58d6&scope.project.id=f2feaca3faed4ec0a547bb377a6f494e&role.id=7ad9776ea3b0430cb02c4599d037c8be => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:41.624055 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867df1e6-4c5d-48fd-8795-e40296d5a490 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:41.625089 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867df1e6-4c5d-48fd-8795-e40296d5a490 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:41.625590 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867df1e6-4c5d-48fd-8795-e40296d5a490 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:41.627478 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 48/98] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:05:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:05:41.632406 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a830e-7dc0-4a4d-ae48-31b7cd21941f None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:41.632829 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a830e-7dc0-4a4d-ae48-31b7cd21941f None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:41.632965 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a830e-7dc0-4a4d-ae48-31b7cd21941f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:41.653559 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-c99a830e-7dc0-4a4d-ae48-31b7cd21941f None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:05:41.654987 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c99a830e-7dc0-4a4d-ae48-31b7cd21941f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:05:41.742395 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 51/99] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:05:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:05:41.790805 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867df1e6-4c5d-48fd-8795-e40296d5a490 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:41.958071 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867df1e6-4c5d-48fd-8795-e40296d5a490 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:41.971929 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf4e2d-86c9-4050-85d6-c9e874658114 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:41.972583 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf4e2d-86c9-4050-85d6-c9e874658114 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:41.973079 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf4e2d-86c9-4050-85d6-c9e874658114 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:41.974740 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 52/100] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:05:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 07 06:05:41.981383 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe798e-7904-4287-a562-a7820f7ea988 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:41.981983 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe798e-7904-4287-a562-a7820f7ea988 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:41.982472 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe798e-7904-4287-a562-a7820f7ea988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:42.013020 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-bcbe798e-7904-4287-a562-a7820f7ea988 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:05:42.014420 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f361fc-7bf1-441f-bb00-c243654146ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:42.014805 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-bcbe798e-7904-4287-a562-a7820f7ea988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:05:42.015234 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f361fc-7bf1-441f-bb00-c243654146ac None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:42.015520 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f361fc-7bf1-441f-bb00-c243654146ac None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:42.015830 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f361fc-7bf1-441f-bb00-c243654146ac None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:42.038851 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f361fc-7bf1-441f-bb00-c243654146ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:05:42.046312 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-32f361fc-7bf1-441f-bb00-c243654146ac None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 07 06:05:42.053873 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 49/101] 10.222.0.24 () {56 vars in 1099 bytes} [Thu Apr 7 06:05:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:05:42.061181 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2836ebb-6b8a-4e2c-b803-cb50167307e0 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:42.062342 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2836ebb-6b8a-4e2c-b803-cb50167307e0 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:42.062989 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2836ebb-6b8a-4e2c-b803-cb50167307e0 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:42.066463 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 50/102] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:05:42 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:05:42.072843 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2836ebb-6b8a-4e2c-b803-cb50167307e0 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:42.143921 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 53/103] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:05:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:05:42.145581 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b353d2-6552-4b94-a5e6-6fee75dc748e None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:42.146096 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b353d2-6552-4b94-a5e6-6fee75dc748e None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:42.146595 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b353d2-6552-4b94-a5e6-6fee75dc748e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:42.175087 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-51b353d2-6552-4b94-a5e6-6fee75dc748e None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:05:42.177635 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-51b353d2-6552-4b94-a5e6-6fee75dc748e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:05:42.260003 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2836ebb-6b8a-4e2c-b803-cb50167307e0 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:42.298606 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 54/104] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:05:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:05:42.299833 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b353d2-6552-4b94-a5e6-6fee75dc748e None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:42.327153 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab42be-7b3f-4c00-bd40-73aa471e8baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:42.328203 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab42be-7b3f-4c00-bd40-73aa471e8baa None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:42.328735 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab42be-7b3f-4c00-bd40-73aa471e8baa None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:42.329213 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab42be-7b3f-4c00-bd40-73aa471e8baa None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:42.330188 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ab42be-7b3f-4c00-bd40-73aa471e8baa None admin] RBAC: Adding query filter params (name=reader) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:05:42.336150 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ab42be-7b3f-4c00-bd40-73aa471e8baa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:42.337792 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ab42be-7b3f-4c00-bd40-73aa471e8baa None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:42.355511 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 51/105] 10.222.0.24 () {56 vars in 1101 bytes} [Thu Apr 7 06:05:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:42.358762 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab42be-7b3f-4c00-bd40-73aa471e8baa None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:42.445962 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b353d2-6552-4b94-a5e6-6fee75dc748e None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:42.479177 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0579553c-01f9-45a3-97ec-9d38ff1888be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:42.480021 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579553c-01f9-45a3-97ec-9d38ff1888be None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:42.480321 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579553c-01f9-45a3-97ec-9d38ff1888be None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:42.480599 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579553c-01f9-45a3-97ec-9d38ff1888be None admin] PATH_INFO: `/v3/domains/default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:42.481777 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0579553c-01f9-45a3-97ec-9d38ff1888be None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:42.483240 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0579553c-01f9-45a3-97ec-9d38ff1888be None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:42.484875 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 55/106] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:05:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:42.485782 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0579553c-01f9-45a3-97ec-9d38ff1888be None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:42.492589 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab42be-7b3f-4c00-bd40-73aa471e8baa None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:42.529091 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab79ed-b59b-4ef6-9cec-be376fdb1b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:42.530424 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab79ed-b59b-4ef6-9cec-be376fdb1b22 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:42.531124 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab79ed-b59b-4ef6-9cec-be376fdb1b22 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:42.531554 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab79ed-b59b-4ef6-9cec-be376fdb1b22 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:42.544397 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ab79ed-b59b-4ef6-9cec-be376fdb1b22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:05:42.551666 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-39ab79ed-b59b-4ef6-9cec-be376fdb1b22 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 07 06:05:42.558210 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 52/107] 10.222.0.24 () {56 vars in 1099 bytes} [Thu Apr 7 06:05:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:05:42.559709 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce85922-a52c-4222-b51e-4af0aa08e8c8 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:42.560186 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce85922-a52c-4222-b51e-4af0aa08e8c8 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:42.560612 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce85922-a52c-4222-b51e-4af0aa08e8c8 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:42.562113 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 53/108] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:05:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:05:42.563454 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa33a7-6e73-4d9c-a5f9-e3e4f470a563 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:42.563913 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa33a7-6e73-4d9c-a5f9-e3e4f470a563 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:42.564350 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa33a7-6e73-4d9c-a5f9-e3e4f470a563 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:42.565714 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 54/109] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:05:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:05:42.566547 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa33a7-6e73-4d9c-a5f9-e3e4f470a563 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:42.589475 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0579553c-01f9-45a3-97ec-9d38ff1888be None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:42.626672 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae01b68-f0a5-4dd7-a7b9-e454fd6e615d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:42.627567 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae01b68-f0a5-4dd7-a7b9-e454fd6e615d None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:42.627888 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae01b68-f0a5-4dd7-a7b9-e454fd6e615d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:42.628170 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae01b68-f0a5-4dd7-a7b9-e454fd6e615d None admin] PATH_INFO: `/v3/users/713f43722c5a47098fd7e8fdb79aaf1e` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:42.642933 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae01b68-f0a5-4dd7-a7b9-e454fd6e615d None admin] RBAC: Authorizing `identity:get_user(user_id=713f43722c5a47098fd7e8fdb79aaf1e)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:42.644554 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae01b68-f0a5-4dd7-a7b9-e454fd6e615d None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:42.651060 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 56/110] 10.222.0.24 () {56 vars in 1177 bytes} [Thu Apr 7 06:05:42 2022] GET /identity/v3/users/713f43722c5a47098fd7e8fdb79aaf1e => generated 289 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:42.651060 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae01b68-f0a5-4dd7-a7b9-e454fd6e615d None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:42.672235 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa33a7-6e73-4d9c-a5f9-e3e4f470a563 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:42.704698 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e85a2e9-7402-4124-b316-00f1e7d067f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:42.705363 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85a2e9-7402-4124-b316-00f1e7d067f2 None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:42.705649 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85a2e9-7402-4124-b316-00f1e7d067f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:42.705923 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85a2e9-7402-4124-b316-00f1e7d067f2 None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:42.706621 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e85a2e9-7402-4124-b316-00f1e7d067f2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:42.708085 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e85a2e9-7402-4124-b316-00f1e7d067f2 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:42.743258 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae01b68-f0a5-4dd7-a7b9-e454fd6e615d None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:42.778616 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d84cab9-3423-40af-9fa7-25e538948331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:42.779356 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84cab9-3423-40af-9fa7-25e538948331 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:42.779585 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84cab9-3423-40af-9fa7-25e538948331 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:42.779893 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84cab9-3423-40af-9fa7-25e538948331 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:42.780650 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d84cab9-3423-40af-9fa7-25e538948331 None admin] RBAC: Adding query filter params (name=member) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:05:42.780962 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d84cab9-3423-40af-9fa7-25e538948331 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:42.782330 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d84cab9-3423-40af-9fa7-25e538948331 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:42.797148 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 57/111] 10.222.0.24 () {56 vars in 1101 bytes} [Thu Apr 7 06:05:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:42.797148 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374bc99-4807-48b2-95a4-4bfe9aab85f3 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:42.797148 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374bc99-4807-48b2-95a4-4bfe9aab85f3 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:42.797148 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374bc99-4807-48b2-95a4-4bfe9aab85f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:42.801292 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 55/112] 10.222.0.24 () {60 vars in 1141 bytes} [Thu Apr 7 06:05:42 2022] POST /identity/v3/projects => generated 302 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:05:42.806018 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae0398-5a7d-4b3b-bbf5-2fc558ef85b6 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:42.806018 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae0398-5a7d-4b3b-bbf5-2fc558ef85b6 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:42.806018 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae0398-5a7d-4b3b-bbf5-2fc558ef85b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:42.820555 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-7374bc99-4807-48b2-95a4-4bfe9aab85f3 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:05:42.822104 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-7374bc99-4807-48b2-95a4-4bfe9aab85f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:05:42.824452 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-44ae0398-5a7d-4b3b-bbf5-2fc558ef85b6 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:05:42.825726 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-44ae0398-5a7d-4b3b-bbf5-2fc558ef85b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:05:42.912203 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 56/113] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:05:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:05:42.912604 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 58/114] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:05:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:05:42.917515 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae0398-5a7d-4b3b-bbf5-2fc558ef85b6 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:42.919649 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7374bc99-4807-48b2-95a4-4bfe9aab85f3 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:43.048405 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7374bc99-4807-48b2-95a4-4bfe9aab85f3 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:43.053723 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae0398-5a7d-4b3b-bbf5-2fc558ef85b6 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:43.083111 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c5996-9ab0-404f-810c-f1039712b257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:43.084027 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c5996-9ab0-404f-810c-f1039712b257 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:43.084318 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c5996-9ab0-404f-810c-f1039712b257 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:43.084664 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c5996-9ab0-404f-810c-f1039712b257 None admin] PATH_INFO: `/v3/users/e3ccb23df7814ee8bbd9a0cd75ed58d6` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:43.085830 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385c5996-9ab0-404f-810c-f1039712b257 None admin] RBAC: Authorizing `identity:get_user(user_id=e3ccb23df7814ee8bbd9a0cd75ed58d6)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:43.087271 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385c5996-9ab0-404f-810c-f1039712b257 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:43.087475 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a99f3fb-1459-4086-9d29-3b024cbd7a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:43.088133 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a99f3fb-1459-4086-9d29-3b024cbd7a9f None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:43.088420 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a99f3fb-1459-4086-9d29-3b024cbd7a9f None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:43.089218 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a99f3fb-1459-4086-9d29-3b024cbd7a9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:43.089480 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 59/115] 10.222.0.24 () {56 vars in 1177 bytes} [Thu Apr 7 06:05:42 2022] GET /identity/v3/users/e3ccb23df7814ee8bbd9a0cd75ed58d6 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:43.090331 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c5996-9ab0-404f-810c-f1039712b257 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:43.155021 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a99f3fb-1459-4086-9d29-3b024cbd7a9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:43.156533 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a99f3fb-1459-4086-9d29-3b024cbd7a9f None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:43.188640 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c5996-9ab0-404f-810c-f1039712b257 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:43.220833 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f59424e-c00f-4652-bef9-94595593b1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:43.221643 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59424e-c00f-4652-bef9-94595593b1c7 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:43.221935 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59424e-c00f-4652-bef9-94595593b1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:43.222215 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59424e-c00f-4652-bef9-94595593b1c7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:43.232147 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f59424e-c00f-4652-bef9-94595593b1c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:05:43.239123 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-7f59424e-c00f-4652-bef9-94595593b1c7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 07 06:05:43.245626 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 60/116] 10.222.0.24 () {56 vars in 1099 bytes} [Thu Apr 7 06:05:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:05:43.245626 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f59424e-c00f-4652-bef9-94595593b1c7 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:43.252070 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 57/117] 10.222.0.24 () {58 vars in 1282 bytes} [Thu Apr 7 06:05:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 07 06:05:43.256498 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b389972a-f441-4e7b-9246-0061a37f4a67 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:43.256498 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b389972a-f441-4e7b-9246-0061a37f4a67 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:43.256498 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b389972a-f441-4e7b-9246-0061a37f4a67 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:43.259296 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 58/118] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:05:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:05:43.260028 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b389972a-f441-4e7b-9246-0061a37f4a67 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:43.345557 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f59424e-c00f-4652-bef9-94595593b1c7 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:43.355976 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b389972a-f441-4e7b-9246-0061a37f4a67 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:43.378579 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d16598e-f451-43de-8d7d-d0690c33de84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:43.379454 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16598e-f451-43de-8d7d-d0690c33de84 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:43.379848 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16598e-f451-43de-8d7d-d0690c33de84 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:43.380194 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16598e-f451-43de-8d7d-d0690c33de84 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:43.388575 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e127762b-f2b8-4769-8103-1a452e6199f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:43.389436 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127762b-f2b8-4769-8103-1a452e6199f3 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:43.389723 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127762b-f2b8-4769-8103-1a452e6199f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:43.390015 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127762b-f2b8-4769-8103-1a452e6199f3 None admin] PATH_INFO: `/v3/projects/f2feaca3faed4ec0a547bb377a6f494e` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:43.391044 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d16598e-f451-43de-8d7d-d0690c33de84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:05:43.391189 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e127762b-f2b8-4769-8103-1a452e6199f3 None admin] RBAC: Authorizing `identity:get_project(project_id=f2feaca3faed4ec0a547bb377a6f494e)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:43.392650 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e127762b-f2b8-4769-8103-1a452e6199f3 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:43.394499 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 59/119] 10.222.0.24 () {56 vars in 1186 bytes} [Thu Apr 7 06:05:43 2022] GET /identity/v3/projects/f2feaca3faed4ec0a547bb377a6f494e => generated 298 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:43.395089 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e127762b-f2b8-4769-8103-1a452e6199f3 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:43.398407 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-1d16598e-f451-43de-8d7d-d0690c33de84 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 07 06:05:43.400088 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 61/120] 10.222.0.24 () {56 vars in 1096 bytes} [Thu Apr 7 06:05:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:05:43.403781 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d16598e-f451-43de-8d7d-d0690c33de84 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:43.492404 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e127762b-f2b8-4769-8103-1a452e6199f3 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:43.501127 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d16598e-f451-43de-8d7d-d0690c33de84 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:43.525254 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b055450-748c-4a47-bdff-9800f3e1c399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:43.526044 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b055450-748c-4a47-bdff-9800f3e1c399 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:43.526398 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b055450-748c-4a47-bdff-9800f3e1c399 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:43.526739 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b055450-748c-4a47-bdff-9800f3e1c399 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:43.527555 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b055450-748c-4a47-bdff-9800f3e1c399 None admin] RBAC: Adding query filter params (name=member) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:05:43.527957 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b055450-748c-4a47-bdff-9800f3e1c399 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:43.529406 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b055450-748c-4a47-bdff-9800f3e1c399 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:43.533498 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc05e4d0-256f-4321-b0d6-a77b3672e546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:43.534369 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05e4d0-256f-4321-b0d6-a77b3672e546 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:43.534657 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05e4d0-256f-4321-b0d6-a77b3672e546 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:43.534941 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05e4d0-256f-4321-b0d6-a77b3672e546 None admin] PATH_INFO: `/v3/projects/f2feaca3faed4ec0a547bb377a6f494e` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:43.536160 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc05e4d0-256f-4321-b0d6-a77b3672e546 None admin] RBAC: Authorizing `identity:get_project(project_id=f2feaca3faed4ec0a547bb377a6f494e)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:43.537609 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc05e4d0-256f-4321-b0d6-a77b3672e546 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:43.538094 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 60/121] 10.222.0.24 () {56 vars in 1101 bytes} [Thu Apr 7 06:05:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:43.539161 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5301da-5a38-4c86-9db0-5c87c5b7b7a1 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:43.539519 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5301da-5a38-4c86-9db0-5c87c5b7b7a1 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:43.539898 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5301da-5a38-4c86-9db0-5c87c5b7b7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:43.545484 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 62/122] 10.222.0.24 () {56 vars in 1186 bytes} [Thu Apr 7 06:05:43 2022] GET /identity/v3/projects/f2feaca3faed4ec0a547bb377a6f494e => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:43.546579 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc05e4d0-256f-4321-b0d6-a77b3672e546 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:43.556497 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-6d5301da-5a38-4c86-9db0-5c87c5b7b7a1 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:05:43.558395 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-6d5301da-5a38-4c86-9db0-5c87c5b7b7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:05:43.631864 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 61/123] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:05:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:05:43.631864 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5301da-5a38-4c86-9db0-5c87c5b7b7a1 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:43.654046 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc05e4d0-256f-4321-b0d6-a77b3672e546 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:43.686934 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046cce5e-345c-47ab-94a6-a5fd9adcaa43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:43.687853 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046cce5e-345c-47ab-94a6-a5fd9adcaa43 None admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:43.688143 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046cce5e-345c-47ab-94a6-a5fd9adcaa43 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:43.688419 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046cce5e-345c-47ab-94a6-a5fd9adcaa43 None admin] PATH_INFO: `/v3/projects/f2feaca3faed4ec0a547bb377a6f494e/users/e3ccb23df7814ee8bbd9a0cd75ed58d6/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:43.690375 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046cce5e-345c-47ab-94a6-a5fd9adcaa43 None admin] RBAC: Authorizing `identity:create_grant(project_id=f2feaca3faed4ec0a547bb377a6f494e, user_id=e3ccb23df7814ee8bbd9a0cd75ed58d6, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:43.691843 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046cce5e-345c-47ab-94a6-a5fd9adcaa43 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:43.719506 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5301da-5a38-4c86-9db0-5c87c5b7b7a1 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:43.752322 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08547fdd-c29c-4894-ae68-bf3e073af9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:43.752994 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08547fdd-c29c-4894-ae68-bf3e073af9a8 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:43.753280 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08547fdd-c29c-4894-ae68-bf3e073af9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:43.753558 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08547fdd-c29c-4894-ae68-bf3e073af9a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:43.754351 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08547fdd-c29c-4894-ae68-bf3e073af9a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:05:43.754657 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08547fdd-c29c-4894-ae68-bf3e073af9a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:43.756060 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08547fdd-c29c-4894-ae68-bf3e073af9a8 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:43.763049 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 63/124] 10.222.0.24 () {58 vars in 1439 bytes} [Thu Apr 7 06:05:43 2022] PUT /identity/v3/projects/f2feaca3faed4ec0a547bb377a6f494e/users/e3ccb23df7814ee8bbd9a0cd75ed58d6/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:05:43.763987 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046cce5e-345c-47ab-94a6-a5fd9adcaa43 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:43.765933 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 62/125] 10.222.0.24 () {56 vars in 1099 bytes} [Thu Apr 7 06:05:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:43.767097 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08547fdd-c29c-4894-ae68-bf3e073af9a8 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:43.884974 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046cce5e-345c-47ab-94a6-a5fd9adcaa43 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:43.908338 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08547fdd-c29c-4894-ae68-bf3e073af9a8 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:43.924118 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61604b10-724f-4908-b658-e91621467825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:43.925029 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61604b10-724f-4908-b658-e91621467825 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:43.925323 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61604b10-724f-4908-b658-e91621467825 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:43.925608 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61604b10-724f-4908-b658-e91621467825 None admin] PATH_INFO: `/v3/users/e3ccb23df7814ee8bbd9a0cd75ed58d6` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:43.926909 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61604b10-724f-4908-b658-e91621467825 None admin] RBAC: Authorizing `identity:get_user(user_id=e3ccb23df7814ee8bbd9a0cd75ed58d6)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:43.928436 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61604b10-724f-4908-b658-e91621467825 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:43.930340 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 64/126] 10.222.0.24 () {56 vars in 1177 bytes} [Thu Apr 7 06:05:43 2022] GET /identity/v3/users/e3ccb23df7814ee8bbd9a0cd75ed58d6 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:43.930979 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61604b10-724f-4908-b658-e91621467825 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:43.946068 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce1ade-9598-40b3-ad01-0070e8e8b42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:43.946744 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce1ade-9598-40b3-ad01-0070e8e8b42d None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:43.947031 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce1ade-9598-40b3-ad01-0070e8e8b42d None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:43.947310 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce1ade-9598-40b3-ad01-0070e8e8b42d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:43.948789 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bce1ade-9598-40b3-ad01-0070e8e8b42d None admin] RBAC: Adding query filter params (role.id=a1818b2066464c9caae41106650b2c17, scope.project.id=f2feaca3faed4ec0a547bb377a6f494e, user.id=713f43722c5a47098fd7e8fdb79aaf1e) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:05:43.949154 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bce1ade-9598-40b3-ad01-0070e8e8b42d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:43.950627 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bce1ade-9598-40b3-ad01-0070e8e8b42d None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:43.956983 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 63/127] 10.222.0.24 () {56 vars in 1374 bytes} [Thu Apr 7 06:05:43 2022] GET /identity/v3/role_assignments?user.id=713f43722c5a47098fd7e8fdb79aaf1e&scope.project.id=f2feaca3faed4ec0a547bb377a6f494e&role.id=a1818b2066464c9caae41106650b2c17 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:43.957672 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce1ade-9598-40b3-ad01-0070e8e8b42d None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:44.052020 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61604b10-724f-4908-b658-e91621467825 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:44.092134 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce1ade-9598-40b3-ad01-0070e8e8b42d None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:44.092329 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97378d3b-06b3-4fb0-b30d-d2cbfa1a0f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:44.093028 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97378d3b-06b3-4fb0-b30d-d2cbfa1a0f52 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:44.093317 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97378d3b-06b3-4fb0-b30d-d2cbfa1a0f52 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:44.093598 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97378d3b-06b3-4fb0-b30d-d2cbfa1a0f52 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:44.106163 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97378d3b-06b3-4fb0-b30d-d2cbfa1a0f52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:05:44.113827 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-97378d3b-06b3-4fb0-b30d-d2cbfa1a0f52 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 07 06:05:44.115537 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 65/128] 10.222.0.24 () {56 vars in 1114 bytes} [Thu Apr 7 06:05:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:05:44.116230 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97378d3b-06b3-4fb0-b30d-d2cbfa1a0f52 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:44.139805 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e4f67-2070-47e5-956f-95e1fd6b0840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:44.140721 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e4f67-2070-47e5-956f-95e1fd6b0840 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:44.141007 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e4f67-2070-47e5-956f-95e1fd6b0840 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:44.141284 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e4f67-2070-47e5-956f-95e1fd6b0840 None admin] PATH_INFO: `/v3/users/91c1e479128840248c7c0e4e51af60ff` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:44.142515 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e4f67-2070-47e5-956f-95e1fd6b0840 None admin] RBAC: Authorizing `identity:get_user(user_id=91c1e479128840248c7c0e4e51af60ff)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:44.144160 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e4f67-2070-47e5-956f-95e1fd6b0840 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:44.145951 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 64/129] 10.222.0.24 () {56 vars in 1177 bytes} [Thu Apr 7 06:05:43 2022] GET /identity/v3/users/91c1e479128840248c7c0e4e51af60ff => generated 247 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:44.146660 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e4f67-2070-47e5-956f-95e1fd6b0840 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:44.252899 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97378d3b-06b3-4fb0-b30d-d2cbfa1a0f52 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:44.272294 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e4f67-2070-47e5-956f-95e1fd6b0840 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:44.287445 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb909cb-c958-4a3d-87d5-843717814623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:44.288602 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb909cb-c958-4a3d-87d5-843717814623 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:44.289067 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb909cb-c958-4a3d-87d5-843717814623 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:44.289358 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb909cb-c958-4a3d-87d5-843717814623 None admin] PATH_INFO: `/v3/projects/84640c32095b4e75b3c06b07a4e11f7b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:44.290864 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb909cb-c958-4a3d-87d5-843717814623 None admin] RBAC: Authorizing `identity:get_project(project_id=84640c32095b4e75b3c06b07a4e11f7b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:44.293306 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb909cb-c958-4a3d-87d5-843717814623 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:44.295502 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 66/130] 10.222.0.24 () {56 vars in 1186 bytes} [Thu Apr 7 06:05:44 2022] GET /identity/v3/projects/84640c32095b4e75b3c06b07a4e11f7b => generated 312 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:44.296319 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb909cb-c958-4a3d-87d5-843717814623 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:44.306881 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea528c8-7e0e-4af3-9846-a039ba87a06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:44.307687 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea528c8-7e0e-4af3-9846-a039ba87a06a None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:44.308018 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea528c8-7e0e-4af3-9846-a039ba87a06a None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:44.308296 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea528c8-7e0e-4af3-9846-a039ba87a06a None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:44.309151 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea528c8-7e0e-4af3-9846-a039ba87a06a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:05:44.309465 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea528c8-7e0e-4af3-9846-a039ba87a06a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:44.310841 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea528c8-7e0e-4af3-9846-a039ba87a06a None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:44.331160 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 65/131] 10.222.0.24 () {56 vars in 1111 bytes} [Thu Apr 7 06:05:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:44.332118 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea528c8-7e0e-4af3-9846-a039ba87a06a None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:44.408010 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb909cb-c958-4a3d-87d5-843717814623 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:44.448795 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f709db-a1f9-402f-bd31-e1373ff6c564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:44.449678 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f709db-a1f9-402f-bd31-e1373ff6c564 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:44.449971 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f709db-a1f9-402f-bd31-e1373ff6c564 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:44.450249 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f709db-a1f9-402f-bd31-e1373ff6c564 None admin] PATH_INFO: `/v3/projects/f2feaca3faed4ec0a547bb377a6f494e` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:44.451937 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f709db-a1f9-402f-bd31-e1373ff6c564 None admin] RBAC: Authorizing `identity:get_project(project_id=f2feaca3faed4ec0a547bb377a6f494e)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:44.454118 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f709db-a1f9-402f-bd31-e1373ff6c564 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:44.456313 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 67/132] 10.222.0.24 () {56 vars in 1186 bytes} [Thu Apr 7 06:05:44 2022] GET /identity/v3/projects/f2feaca3faed4ec0a547bb377a6f494e => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:44.457113 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f709db-a1f9-402f-bd31-e1373ff6c564 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:44.479805 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea528c8-7e0e-4af3-9846-a039ba87a06a None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:44.557070 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7334d04-728f-40cf-baa9-19ca38b1d9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:44.558504 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7334d04-728f-40cf-baa9-19ca38b1d9ae None admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:44.558839 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7334d04-728f-40cf-baa9-19ca38b1d9ae None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:44.559121 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7334d04-728f-40cf-baa9-19ca38b1d9ae None admin] PATH_INFO: `/v3/projects/84640c32095b4e75b3c06b07a4e11f7b/users/e3ccb23df7814ee8bbd9a0cd75ed58d6/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:44.561197 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7334d04-728f-40cf-baa9-19ca38b1d9ae None admin] RBAC: Authorizing `identity:create_grant(project_id=84640c32095b4e75b3c06b07a4e11f7b, user_id=e3ccb23df7814ee8bbd9a0cd75ed58d6, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:44.562656 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7334d04-728f-40cf-baa9-19ca38b1d9ae None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:44.592037 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f709db-a1f9-402f-bd31-e1373ff6c564 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:44.626428 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ae112-8da9-469c-8c9e-99e4e7e5b0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:44.627424 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ae112-8da9-469c-8c9e-99e4e7e5b0cd None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:44.627714 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ae112-8da9-469c-8c9e-99e4e7e5b0cd None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:44.628019 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ae112-8da9-469c-8c9e-99e4e7e5b0cd None admin] PATH_INFO: `/v3/users/e3ccb23df7814ee8bbd9a0cd75ed58d6` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:44.629343 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8ae112-8da9-469c-8c9e-99e4e7e5b0cd None admin] RBAC: Authorizing `identity:get_user(user_id=e3ccb23df7814ee8bbd9a0cd75ed58d6)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:44.630859 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8ae112-8da9-469c-8c9e-99e4e7e5b0cd None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:44.632508 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 68/133] 10.222.0.24 () {56 vars in 1177 bytes} [Thu Apr 7 06:05:44 2022] GET /identity/v3/users/e3ccb23df7814ee8bbd9a0cd75ed58d6 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:44.633314 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ae112-8da9-469c-8c9e-99e4e7e5b0cd None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:44.690315 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 66/134] 10.222.0.24 () {58 vars in 1439 bytes} [Thu Apr 7 06:05:44 2022] PUT /identity/v3/projects/84640c32095b4e75b3c06b07a4e11f7b/users/e3ccb23df7814ee8bbd9a0cd75ed58d6/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:05:44.692240 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7334d04-728f-40cf-baa9-19ca38b1d9ae None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:44.737036 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ae112-8da9-469c-8c9e-99e4e7e5b0cd None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:44.796578 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a99df-c909-49cb-b9f2-f063d8923da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:44.797547 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a99df-c909-49cb-b9f2-f063d8923da2 None admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:44.797829 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a99df-c909-49cb-b9f2-f063d8923da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:44.798112 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a99df-c909-49cb-b9f2-f063d8923da2 None admin] PATH_INFO: `/v3/projects/f2feaca3faed4ec0a547bb377a6f494e/users/91c1e479128840248c7c0e4e51af60ff/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:44.801230 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5a99df-c909-49cb-b9f2-f063d8923da2 None admin] RBAC: Authorizing `identity:create_grant(project_id=f2feaca3faed4ec0a547bb377a6f494e, user_id=91c1e479128840248c7c0e4e51af60ff, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:44.802686 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5a99df-c909-49cb-b9f2-f063d8923da2 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:44.879784 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7334d04-728f-40cf-baa9-19ca38b1d9ae None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:44.890365 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 69/135] 10.222.0.24 () {58 vars in 1439 bytes} [Thu Apr 7 06:05:44 2022] PUT /identity/v3/projects/f2feaca3faed4ec0a547bb377a6f494e/users/91c1e479128840248c7c0e4e51af60ff/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:05:44.920311 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f700fa06-8a93-430b-b0b1-abeafb82e625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:44.921204 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f700fa06-8a93-430b-b0b1-abeafb82e625 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:44.921498 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f700fa06-8a93-430b-b0b1-abeafb82e625 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:44.921777 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f700fa06-8a93-430b-b0b1-abeafb82e625 None admin] PATH_INFO: `/v3/projects/f2feaca3faed4ec0a547bb377a6f494e` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:44.923015 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f700fa06-8a93-430b-b0b1-abeafb82e625 None admin] RBAC: Authorizing `identity:get_project(project_id=f2feaca3faed4ec0a547bb377a6f494e)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:44.924584 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f700fa06-8a93-430b-b0b1-abeafb82e625 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:44.926458 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 67/136] 10.222.0.24 () {56 vars in 1186 bytes} [Thu Apr 7 06:05:44 2022] GET /identity/v3/projects/f2feaca3faed4ec0a547bb377a6f494e => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:44.932685 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a99df-c909-49cb-b9f2-f063d8923da2 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:45.070698 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a99df-c909-49cb-b9f2-f063d8923da2 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:45.107182 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646fa7c2-d57b-4d41-badb-7c6cd5649d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:45.108139 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646fa7c2-d57b-4d41-badb-7c6cd5649d4a None admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:45.108426 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646fa7c2-d57b-4d41-badb-7c6cd5649d4a None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:45.108704 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646fa7c2-d57b-4d41-badb-7c6cd5649d4a None admin] PATH_INFO: `/v3/projects/f2feaca3faed4ec0a547bb377a6f494e/users/e3ccb23df7814ee8bbd9a0cd75ed58d6/roles/7ad9776ea3b0430cb02c4599d037c8be` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:45.111096 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646fa7c2-d57b-4d41-badb-7c6cd5649d4a None admin] RBAC: Authorizing `identity:create_grant(project_id=f2feaca3faed4ec0a547bb377a6f494e, user_id=e3ccb23df7814ee8bbd9a0cd75ed58d6, role_id=7ad9776ea3b0430cb02c4599d037c8be)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:45.112651 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646fa7c2-d57b-4d41-badb-7c6cd5649d4a None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:45.193518 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 70/137] 10.222.0.24 () {58 vars in 1439 bytes} [Thu Apr 7 06:05:44 2022] PUT /identity/v3/projects/f2feaca3faed4ec0a547bb377a6f494e/users/e3ccb23df7814ee8bbd9a0cd75ed58d6/roles/7ad9776ea3b0430cb02c4599d037c8be => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:05:45.393293 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f07ae-0063-45a5-a12e-f5ce3620f4bd None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:45.393640 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f07ae-0063-45a5-a12e-f5ce3620f4bd None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:45.393815 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f07ae-0063-45a5-a12e-f5ce3620f4bd None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:45.395294 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 68/138] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:05:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:05:45.401698 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b533b1-bb7a-4bb1-a994-e67b5d4aea5f None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:45.402043 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b533b1-bb7a-4bb1-a994-e67b5d4aea5f None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:45.402365 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b533b1-bb7a-4bb1-a994-e67b5d4aea5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:45.424844 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-76b533b1-bb7a-4bb1-a994-e67b5d4aea5f None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:05:45.426113 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-76b533b1-bb7a-4bb1-a994-e67b5d4aea5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:05:45.513426 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 71/139] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:05:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:05:45.551235 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7f07ae-0063-45a5-a12e-f5ce3620f4bd None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:45.680746 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7f07ae-0063-45a5-a12e-f5ce3620f4bd None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:45.717242 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d126a-ffe7-4cc8-b4db-c242816b418e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:45.718053 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d126a-ffe7-4cc8-b4db-c242816b418e None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:45.718344 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d126a-ffe7-4cc8-b4db-c242816b418e None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:45.718625 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d126a-ffe7-4cc8-b4db-c242816b418e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:45.719843 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061d126a-ffe7-4cc8-b4db-c242816b418e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:45.721324 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061d126a-ffe7-4cc8-b4db-c242816b418e None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:45.723098 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 69/140] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:05:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:45.728655 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b533b1-bb7a-4bb1-a994-e67b5d4aea5f None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:45.847635 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b533b1-bb7a-4bb1-a994-e67b5d4aea5f None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:45.896647 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81b54d8-b8f1-402f-9129-4e95ca9b76fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:45.897381 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b54d8-b8f1-402f-9129-4e95ca9b76fd None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:45.897675 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b54d8-b8f1-402f-9129-4e95ca9b76fd None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:45.897953 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b54d8-b8f1-402f-9129-4e95ca9b76fd None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:45.898682 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81b54d8-b8f1-402f-9129-4e95ca9b76fd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:45.900173 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81b54d8-b8f1-402f-9129-4e95ca9b76fd None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:46.011275 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 72/141] 10.222.0.24 () {60 vars in 1132 bytes} [Thu Apr 7 06:05:45 2022] POST /identity/v3/users => generated 283 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:05:46.598885 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0ace6-5c9b-4328-86b2-e8168bc5685d None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:46.599394 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0ace6-5c9b-4328-86b2-e8168bc5685d None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:46.599481 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0ace6-5c9b-4328-86b2-e8168bc5685d None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:46.600844 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 70/142] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:05:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:05:46.606716 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4cf6e4-144a-4a6c-8eec-bfcbf9982d9e None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:46.607017 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4cf6e4-144a-4a6c-8eec-bfcbf9982d9e None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:46.607302 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4cf6e4-144a-4a6c-8eec-bfcbf9982d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:46.624286 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-0d4cf6e4-144a-4a6c-8eec-bfcbf9982d9e None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:05:46.625466 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-0d4cf6e4-144a-4a6c-8eec-bfcbf9982d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:05:46.693504 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 73/143] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:05:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:05:46.718978 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc0ace6-5c9b-4328-86b2-e8168bc5685d None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:46.830226 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc0ace6-5c9b-4328-86b2-e8168bc5685d None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:46.871794 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950a0207-b983-428d-b638-32a91f6fd514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:46.872793 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a0207-b983-428d-b638-32a91f6fd514 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:46.872793 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a0207-b983-428d-b638-32a91f6fd514 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:46.873083 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a0207-b983-428d-b638-32a91f6fd514 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:46.889104 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950a0207-b983-428d-b638-32a91f6fd514 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:05:46.896080 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-950a0207-b983-428d-b638-32a91f6fd514 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 07 06:05:46.897313 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 71/144] 10.222.0.24 () {56 vars in 1099 bytes} [Thu Apr 7 06:05:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:05:46.903548 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4cf6e4-144a-4a6c-8eec-bfcbf9982d9e None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:47.007053 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4cf6e4-144a-4a6c-8eec-bfcbf9982d9e None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:47.040504 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd8f429-f10e-40c7-80b0-920d2d9dba09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:47.041188 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8f429-f10e-40c7-80b0-920d2d9dba09 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:47.042055 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8f429-f10e-40c7-80b0-920d2d9dba09 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:47.042312 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8f429-f10e-40c7-80b0-920d2d9dba09 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:47.043068 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd8f429-f10e-40c7-80b0-920d2d9dba09 None admin] RBAC: Adding query filter params (name=member) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:05:47.043375 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd8f429-f10e-40c7-80b0-920d2d9dba09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:47.044798 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd8f429-f10e-40c7-80b0-920d2d9dba09 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:47.059263 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 74/145] 10.222.0.24 () {56 vars in 1101 bytes} [Thu Apr 7 06:05:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:47.064739 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950a0207-b983-428d-b638-32a91f6fd514 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:47.169039 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950a0207-b983-428d-b638-32a91f6fd514 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:47.205601 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02989cc-3d49-47a1-8650-8adbf685b641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:47.206477 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02989cc-3d49-47a1-8650-8adbf685b641 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:47.206767 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02989cc-3d49-47a1-8650-8adbf685b641 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:47.207048 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02989cc-3d49-47a1-8650-8adbf685b641 None admin] PATH_INFO: `/v3/users/e3ccb23df7814ee8bbd9a0cd75ed58d6` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:47.208280 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02989cc-3d49-47a1-8650-8adbf685b641 None admin] RBAC: Authorizing `identity:get_user(user_id=e3ccb23df7814ee8bbd9a0cd75ed58d6)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:47.209727 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02989cc-3d49-47a1-8650-8adbf685b641 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:47.211540 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 72/146] 10.222.0.24 () {56 vars in 1177 bytes} [Thu Apr 7 06:05:47 2022] GET /identity/v3/users/e3ccb23df7814ee8bbd9a0cd75ed58d6 => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:47.216974 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd8f429-f10e-40c7-80b0-920d2d9dba09 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:47.327323 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd8f429-f10e-40c7-80b0-920d2d9dba09 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:47.367365 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907a42d-00d6-46e8-8e80-adb8e8475db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:47.368393 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907a42d-00d6-46e8-8e80-adb8e8475db3 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:47.368879 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907a42d-00d6-46e8-8e80-adb8e8475db3 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:47.369348 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907a42d-00d6-46e8-8e80-adb8e8475db3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:47.442928 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5907a42d-00d6-46e8-8e80-adb8e8475db3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:47.444721 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5907a42d-00d6-46e8-8e80-adb8e8475db3 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:47.526921 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43085f9b-0324-4d9b-8c8a-be8c21dfe89d None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:47.527260 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43085f9b-0324-4d9b-8c8a-be8c21dfe89d None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:47.527486 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43085f9b-0324-4d9b-8c8a-be8c21dfe89d None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:47.528886 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 73/147] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:05:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:05:47.534691 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b55b2f-38f2-4300-a8d7-bfcc6035ddd5 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:47.534987 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b55b2f-38f2-4300-a8d7-bfcc6035ddd5 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:47.535274 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b55b2f-38f2-4300-a8d7-bfcc6035ddd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:47.566654 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 75/148] 10.222.0.24 () {58 vars in 1282 bytes} [Thu Apr 7 06:05:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 07 06:05:47.572380 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907a42d-00d6-46e8-8e80-adb8e8475db3 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:47.572580 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-07b55b2f-38f2-4300-a8d7-bfcc6035ddd5 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:05:47.573651 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-07b55b2f-38f2-4300-a8d7-bfcc6035ddd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:05:47.669481 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 74/149] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:05:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Apr 07 06:05:47.711654 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b55b2f-38f2-4300-a8d7-bfcc6035ddd5 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:47.736340 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907a42d-00d6-46e8-8e80-adb8e8475db3 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:47.785889 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b618b38b-8e0e-4026-9a5d-3d26b5d81785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:47.786804 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618b38b-8e0e-4026-9a5d-3d26b5d81785 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:47.787087 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618b38b-8e0e-4026-9a5d-3d26b5d81785 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:47.787363 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618b38b-8e0e-4026-9a5d-3d26b5d81785 None admin] PATH_INFO: `/v3/projects/f2feaca3faed4ec0a547bb377a6f494e` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:47.792596 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b618b38b-8e0e-4026-9a5d-3d26b5d81785 None admin] RBAC: Authorizing `identity:get_project(project_id=f2feaca3faed4ec0a547bb377a6f494e)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:47.794078 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b618b38b-8e0e-4026-9a5d-3d26b5d81785 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:47.795839 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 76/150] 10.222.0.24 () {56 vars in 1186 bytes} [Thu Apr 7 06:05:47 2022] GET /identity/v3/projects/f2feaca3faed4ec0a547bb377a6f494e => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:05:47.813811 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b618b38b-8e0e-4026-9a5d-3d26b5d81785 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:47.843760 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b55b2f-38f2-4300-a8d7-bfcc6035ddd5 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:47.884340 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80373d8-ba94-4bca-846e-fbc98b94a6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:47.885149 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80373d8-ba94-4bca-846e-fbc98b94a6ab None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:47.885969 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80373d8-ba94-4bca-846e-fbc98b94a6ab None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:47.886248 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80373d8-ba94-4bca-846e-fbc98b94a6ab None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:47.901329 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80373d8-ba94-4bca-846e-fbc98b94a6ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:05:47.910814 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-d80373d8-ba94-4bca-846e-fbc98b94a6ab None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 07 06:05:47.912276 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 75/151] 10.222.0.24 () {56 vars in 1099 bytes} [Thu Apr 7 06:05:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 07 06:05:47.918259 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80373d8-ba94-4bca-846e-fbc98b94a6ab None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:48.006003 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b618b38b-8e0e-4026-9a5d-3d26b5d81785 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:48.027081 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80373d8-ba94-4bca-846e-fbc98b94a6ab None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:48.062658 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809f8f4-4647-4492-93c7-f199619d9891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:48.063342 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809f8f4-4647-4492-93c7-f199619d9891 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:48.063629 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809f8f4-4647-4492-93c7-f199619d9891 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:48.063940 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809f8f4-4647-4492-93c7-f199619d9891 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:48.064704 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1809f8f4-4647-4492-93c7-f199619d9891 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:05:48.065015 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1809f8f4-4647-4492-93c7-f199619d9891 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:48.066428 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1809f8f4-4647-4492-93c7-f199619d9891 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:48.076111 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 76/152] 10.222.0.24 () {56 vars in 1101 bytes} [Thu Apr 7 06:05:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:48.083539 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809f8f4-4647-4492-93c7-f199619d9891 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:48.100517 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820df16b-0232-4b7c-b9ca-4d13b2de72dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:48.101210 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820df16b-0232-4b7c-b9ca-4d13b2de72dd None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:48.101499 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820df16b-0232-4b7c-b9ca-4d13b2de72dd None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:48.101784 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820df16b-0232-4b7c-b9ca-4d13b2de72dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:48.102629 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820df16b-0232-4b7c-b9ca-4d13b2de72dd None admin] RBAC: Adding query filter params (role.id=7abd6a5977df4ff4a5476c2d95a1934b, scope.project.id=f2feaca3faed4ec0a547bb377a6f494e, user.id=e3ccb23df7814ee8bbd9a0cd75ed58d6) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:05:48.102947 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820df16b-0232-4b7c-b9ca-4d13b2de72dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:48.104978 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820df16b-0232-4b7c-b9ca-4d13b2de72dd None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:48.112899 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 77/153] 10.222.0.24 () {56 vars in 1374 bytes} [Thu Apr 7 06:05:47 2022] GET /identity/v3/role_assignments?user.id=e3ccb23df7814ee8bbd9a0cd75ed58d6&scope.project.id=f2feaca3faed4ec0a547bb377a6f494e&role.id=7abd6a5977df4ff4a5476c2d95a1934b => generated 608 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:05:48.213796 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809f8f4-4647-4492-93c7-f199619d9891 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:48.256936 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff6c1c5-226d-4359-82d1-17daf010da65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:48.257762 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6c1c5-226d-4359-82d1-17daf010da65 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:48.258052 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6c1c5-226d-4359-82d1-17daf010da65 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:48.258331 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6c1c5-226d-4359-82d1-17daf010da65 None admin] PATH_INFO: `/v3/users/713f43722c5a47098fd7e8fdb79aaf1e` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:48.264746 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff6c1c5-226d-4359-82d1-17daf010da65 None admin] RBAC: Authorizing `identity:get_user(user_id=713f43722c5a47098fd7e8fdb79aaf1e)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:48.266270 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff6c1c5-226d-4359-82d1-17daf010da65 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:48.268238 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 77/154] 10.222.0.24 () {56 vars in 1177 bytes} [Thu Apr 7 06:05:48 2022] GET /identity/v3/users/713f43722c5a47098fd7e8fdb79aaf1e => generated 289 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:48.273821 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820df16b-0232-4b7c-b9ca-4d13b2de72dd None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:48.418550 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820df16b-0232-4b7c-b9ca-4d13b2de72dd None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:48.459252 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea643e9f-5df6-4ccb-ae15-7b70c0707901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:48.460144 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea643e9f-5df6-4ccb-ae15-7b70c0707901 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:48.460427 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea643e9f-5df6-4ccb-ae15-7b70c0707901 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:48.460703 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea643e9f-5df6-4ccb-ae15-7b70c0707901 None admin] PATH_INFO: `/v3/projects/f2feaca3faed4ec0a547bb377a6f494e` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:48.461900 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea643e9f-5df6-4ccb-ae15-7b70c0707901 None admin] RBAC: Authorizing `identity:get_project(project_id=f2feaca3faed4ec0a547bb377a6f494e)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:48.465839 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea643e9f-5df6-4ccb-ae15-7b70c0707901 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:48.467815 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 78/155] 10.222.0.24 () {56 vars in 1186 bytes} [Thu Apr 7 06:05:48 2022] GET /identity/v3/projects/f2feaca3faed4ec0a547bb377a6f494e => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:48.473166 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff6c1c5-226d-4359-82d1-17daf010da65 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:48.647365 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff6c1c5-226d-4359-82d1-17daf010da65 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:48.681227 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c683a-25a6-46a2-8b72-937bd76a6a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:48.682172 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c683a-25a6-46a2-8b72-937bd76a6a36 None admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:48.682464 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c683a-25a6-46a2-8b72-937bd76a6a36 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:48.682740 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c683a-25a6-46a2-8b72-937bd76a6a36 None admin] PATH_INFO: `/v3/projects/f2feaca3faed4ec0a547bb377a6f494e/users/713f43722c5a47098fd7e8fdb79aaf1e/roles/a1818b2066464c9caae41106650b2c17` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:48.685566 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808c683a-25a6-46a2-8b72-937bd76a6a36 None admin] RBAC: Authorizing `identity:create_grant(project_id=f2feaca3faed4ec0a547bb377a6f494e, user_id=713f43722c5a47098fd7e8fdb79aaf1e, role_id=a1818b2066464c9caae41106650b2c17)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:48.687028 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808c683a-25a6-46a2-8b72-937bd76a6a36 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:48.708237 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d753e-9a46-4d9f-bb8c-6a3d1b71e9fd None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:48.708512 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d753e-9a46-4d9f-bb8c-6a3d1b71e9fd None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:48.712285 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d753e-9a46-4d9f-bb8c-6a3d1b71e9fd None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:48.712285 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 79/156] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:05:48.715979 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ae83b-7acb-41b6-a1af-8cce89147499 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:48.716267 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ae83b-7acb-41b6-a1af-8cce89147499 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:48.716549 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ae83b-7acb-41b6-a1af-8cce89147499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:48.741707 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-5f1ae83b-7acb-41b6-a1af-8cce89147499 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:05:48.742878 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-5f1ae83b-7acb-41b6-a1af-8cce89147499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:05:48.778330 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 78/157] 10.222.0.24 () {58 vars in 1439 bytes} [Thu Apr 7 06:05:48 2022] PUT /identity/v3/projects/f2feaca3faed4ec0a547bb377a6f494e/users/713f43722c5a47098fd7e8fdb79aaf1e/roles/a1818b2066464c9caae41106650b2c17 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:05:48.841876 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 80/158] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:05:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 07 06:05:48.906557 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c683a-25a6-46a2-8b72-937bd76a6a36 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:49.049844 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c683a-25a6-46a2-8b72-937bd76a6a36 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:49.098132 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef49b7-9a5d-4975-a342-02b76838d4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:49.099232 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef49b7-9a5d-4975-a342-02b76838d4a6 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:49.099661 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef49b7-9a5d-4975-a342-02b76838d4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:49.100168 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef49b7-9a5d-4975-a342-02b76838d4a6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:49.113083 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feef49b7-9a5d-4975-a342-02b76838d4a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:05:49.121134 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-feef49b7-9a5d-4975-a342-02b76838d4a6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 07 06:05:49.122544 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 79/159] 10.222.0.24 () {56 vars in 1099 bytes} [Thu Apr 7 06:05:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:05:49.128411 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ae83b-7acb-41b6-a1af-8cce89147499 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:49.194635 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611503a9-a167-4c66-ac67-a5486ee04577 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:49.195133 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611503a9-a167-4c66-ac67-a5486ee04577 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:49.195555 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611503a9-a167-4c66-ac67-a5486ee04577 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:49.197209 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 80/160] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:05:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 07 06:05:49.202473 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7caf4-455b-4c83-8e48-3bc8f4ef98ae None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:49.203043 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7caf4-455b-4c83-8e48-3bc8f4ef98ae None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:49.203521 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7caf4-455b-4c83-8e48-3bc8f4ef98ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:49.231902 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-00c7caf4-455b-4c83-8e48-3bc8f4ef98ae None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:05:49.233432 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-00c7caf4-455b-4c83-8e48-3bc8f4ef98ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:05:49.311972 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ae83b-7acb-41b6-a1af-8cce89147499 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:49.365533 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 81/161] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:05:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Apr 07 06:05:49.384065 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c474ee89-33dd-4f0a-bfa6-3afbbedd1fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:49.384750 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474ee89-33dd-4f0a-bfa6-3afbbedd1fc5 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:49.385034 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474ee89-33dd-4f0a-bfa6-3afbbedd1fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:49.385845 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474ee89-33dd-4f0a-bfa6-3afbbedd1fc5 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:49.386695 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c474ee89-33dd-4f0a-bfa6-3afbbedd1fc5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:05:49.387000 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c474ee89-33dd-4f0a-bfa6-3afbbedd1fc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:49.388411 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c474ee89-33dd-4f0a-bfa6-3afbbedd1fc5 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:49.406209 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 81/162] 10.222.0.24 () {56 vars in 1101 bytes} [Thu Apr 7 06:05:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:49.411715 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c7caf4-455b-4c83-8e48-3bc8f4ef98ae None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:49.413414 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c474ee89-33dd-4f0a-bfa6-3afbbedd1fc5 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:49.599302 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c474ee89-33dd-4f0a-bfa6-3afbbedd1fc5 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:49.601812 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c7caf4-455b-4c83-8e48-3bc8f4ef98ae None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:49.666100 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d427f-ab54-4b20-8ca7-36ed4c137bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:49.667455 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d427f-ab54-4b20-8ca7-36ed4c137bcc None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:49.667758 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d427f-ab54-4b20-8ca7-36ed4c137bcc None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:49.668121 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d427f-ab54-4b20-8ca7-36ed4c137bcc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:49.669011 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9dbd4-0997-42c9-9bfd-4520dee228ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:49.670113 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9dbd4-0997-42c9-9bfd-4520dee228ae None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:49.670592 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9dbd4-0997-42c9-9bfd-4520dee228ae None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:49.671076 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9dbd4-0997-42c9-9bfd-4520dee228ae None admin] PATH_INFO: `/v3/users/e3ccb23df7814ee8bbd9a0cd75ed58d6` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:49.675358 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c9dbd4-0997-42c9-9bfd-4520dee228ae None admin] RBAC: Authorizing `identity:get_user(user_id=e3ccb23df7814ee8bbd9a0cd75ed58d6)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:49.677079 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c9dbd4-0997-42c9-9bfd-4520dee228ae None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:49.678962 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 82/163] 10.222.0.24 () {56 vars in 1177 bytes} [Thu Apr 7 06:05:49 2022] GET /identity/v3/users/e3ccb23df7814ee8bbd9a0cd75ed58d6 => generated 275 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:49.684553 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9dbd4-0997-42c9-9bfd-4520dee228ae None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:49.700756 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415d427f-ab54-4b20-8ca7-36ed4c137bcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:05:49.708243 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-415d427f-ab54-4b20-8ca7-36ed4c137bcc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 07 06:05:49.715153 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 82/164] 10.222.0.24 () {56 vars in 1114 bytes} [Thu Apr 7 06:05:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:05:49.716074 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d427f-ab54-4b20-8ca7-36ed4c137bcc None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:49.866920 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9dbd4-0997-42c9-9bfd-4520dee228ae None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:49.910813 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f9668-9ba6-497f-9d90-ce8a57882cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:49.911780 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f9668-9ba6-497f-9d90-ce8a57882cc5 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:49.912174 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f9668-9ba6-497f-9d90-ce8a57882cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:49.912645 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f9668-9ba6-497f-9d90-ce8a57882cc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:49.951347 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d427f-ab54-4b20-8ca7-36ed4c137bcc None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:49.984132 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f9668-9ba6-497f-9d90-ce8a57882cc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:49.985958 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f9668-9ba6-497f-9d90-ce8a57882cc5 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:50.009565 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee9631a-80b1-4467-ae93-39064d4ff00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:50.010344 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9631a-80b1-4467-ae93-39064d4ff00c None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:50.010634 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9631a-80b1-4467-ae93-39064d4ff00c None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:50.010915 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9631a-80b1-4467-ae93-39064d4ff00c None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:50.011721 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee9631a-80b1-4467-ae93-39064d4ff00c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:05:50.012055 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee9631a-80b1-4467-ae93-39064d4ff00c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:50.013435 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee9631a-80b1-4467-ae93-39064d4ff00c None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:50.021738 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 83/165] 10.222.0.24 () {56 vars in 1111 bytes} [Thu Apr 7 06:05:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:50.023244 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5305d-9afb-4213-ae7c-75c31497ed4f None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:50.023372 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5305d-9afb-4213-ae7c-75c31497ed4f None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:50.023567 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5305d-9afb-4213-ae7c-75c31497ed4f None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:50.029132 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 84/166] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:05:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:05:50.031644 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a5305d-9afb-4213-ae7c-75c31497ed4f None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:50.093147 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 83/167] 10.222.0.24 () {58 vars in 1282 bytes} [Thu Apr 7 06:05:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 07 06:05:50.094903 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628db4e-9d09-428c-9970-e9ba722be21b None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:50.095389 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628db4e-9d09-428c-9970-e9ba722be21b None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:50.095890 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628db4e-9d09-428c-9970-e9ba722be21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:50.113387 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-b628db4e-9d09-428c-9970-e9ba722be21b None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:05:50.114909 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b628db4e-9d09-428c-9970-e9ba722be21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:05:50.217726 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 84/168] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:05:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:05:50.218898 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b628db4e-9d09-428c-9970-e9ba722be21b None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:50.254610 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a5305d-9afb-4213-ae7c-75c31497ed4f None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:50.311157 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b4d9f0-0138-4196-8817-1a38a6240afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:50.312070 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b4d9f0-0138-4196-8817-1a38a6240afc None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:50.312352 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b4d9f0-0138-4196-8817-1a38a6240afc None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:50.312623 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b4d9f0-0138-4196-8817-1a38a6240afc None admin] PATH_INFO: `/v3/users/e3ccb23df7814ee8bbd9a0cd75ed58d6` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:50.313827 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b4d9f0-0138-4196-8817-1a38a6240afc None admin] RBAC: Authorizing `identity:get_user(user_id=e3ccb23df7814ee8bbd9a0cd75ed58d6)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:50.315280 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b4d9f0-0138-4196-8817-1a38a6240afc None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:50.317152 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 85/169] 10.222.0.24 () {56 vars in 1177 bytes} [Thu Apr 7 06:05:50 2022] GET /identity/v3/users/e3ccb23df7814ee8bbd9a0cd75ed58d6 => generated 275 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:50.317689 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b4d9f0-0138-4196-8817-1a38a6240afc None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:50.361901 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b628db4e-9d09-428c-9970-e9ba722be21b None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:50.397988 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d917d04-d165-42ed-b972-01c5b861bad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:50.399298 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d917d04-d165-42ed-b972-01c5b861bad6 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:50.399816 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d917d04-d165-42ed-b972-01c5b861bad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:50.400312 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d917d04-d165-42ed-b972-01c5b861bad6 None admin] PATH_INFO: `/v3/projects/84640c32095b4e75b3c06b07a4e11f7b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:50.402110 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d917d04-d165-42ed-b972-01c5b861bad6 None admin] RBAC: Authorizing `identity:get_project(project_id=84640c32095b4e75b3c06b07a4e11f7b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:50.403895 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d917d04-d165-42ed-b972-01c5b861bad6 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:50.405919 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 85/170] 10.222.0.24 () {56 vars in 1186 bytes} [Thu Apr 7 06:05:50 2022] GET /identity/v3/projects/84640c32095b4e75b3c06b07a4e11f7b => generated 312 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:50.407205 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d917d04-d165-42ed-b972-01c5b861bad6 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:50.418050 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b4d9f0-0138-4196-8817-1a38a6240afc None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:50.453038 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4364cfa3-e1df-4de7-8157-d8a6b984a5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:50.453779 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4364cfa3-e1df-4de7-8157-d8a6b984a5a9 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:50.454060 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4364cfa3-e1df-4de7-8157-d8a6b984a5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:50.454335 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4364cfa3-e1df-4de7-8157-d8a6b984a5a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:50.465226 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4364cfa3-e1df-4de7-8157-d8a6b984a5a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:05:50.471871 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-4364cfa3-e1df-4de7-8157-d8a6b984a5a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 07 06:05:50.473045 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 86/171] 10.222.0.24 () {56 vars in 1096 bytes} [Thu Apr 7 06:05:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:05:50.473828 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4364cfa3-e1df-4de7-8157-d8a6b984a5a9 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:50.515821 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d917d04-d165-42ed-b972-01c5b861bad6 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:50.550531 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0247d543-afd5-47ce-adf4-11846b1d94bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:50.551527 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247d543-afd5-47ce-adf4-11846b1d94bd None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:50.552054 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247d543-afd5-47ce-adf4-11846b1d94bd None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:50.552554 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247d543-afd5-47ce-adf4-11846b1d94bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:50.572463 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4364cfa3-e1df-4de7-8157-d8a6b984a5a9 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:50.605564 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5268f8d-733c-4e0a-b8fa-c9237e3246fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:50.606224 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5268f8d-733c-4e0a-b8fa-c9237e3246fe None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:50.606503 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5268f8d-733c-4e0a-b8fa-c9237e3246fe None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:50.606775 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5268f8d-733c-4e0a-b8fa-c9237e3246fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:50.607609 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5268f8d-733c-4e0a-b8fa-c9237e3246fe None admin] RBAC: Adding query filter params (role.id=7abd6a5977df4ff4a5476c2d95a1934b, scope.project.id=84640c32095b4e75b3c06b07a4e11f7b, user.id=e3ccb23df7814ee8bbd9a0cd75ed58d6) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:05:50.607945 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5268f8d-733c-4e0a-b8fa-c9237e3246fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:50.609414 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5268f8d-733c-4e0a-b8fa-c9237e3246fe None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:50.615605 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 87/172] 10.222.0.24 () {56 vars in 1374 bytes} [Thu Apr 7 06:05:50 2022] GET /identity/v3/role_assignments?user.id=e3ccb23df7814ee8bbd9a0cd75ed58d6&scope.project.id=84640c32095b4e75b3c06b07a4e11f7b&role.id=7abd6a5977df4ff4a5476c2d95a1934b => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:50.616214 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5268f8d-733c-4e0a-b8fa-c9237e3246fe None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:50.628321 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0247d543-afd5-47ce-adf4-11846b1d94bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:50.630139 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0247d543-afd5-47ce-adf4-11846b1d94bd None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:50.765926 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5268f8d-733c-4e0a-b8fa-c9237e3246fe None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:50.819137 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 86/173] 10.222.0.24 () {58 vars in 1282 bytes} [Thu Apr 7 06:05:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 07 06:05:50.825329 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0247d543-afd5-47ce-adf4-11846b1d94bd None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:50.849004 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7932ffe0-e491-49f3-8a82-8e67bd0fe92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:50.849695 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932ffe0-e491-49f3-8a82-8e67bd0fe92b None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:50.849988 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932ffe0-e491-49f3-8a82-8e67bd0fe92b None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:50.850262 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932ffe0-e491-49f3-8a82-8e67bd0fe92b None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:50.851025 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7932ffe0-e491-49f3-8a82-8e67bd0fe92b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:05:50.851337 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7932ffe0-e491-49f3-8a82-8e67bd0fe92b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:50.854222 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7932ffe0-e491-49f3-8a82-8e67bd0fe92b None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:50.870787 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 88/174] 10.222.0.24 () {56 vars in 1099 bytes} [Thu Apr 7 06:05:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:50.877034 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7932ffe0-e491-49f3-8a82-8e67bd0fe92b None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:50.992783 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0247d543-afd5-47ce-adf4-11846b1d94bd None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:51.030553 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7932ffe0-e491-49f3-8a82-8e67bd0fe92b None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:51.037319 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e720e-7d8a-41fc-9ace-3a7cee5c8aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:51.038286 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e720e-7d8a-41fc-9ace-3a7cee5c8aa1 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:51.039226 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e720e-7d8a-41fc-9ace-3a7cee5c8aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:51.039331 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e720e-7d8a-41fc-9ace-3a7cee5c8aa1 None admin] PATH_INFO: `/v3/projects/f2feaca3faed4ec0a547bb377a6f494e` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:51.040680 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063e720e-7d8a-41fc-9ace-3a7cee5c8aa1 None admin] RBAC: Authorizing `identity:get_project(project_id=f2feaca3faed4ec0a547bb377a6f494e)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:51.043144 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063e720e-7d8a-41fc-9ace-3a7cee5c8aa1 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:51.045884 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 87/175] 10.222.0.24 () {56 vars in 1186 bytes} [Thu Apr 7 06:05:50 2022] GET /identity/v3/projects/f2feaca3faed4ec0a547bb377a6f494e => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:05:51.051805 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9e33b-5d22-41fb-83cf-6810261cf47c None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:51.053736 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9e33b-5d22-41fb-83cf-6810261cf47c None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:51.054207 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9e33b-5d22-41fb-83cf-6810261cf47c None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:51.055830 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 88/176] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:05:51 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:05:51.060192 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a9e33b-5d22-41fb-83cf-6810261cf47c None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:51.077725 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45bdede-6b20-4b13-ac3e-41a588fce6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:51.078731 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45bdede-6b20-4b13-ac3e-41a588fce6d3 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:51.079102 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45bdede-6b20-4b13-ac3e-41a588fce6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:51.080324 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45bdede-6b20-4b13-ac3e-41a588fce6d3 None admin] PATH_INFO: `/v3/users/91c1e479128840248c7c0e4e51af60ff` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:51.081659 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45bdede-6b20-4b13-ac3e-41a588fce6d3 None admin] RBAC: Authorizing `identity:get_user(user_id=91c1e479128840248c7c0e4e51af60ff)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:51.083252 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45bdede-6b20-4b13-ac3e-41a588fce6d3 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:51.085379 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 89/177] 10.222.0.24 () {56 vars in 1177 bytes} [Thu Apr 7 06:05:50 2022] GET /identity/v3/users/91c1e479128840248c7c0e4e51af60ff => generated 247 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:51.086653 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076abc6-97b7-4ef1-98b2-745419c8f3ef None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:51.087016 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076abc6-97b7-4ef1-98b2-745419c8f3ef None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:51.087370 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076abc6-97b7-4ef1-98b2-745419c8f3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:51.117095 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-7076abc6-97b7-4ef1-98b2-745419c8f3ef None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:05:51.118299 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-7076abc6-97b7-4ef1-98b2-745419c8f3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:05:51.238704 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a9e33b-5d22-41fb-83cf-6810261cf47c None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:51.249569 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 90/178] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:05:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:05:51.250472 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076abc6-97b7-4ef1-98b2-745419c8f3ef None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:51.318493 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2dde75-6e8d-46e1-8b25-b465c6ec762c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:51.319535 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2dde75-6e8d-46e1-8b25-b465c6ec762c None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:51.320096 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2dde75-6e8d-46e1-8b25-b465c6ec762c None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:51.320648 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2dde75-6e8d-46e1-8b25-b465c6ec762c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:51.321700 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2dde75-6e8d-46e1-8b25-b465c6ec762c None admin] RBAC: Adding query filter params (role.id=7ad9776ea3b0430cb02c4599d037c8be, scope.project.id=f2feaca3faed4ec0a547bb377a6f494e, user.id=e3ccb23df7814ee8bbd9a0cd75ed58d6) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:05:51.322225 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2dde75-6e8d-46e1-8b25-b465c6ec762c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:51.327363 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2dde75-6e8d-46e1-8b25-b465c6ec762c None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:51.333994 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 89/179] 10.222.0.24 () {56 vars in 1374 bytes} [Thu Apr 7 06:05:51 2022] GET /identity/v3/role_assignments?user.id=e3ccb23df7814ee8bbd9a0cd75ed58d6&scope.project.id=f2feaca3faed4ec0a547bb377a6f494e&role.id=7ad9776ea3b0430cb02c4599d037c8be => generated 608 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:51.336836 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2dde75-6e8d-46e1-8b25-b465c6ec762c None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:51.412273 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076abc6-97b7-4ef1-98b2-745419c8f3ef None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:51.453727 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a97d5-e1c3-45d6-84d9-50cbfb71ed74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:51.454460 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a97d5-e1c3-45d6-84d9-50cbfb71ed74 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:51.454788 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a97d5-e1c3-45d6-84d9-50cbfb71ed74 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:51.454957 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a97d5-e1c3-45d6-84d9-50cbfb71ed74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:51.517249 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2dde75-6e8d-46e1-8b25-b465c6ec762c None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:51.568169 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a0923-dd4f-41ec-945f-27f73f5d3108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:51.569039 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a0923-dd4f-41ec-945f-27f73f5d3108 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:51.569263 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a0923-dd4f-41ec-945f-27f73f5d3108 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:51.569538 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a0923-dd4f-41ec-945f-27f73f5d3108 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:51.584055 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4a0923-dd4f-41ec-945f-27f73f5d3108 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:05:51.591618 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-3b4a0923-dd4f-41ec-945f-27f73f5d3108 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 07 06:05:51.592923 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 90/180] 10.222.0.24 () {56 vars in 1096 bytes} [Thu Apr 7 06:05:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:05:51.594178 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8c804-fb6b-4556-b3b9-dc1f095fcee9 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:51.594465 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8c804-fb6b-4556-b3b9-dc1f095fcee9 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:51.594738 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8c804-fb6b-4556-b3b9-dc1f095fcee9 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:51.596036 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 91/181] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:05:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:05:51.600786 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9a97d5-e1c3-45d6-84d9-50cbfb71ed74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:51.602274 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9a97d5-e1c3-45d6-84d9-50cbfb71ed74 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:51.602624 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8c804-fb6b-4556-b3b9-dc1f095fcee9 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:51.731664 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 91/182] 10.222.0.24 () {58 vars in 1282 bytes} [Thu Apr 7 06:05:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 07 06:05:51.734585 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764bca7-18d5-4a01-bbfd-7d4b82a2b25e None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:51.734585 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764bca7-18d5-4a01-bbfd-7d4b82a2b25e None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:51.734585 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764bca7-18d5-4a01-bbfd-7d4b82a2b25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:51.740706 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8c804-fb6b-4556-b3b9-dc1f095fcee9 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:51.753997 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-a764bca7-18d5-4a01-bbfd-7d4b82a2b25e None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:05:51.755180 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a764bca7-18d5-4a01-bbfd-7d4b82a2b25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:05:51.785424 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7adea8e-56cd-4c4c-8133-acbeb8781851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:51.786407 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7adea8e-56cd-4c4c-8133-acbeb8781851 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:51.786699 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7adea8e-56cd-4c4c-8133-acbeb8781851 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:51.786978 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7adea8e-56cd-4c4c-8133-acbeb8781851 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:51.787739 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7adea8e-56cd-4c4c-8133-acbeb8781851 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:05:51.787739 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7adea8e-56cd-4c4c-8133-acbeb8781851 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:51.789438 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7adea8e-56cd-4c4c-8133-acbeb8781851 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:51.801507 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 92/183] 10.222.0.24 () {56 vars in 1099 bytes} [Thu Apr 7 06:05:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:51.801995 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7adea8e-56cd-4c4c-8133-acbeb8781851 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:51.850784 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 92/184] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:05:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:05:51.851585 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764bca7-18d5-4a01-bbfd-7d4b82a2b25e None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:51.934257 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7adea8e-56cd-4c4c-8133-acbeb8781851 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:51.976520 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfb366b-e07c-4d2f-bb2f-ca429546a431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:51.977447 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb366b-e07c-4d2f-bb2f-ca429546a431 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:51.977737 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb366b-e07c-4d2f-bb2f-ca429546a431 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:51.978446 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb366b-e07c-4d2f-bb2f-ca429546a431 None admin] PATH_INFO: `/v3/projects/f2feaca3faed4ec0a547bb377a6f494e` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:51.980444 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfb366b-e07c-4d2f-bb2f-ca429546a431 None admin] RBAC: Authorizing `identity:get_project(project_id=f2feaca3faed4ec0a547bb377a6f494e)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:51.982667 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfb366b-e07c-4d2f-bb2f-ca429546a431 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:51.987848 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 93/185] 10.222.0.24 () {56 vars in 1186 bytes} [Thu Apr 7 06:05:51 2022] GET /identity/v3/projects/f2feaca3faed4ec0a547bb377a6f494e => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:51.988676 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfb366b-e07c-4d2f-bb2f-ca429546a431 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:51.997892 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764bca7-18d5-4a01-bbfd-7d4b82a2b25e None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:52.042084 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8724a1-e020-4d5a-a3fb-66cdfa364b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:52.042974 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8724a1-e020-4d5a-a3fb-66cdfa364b33 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:52.043257 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8724a1-e020-4d5a-a3fb-66cdfa364b33 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:52.043532 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8724a1-e020-4d5a-a3fb-66cdfa364b33 None admin] PATH_INFO: `/v3/users/978a1bc6f420436bb0026afaefb9b984` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:52.061367 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8724a1-e020-4d5a-a3fb-66cdfa364b33 None admin] RBAC: Authorizing `identity:get_user(user_id=978a1bc6f420436bb0026afaefb9b984)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:52.063151 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8724a1-e020-4d5a-a3fb-66cdfa364b33 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:52.066360 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 93/186] 10.222.0.24 () {56 vars in 1177 bytes} [Thu Apr 7 06:05:51 2022] GET /identity/v3/users/978a1bc6f420436bb0026afaefb9b984 => generated 283 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:52.067307 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8724a1-e020-4d5a-a3fb-66cdfa364b33 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:52.097741 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfb366b-e07c-4d2f-bb2f-ca429546a431 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:52.132985 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250ce15a-e77d-4765-bd44-971cb5ed568e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:52.133704 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ce15a-e77d-4765-bd44-971cb5ed568e None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:52.133986 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ce15a-e77d-4765-bd44-971cb5ed568e None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:52.134266 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ce15a-e77d-4765-bd44-971cb5ed568e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:52.144482 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250ce15a-e77d-4765-bd44-971cb5ed568e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:05:52.152307 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-250ce15a-e77d-4765-bd44-971cb5ed568e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 07 06:05:52.153563 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 94/187] 10.222.0.24 () {56 vars in 1114 bytes} [Thu Apr 7 06:05:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:05:52.154341 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250ce15a-e77d-4765-bd44-971cb5ed568e None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:52.176907 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8724a1-e020-4d5a-a3fb-66cdfa364b33 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:52.209425 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6139036e-2eef-46ee-a91c-cc60355cf0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:52.210082 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6139036e-2eef-46ee-a91c-cc60355cf0ca None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:52.210369 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6139036e-2eef-46ee-a91c-cc60355cf0ca None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:52.210629 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6139036e-2eef-46ee-a91c-cc60355cf0ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:52.211455 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6139036e-2eef-46ee-a91c-cc60355cf0ca None admin] RBAC: Adding query filter params (role.id=0fab680bc76f4a73826e9beb59e8129b, scope.project.id=f2feaca3faed4ec0a547bb377a6f494e, user.id=91c1e479128840248c7c0e4e51af60ff) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:05:52.211857 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6139036e-2eef-46ee-a91c-cc60355cf0ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:52.213745 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6139036e-2eef-46ee-a91c-cc60355cf0ca None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:52.226200 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 94/188] 10.222.0.24 () {56 vars in 1374 bytes} [Thu Apr 7 06:05:52 2022] GET /identity/v3/role_assignments?user.id=91c1e479128840248c7c0e4e51af60ff&scope.project.id=f2feaca3faed4ec0a547bb377a6f494e&role.id=0fab680bc76f4a73826e9beb59e8129b => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:52.226200 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f6568-a699-4e17-9e6e-475f7fabbf4d None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:52.226200 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f6568-a699-4e17-9e6e-475f7fabbf4d None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:52.226200 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f6568-a699-4e17-9e6e-475f7fabbf4d None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:52.226200 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 95/189] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:05:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:05:52.226200 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f6568-a699-4e17-9e6e-475f7fabbf4d None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:52.264230 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250ce15a-e77d-4765-bd44-971cb5ed568e None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:52.304417 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f3740-ad79-4048-9c9f-33475ad2cf1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:52.305707 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f3740-ad79-4048-9c9f-33475ad2cf1b None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:52.306001 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f3740-ad79-4048-9c9f-33475ad2cf1b None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:52.306281 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f3740-ad79-4048-9c9f-33475ad2cf1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:52.350840 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f6568-a699-4e17-9e6e-475f7fabbf4d None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:52.392757 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c8a5f2-5e92-418a-b8e8-b1eeb43a4fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:52.393237 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c8a5f2-5e92-418a-b8e8-b1eeb43a4fa8 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:52.393526 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c8a5f2-5e92-418a-b8e8-b1eeb43a4fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:52.393803 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c8a5f2-5e92-418a-b8e8-b1eeb43a4fa8 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:52.394768 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c8a5f2-5e92-418a-b8e8-b1eeb43a4fa8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:05:52.394873 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c8a5f2-5e92-418a-b8e8-b1eeb43a4fa8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:52.396391 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c8a5f2-5e92-418a-b8e8-b1eeb43a4fa8 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:52.406087 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 96/190] 10.222.0.24 () {56 vars in 1111 bytes} [Thu Apr 7 06:05:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:52.406087 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3387f9e1-a7cd-4580-927f-a36b583c5c2d None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:52.406087 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3387f9e1-a7cd-4580-927f-a36b583c5c2d None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:52.406087 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3387f9e1-a7cd-4580-927f-a36b583c5c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:52.416250 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0f3740-ad79-4048-9c9f-33475ad2cf1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:52.417829 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0f3740-ad79-4048-9c9f-33475ad2cf1b None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:52.428967 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-3387f9e1-a7cd-4580-927f-a36b583c5c2d None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:05:52.430780 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-3387f9e1-a7cd-4580-927f-a36b583c5c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:05:52.510200 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 97/191] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:05:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:05:52.510200 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3387f9e1-a7cd-4580-927f-a36b583c5c2d None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:52.534191 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 95/192] 10.222.0.24 () {58 vars in 1282 bytes} [Thu Apr 7 06:05:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 07 06:05:52.535680 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a390ca-a150-4963-8c35-31d55a6c2871 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:52.536019 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a390ca-a150-4963-8c35-31d55a6c2871 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:52.536301 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a390ca-a150-4963-8c35-31d55a6c2871 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:52.538601 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 96/193] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:05:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:05:52.538601 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a390ca-a150-4963-8c35-31d55a6c2871 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:52.599193 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3387f9e1-a7cd-4580-927f-a36b583c5c2d None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:52.631356 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60357863-40e6-4a6a-970a-64f759e1ce03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:52.632263 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60357863-40e6-4a6a-970a-64f759e1ce03 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:52.632550 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60357863-40e6-4a6a-970a-64f759e1ce03 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:52.632818 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60357863-40e6-4a6a-970a-64f759e1ce03 None admin] PATH_INFO: `/v3/users/978a1bc6f420436bb0026afaefb9b984` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:52.633636 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a390ca-a150-4963-8c35-31d55a6c2871 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:52.633991 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60357863-40e6-4a6a-970a-64f759e1ce03 None admin] RBAC: Authorizing `identity:get_user(user_id=978a1bc6f420436bb0026afaefb9b984)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:52.635477 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60357863-40e6-4a6a-970a-64f759e1ce03 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:52.637108 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 98/194] 10.222.0.24 () {56 vars in 1177 bytes} [Thu Apr 7 06:05:52 2022] GET /identity/v3/users/978a1bc6f420436bb0026afaefb9b984 => generated 283 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:52.637918 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60357863-40e6-4a6a-970a-64f759e1ce03 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:52.665558 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b083a-8b3e-478a-97c4-785d9d806ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:52.666804 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b083a-8b3e-478a-97c4-785d9d806ea4 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:52.667086 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b083a-8b3e-478a-97c4-785d9d806ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:52.667355 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b083a-8b3e-478a-97c4-785d9d806ea4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:52.668536 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982b083a-8b3e-478a-97c4-785d9d806ea4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:52.669961 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982b083a-8b3e-478a-97c4-785d9d806ea4 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:52.671558 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 97/195] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:05:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:52.672710 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d924992-1821-4285-ac15-89b87f7d8efd None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:52.672994 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d924992-1821-4285-ac15-89b87f7d8efd None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:52.673267 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d924992-1821-4285-ac15-89b87f7d8efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:52.688390 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-8d924992-1821-4285-ac15-89b87f7d8efd None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:05:52.689544 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-8d924992-1821-4285-ac15-89b87f7d8efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:05:52.731703 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60357863-40e6-4a6a-970a-64f759e1ce03 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:52.751447 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 98/196] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:05:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:05:52.752292 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d924992-1821-4285-ac15-89b87f7d8efd None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:52.769331 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae288109-77c4-405f-97f5-87f72c07947e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:52.769990 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae288109-77c4-405f-97f5-87f72c07947e None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:52.770282 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae288109-77c4-405f-97f5-87f72c07947e None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:52.770854 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae288109-77c4-405f-97f5-87f72c07947e None admin] PATH_INFO: `/v3/projects/fc392bd6c8534b789823b148310d9370` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:52.772203 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae288109-77c4-405f-97f5-87f72c07947e None admin] RBAC: Authorizing `identity:get_project(project_id=fc392bd6c8534b789823b148310d9370)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:52.773601 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae288109-77c4-405f-97f5-87f72c07947e None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:52.775332 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 99/197] 10.222.0.24 () {56 vars in 1186 bytes} [Thu Apr 7 06:05:52 2022] GET /identity/v3/projects/fc392bd6c8534b789823b148310d9370 => generated 302 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:52.776381 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae288109-77c4-405f-97f5-87f72c07947e None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:52.847484 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d924992-1821-4285-ac15-89b87f7d8efd None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:52.870140 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae288109-77c4-405f-97f5-87f72c07947e None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:52.879484 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a264c6f-1ddf-4b2a-95cc-06bb6d22b8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:52.880166 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a264c6f-1ddf-4b2a-95cc-06bb6d22b8c4 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:52.880451 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a264c6f-1ddf-4b2a-95cc-06bb6d22b8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:52.880734 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a264c6f-1ddf-4b2a-95cc-06bb6d22b8c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:52.901588 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11adaee7-606f-44ef-ab49-01f1a40bb653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:52.902248 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11adaee7-606f-44ef-ab49-01f1a40bb653 None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:52.902531 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11adaee7-606f-44ef-ab49-01f1a40bb653 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:52.902808 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11adaee7-606f-44ef-ab49-01f1a40bb653 None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:52.903510 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11adaee7-606f-44ef-ab49-01f1a40bb653 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:52.904972 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11adaee7-606f-44ef-ab49-01f1a40bb653 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:52.943886 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a264c6f-1ddf-4b2a-95cc-06bb6d22b8c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:52.945327 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a264c6f-1ddf-4b2a-95cc-06bb6d22b8c4 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:52.988592 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 100/198] 10.222.0.24 () {60 vars in 1132 bytes} [Thu Apr 7 06:05:52 2022] POST /identity/v3/users => generated 297 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:05:52.989494 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11adaee7-606f-44ef-ab49-01f1a40bb653 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:53.048245 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 99/199] 10.222.0.24 () {58 vars in 1282 bytes} [Thu Apr 7 06:05:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 07 06:05:53.049211 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a264c6f-1ddf-4b2a-95cc-06bb6d22b8c4 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:53.101029 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11adaee7-606f-44ef-ab49-01f1a40bb653 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:53.137048 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa042c-865f-459f-8146-9084cca8c998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:53.137977 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa042c-865f-459f-8146-9084cca8c998 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:53.138270 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa042c-865f-459f-8146-9084cca8c998 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:53.138552 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa042c-865f-459f-8146-9084cca8c998 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:53.149408 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fa042c-865f-459f-8146-9084cca8c998 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:05:53.153463 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a264c6f-1ddf-4b2a-95cc-06bb6d22b8c4 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:53.156520 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-12fa042c-865f-459f-8146-9084cca8c998 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 07 06:05:53.162706 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 101/200] 10.222.0.24 () {56 vars in 1099 bytes} [Thu Apr 7 06:05:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:05:53.162706 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa042c-865f-459f-8146-9084cca8c998 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:53.190747 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b979972-edb0-4c82-b7c7-4b0c045b6eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:53.191415 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b979972-edb0-4c82-b7c7-4b0c045b6eef None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:53.191701 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b979972-edb0-4c82-b7c7-4b0c045b6eef None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:53.192017 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b979972-edb0-4c82-b7c7-4b0c045b6eef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:53.193526 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b979972-edb0-4c82-b7c7-4b0c045b6eef None admin] RBAC: Adding query filter params (role.id=0fab680bc76f4a73826e9beb59e8129b, scope.project.id=fc392bd6c8534b789823b148310d9370, user.id=978a1bc6f420436bb0026afaefb9b984) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:05:53.193526 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b979972-edb0-4c82-b7c7-4b0c045b6eef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:53.194642 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b979972-edb0-4c82-b7c7-4b0c045b6eef None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:53.200843 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 100/201] 10.222.0.24 () {56 vars in 1374 bytes} [Thu Apr 7 06:05:53 2022] GET /identity/v3/role_assignments?user.id=978a1bc6f420436bb0026afaefb9b984&scope.project.id=fc392bd6c8534b789823b148310d9370&role.id=0fab680bc76f4a73826e9beb59e8129b => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:53.201640 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b979972-edb0-4c82-b7c7-4b0c045b6eef None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:53.270752 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa042c-865f-459f-8146-9084cca8c998 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:53.309850 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a5e91-2b65-42fb-a570-757210ea397b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:53.310745 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a5e91-2b65-42fb-a570-757210ea397b None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:53.311034 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a5e91-2b65-42fb-a570-757210ea397b None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:53.311311 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a5e91-2b65-42fb-a570-757210ea397b None admin] PATH_INFO: `/v3/projects/fc392bd6c8534b789823b148310d9370` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:53.312695 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0a5e91-2b65-42fb-a570-757210ea397b None admin] RBAC: Authorizing `identity:get_project(project_id=fc392bd6c8534b789823b148310d9370)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:53.314241 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0a5e91-2b65-42fb-a570-757210ea397b None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:53.316068 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 102/202] 10.222.0.24 () {56 vars in 1186 bytes} [Thu Apr 7 06:05:53 2022] GET /identity/v3/projects/fc392bd6c8534b789823b148310d9370 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:53.321958 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a5e91-2b65-42fb-a570-757210ea397b None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:53.329022 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b979972-edb0-4c82-b7c7-4b0c045b6eef None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:53.373032 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b20b2-193c-46eb-bdc7-3cf502f5da76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:53.374074 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b20b2-193c-46eb-bdc7-3cf502f5da76 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:53.374568 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b20b2-193c-46eb-bdc7-3cf502f5da76 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:53.375033 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b20b2-193c-46eb-bdc7-3cf502f5da76 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:53.375961 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9b20b2-193c-46eb-bdc7-3cf502f5da76 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:05:53.376276 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9b20b2-193c-46eb-bdc7-3cf502f5da76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:53.377707 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9b20b2-193c-46eb-bdc7-3cf502f5da76 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:53.388013 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 101/203] 10.222.0.24 () {56 vars in 1101 bytes} [Thu Apr 7 06:05:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:53.393711 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b20b2-193c-46eb-bdc7-3cf502f5da76 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:53.447244 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a5e91-2b65-42fb-a570-757210ea397b None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:53.484201 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae6c0d-49ee-49b6-b093-f17026078137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:53.485184 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae6c0d-49ee-49b6-b093-f17026078137 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:53.485667 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae6c0d-49ee-49b6-b093-f17026078137 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:53.486149 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae6c0d-49ee-49b6-b093-f17026078137 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:53.487236 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ae6c0d-49ee-49b6-b093-f17026078137 None admin] RBAC: Adding query filter params (role.id=7ad9776ea3b0430cb02c4599d037c8be, scope.project.id=fc392bd6c8534b789823b148310d9370, user.id=978a1bc6f420436bb0026afaefb9b984) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:05:53.487718 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ae6c0d-49ee-49b6-b093-f17026078137 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:53.489403 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ae6c0d-49ee-49b6-b093-f17026078137 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:53.495849 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 103/204] 10.222.0.24 () {56 vars in 1374 bytes} [Thu Apr 7 06:05:53 2022] GET /identity/v3/role_assignments?user.id=978a1bc6f420436bb0026afaefb9b984&scope.project.id=fc392bd6c8534b789823b148310d9370&role.id=7ad9776ea3b0430cb02c4599d037c8be => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:05:53.516845 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b20b2-193c-46eb-bdc7-3cf502f5da76 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:53.553273 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156be82e-9d06-4df6-9dcb-52c81f6710e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:53.554183 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156be82e-9d06-4df6-9dcb-52c81f6710e6 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:53.554480 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156be82e-9d06-4df6-9dcb-52c81f6710e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:53.554758 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156be82e-9d06-4df6-9dcb-52c81f6710e6 None admin] PATH_INFO: `/v3/users/713f43722c5a47098fd7e8fdb79aaf1e` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:53.556091 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156be82e-9d06-4df6-9dcb-52c81f6710e6 None admin] RBAC: Authorizing `identity:get_user(user_id=713f43722c5a47098fd7e8fdb79aaf1e)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:53.558117 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156be82e-9d06-4df6-9dcb-52c81f6710e6 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:53.559893 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 102/205] 10.222.0.24 () {56 vars in 1177 bytes} [Thu Apr 7 06:05:53 2022] GET /identity/v3/users/713f43722c5a47098fd7e8fdb79aaf1e => generated 289 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:05:53.565424 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae6c0d-49ee-49b6-b093-f17026078137 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:53.672621 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae6c0d-49ee-49b6-b093-f17026078137 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:53.708552 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6eb3f0-bdf1-4fbb-a1bf-49c14be8ec62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:53.709149 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6eb3f0-bdf1-4fbb-a1bf-49c14be8ec62 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:53.709434 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6eb3f0-bdf1-4fbb-a1bf-49c14be8ec62 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:53.709710 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6eb3f0-bdf1-4fbb-a1bf-49c14be8ec62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:53.783938 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6eb3f0-bdf1-4fbb-a1bf-49c14be8ec62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:53.785418 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6eb3f0-bdf1-4fbb-a1bf-49c14be8ec62 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:53.881450 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 104/206] 10.222.0.24 () {58 vars in 1282 bytes} [Thu Apr 7 06:05:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 07 06:05:53.887459 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156be82e-9d06-4df6-9dcb-52c81f6710e6 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:53.987588 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156be82e-9d06-4df6-9dcb-52c81f6710e6 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:54.021363 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46b33a9-ec59-4153-90d4-c9fed0f9c578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:54.022265 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b33a9-ec59-4153-90d4-c9fed0f9c578 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:54.022609 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b33a9-ec59-4153-90d4-c9fed0f9c578 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:54.022890 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b33a9-ec59-4153-90d4-c9fed0f9c578 None admin] PATH_INFO: `/v3/projects/f2feaca3faed4ec0a547bb377a6f494e` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:54.024167 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46b33a9-ec59-4153-90d4-c9fed0f9c578 None admin] RBAC: Authorizing `identity:get_project(project_id=f2feaca3faed4ec0a547bb377a6f494e)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:54.025787 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46b33a9-ec59-4153-90d4-c9fed0f9c578 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:54.027546 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 103/207] 10.222.0.24 () {56 vars in 1186 bytes} [Thu Apr 7 06:05:53 2022] GET /identity/v3/projects/f2feaca3faed4ec0a547bb377a6f494e => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:54.033374 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6eb3f0-bdf1-4fbb-a1bf-49c14be8ec62 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:54.151956 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6eb3f0-bdf1-4fbb-a1bf-49c14be8ec62 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:54.187397 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e6fff4-ea16-4449-85ca-c424b64c2ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:54.188098 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6fff4-ea16-4449-85ca-c424b64c2ea8 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:54.188378 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6fff4-ea16-4449-85ca-c424b64c2ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:54.188648 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6fff4-ea16-4449-85ca-c424b64c2ea8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:54.189481 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e6fff4-ea16-4449-85ca-c424b64c2ea8 None admin] RBAC: Adding query filter params (role.id=a1818b2066464c9caae41106650b2c17, scope.project.id=f2feaca3faed4ec0a547bb377a6f494e, user.id=713f43722c5a47098fd7e8fdb79aaf1e) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:05:54.189791 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e6fff4-ea16-4449-85ca-c424b64c2ea8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:54.191208 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e6fff4-ea16-4449-85ca-c424b64c2ea8 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:54.197980 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 105/208] 10.222.0.24 () {56 vars in 1374 bytes} [Thu Apr 7 06:05:54 2022] GET /identity/v3/role_assignments?user.id=713f43722c5a47098fd7e8fdb79aaf1e&scope.project.id=f2feaca3faed4ec0a547bb377a6f494e&role.id=a1818b2066464c9caae41106650b2c17 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:55.704480 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ecd78-edf6-4466-897f-4a39d2bee85c None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:55.705473 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ecd78-edf6-4466-897f-4a39d2bee85c None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:55.705987 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ecd78-edf6-4466-897f-4a39d2bee85c None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:55.707994 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 104/209] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:05:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:05:55.714239 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca90015-4c7f-476a-8082-c90569e04dc4 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:55.715195 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca90015-4c7f-476a-8082-c90569e04dc4 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:55.715672 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca90015-4c7f-476a-8082-c90569e04dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:55.734704 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-bca90015-4c7f-476a-8082-c90569e04dc4 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:05:55.739800 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-bca90015-4c7f-476a-8082-c90569e04dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:05:55.804817 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 106/210] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:05:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:05:55.829359 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07ecd78-edf6-4466-897f-4a39d2bee85c None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:55.874781 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334199f-917f-4241-80e4-6e8440466064 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:55.875069 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334199f-917f-4241-80e4-6e8440466064 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:55.875344 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334199f-917f-4241-80e4-6e8440466064 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:55.876752 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 107/211] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:05:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 07 06:05:55.881561 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deaf318-817f-4876-89d2-f13857bde02c None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:55.881847 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deaf318-817f-4876-89d2-f13857bde02c None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:55.882125 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deaf318-817f-4876-89d2-f13857bde02c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:55.898475 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-5deaf318-817f-4876-89d2-f13857bde02c None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:05:55.899642 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-5deaf318-817f-4876-89d2-f13857bde02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:05:55.939269 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07ecd78-edf6-4466-897f-4a39d2bee85c None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:55.965857 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 108/212] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:05:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 07 06:05:55.967958 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460e80b-b0c9-4e4c-b6b0-db594d550220 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:55.968254 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460e80b-b0c9-4e4c-b6b0-db594d550220 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:55.968541 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460e80b-b0c9-4e4c-b6b0-db594d550220 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:55.969961 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 109/213] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:05:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:05:55.975140 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cebf22d-becf-4ec9-976c-6377640693ea None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:55.975434 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cebf22d-becf-4ec9-976c-6377640693ea None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:55.975715 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cebf22d-becf-4ec9-976c-6377640693ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:55.981900 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e01ceb8-b65d-401a-87d1-ee9f127c6a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:55.983699 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01ceb8-b65d-401a-87d1-ee9f127c6a9d None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:55.984220 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01ceb8-b65d-401a-87d1-ee9f127c6a9d None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:55.984671 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01ceb8-b65d-401a-87d1-ee9f127c6a9d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:55.993565 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-8cebf22d-becf-4ec9-976c-6377640693ea None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:05:55.994812 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-8cebf22d-becf-4ec9-976c-6377640693ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:05:55.996791 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e01ceb8-b65d-401a-87d1-ee9f127c6a9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:05:56.004545 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-1e01ceb8-b65d-401a-87d1-ee9f127c6a9d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 07 06:05:56.005909 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 105/214] 10.222.0.24 () {56 vars in 1099 bytes} [Thu Apr 7 06:05:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:05:56.011043 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e01ceb8-b65d-401a-87d1-ee9f127c6a9d None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:56.062424 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 110/215] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:05:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:05:56.063582 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cebf22d-becf-4ec9-976c-6377640693ea None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:56.118938 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e01ceb8-b65d-401a-87d1-ee9f127c6a9d None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:56.150291 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adbddc5-1e6a-4608-9266-c7306876be44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:56.151705 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbddc5-1e6a-4608-9266-c7306876be44 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:56.152028 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbddc5-1e6a-4608-9266-c7306876be44 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:56.152296 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbddc5-1e6a-4608-9266-c7306876be44 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:56.153482 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adbddc5-1e6a-4608-9266-c7306876be44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:56.154937 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adbddc5-1e6a-4608-9266-c7306876be44 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:56.156715 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 106/216] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:05:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:56.157313 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adbddc5-1e6a-4608-9266-c7306876be44 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:56.163770 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cebf22d-becf-4ec9-976c-6377640693ea None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:56.195485 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d5207-1ef2-4f10-92fe-c7da8b5458ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:56.196186 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d5207-1ef2-4f10-92fe-c7da8b5458ee None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:56.196476 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d5207-1ef2-4f10-92fe-c7da8b5458ee None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:56.196758 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d5207-1ef2-4f10-92fe-c7da8b5458ee None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:56.197999 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51d5207-1ef2-4f10-92fe-c7da8b5458ee None admin] RBAC: Adding query filter params (name=member) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:05:56.198308 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51d5207-1ef2-4f10-92fe-c7da8b5458ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:56.199689 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51d5207-1ef2-4f10-92fe-c7da8b5458ee None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:56.207430 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 111/217] 10.222.0.24 () {56 vars in 1101 bytes} [Thu Apr 7 06:05:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:56.208692 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc07483-5997-4fad-b953-d00c4c553800 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:56.208985 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc07483-5997-4fad-b953-d00c4c553800 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:56.209280 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc07483-5997-4fad-b953-d00c4c553800 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:56.210646 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 112/218] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:05:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:05:56.215209 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc07483-5997-4fad-b953-d00c4c553800 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:56.250744 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adbddc5-1e6a-4608-9266-c7306876be44 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:56.281893 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6eefc9-d658-47a3-af71-ca367e6e25a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:56.282678 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6eefc9-d658-47a3-af71-ca367e6e25a5 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:56.282960 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6eefc9-d658-47a3-af71-ca367e6e25a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:56.283232 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6eefc9-d658-47a3-af71-ca367e6e25a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:56.293408 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6eefc9-d658-47a3-af71-ca367e6e25a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:05:56.300267 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-bb6eefc9-d658-47a3-af71-ca367e6e25a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 07 06:05:56.301448 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 107/219] 10.222.0.24 () {56 vars in 1096 bytes} [Thu Apr 7 06:05:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:05:56.302205 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6eefc9-d658-47a3-af71-ca367e6e25a5 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:56.309732 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc07483-5997-4fad-b953-d00c4c553800 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:56.340905 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52fc679-7210-49b9-9a57-d0625f49a069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:56.341564 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52fc679-7210-49b9-9a57-d0625f49a069 None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:56.341855 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52fc679-7210-49b9-9a57-d0625f49a069 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:56.342133 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52fc679-7210-49b9-9a57-d0625f49a069 None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:56.342828 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52fc679-7210-49b9-9a57-d0625f49a069 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:56.344276 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52fc679-7210-49b9-9a57-d0625f49a069 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:56.395543 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6eefc9-d658-47a3-af71-ca367e6e25a5 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:56.427535 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ed72e-81f1-4bda-8fc0-0d34f273d784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:56.428418 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ed72e-81f1-4bda-8fc0-0d34f273d784 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:56.428698 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ed72e-81f1-4bda-8fc0-0d34f273d784 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:56.428975 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ed72e-81f1-4bda-8fc0-0d34f273d784 None admin] PATH_INFO: `/v3/users/068063830ff84695bea85e9e77356a8a` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:56.432670 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 113/220] 10.222.0.24 () {60 vars in 1132 bytes} [Thu Apr 7 06:05:56 2022] POST /identity/v3/users => generated 297 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:05:56.433933 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51522ce7-e8f3-41e2-93c0-e018407cc9a2 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:56.434222 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51522ce7-e8f3-41e2-93c0-e018407cc9a2 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:56.434830 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51522ce7-e8f3-41e2-93c0-e018407cc9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:56.443548 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149ed72e-81f1-4bda-8fc0-0d34f273d784 None admin] RBAC: Authorizing `identity:get_user(user_id=068063830ff84695bea85e9e77356a8a)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:56.445050 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149ed72e-81f1-4bda-8fc0-0d34f273d784 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:56.447005 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 108/221] 10.222.0.24 () {56 vars in 1177 bytes} [Thu Apr 7 06:05:56 2022] GET /identity/v3/users/068063830ff84695bea85e9e77356a8a => generated 297 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:56.447704 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ed72e-81f1-4bda-8fc0-0d34f273d784 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:56.463974 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-51522ce7-e8f3-41e2-93c0-e018407cc9a2 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:05:56.465566 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-51522ce7-e8f3-41e2-93c0-e018407cc9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:05:56.550637 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 114/222] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:05:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:05:56.550637 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51522ce7-e8f3-41e2-93c0-e018407cc9a2 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:56.553951 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ed72e-81f1-4bda-8fc0-0d34f273d784 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:56.592347 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79129fd5-f279-4c91-bb59-dd608142dafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:56.593045 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79129fd5-f279-4c91-bb59-dd608142dafc None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:56.593330 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79129fd5-f279-4c91-bb59-dd608142dafc None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:56.593605 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79129fd5-f279-4c91-bb59-dd608142dafc None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:56.594383 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79129fd5-f279-4c91-bb59-dd608142dafc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:05:56.594693 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79129fd5-f279-4c91-bb59-dd608142dafc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:56.596126 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79129fd5-f279-4c91-bb59-dd608142dafc None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:56.605064 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 109/223] 10.222.0.24 () {56 vars in 1099 bytes} [Thu Apr 7 06:05:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:56.605923 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79129fd5-f279-4c91-bb59-dd608142dafc None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:56.657691 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51522ce7-e8f3-41e2-93c0-e018407cc9a2 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:56.692011 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62491f23-bdfe-4ffa-a569-e89aa113cac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:56.692820 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62491f23-bdfe-4ffa-a569-e89aa113cac3 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:56.692987 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62491f23-bdfe-4ffa-a569-e89aa113cac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:56.693233 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62491f23-bdfe-4ffa-a569-e89aa113cac3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:56.707231 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79129fd5-f279-4c91-bb59-dd608142dafc None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:56.743902 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f383861-052a-4d95-9a9e-e646feceefa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:56.745542 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f383861-052a-4d95-9a9e-e646feceefa8 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:56.745990 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f383861-052a-4d95-9a9e-e646feceefa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:56.746418 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f383861-052a-4d95-9a9e-e646feceefa8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:56.757782 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f383861-052a-4d95-9a9e-e646feceefa8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:05:56.765943 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-3f383861-052a-4d95-9a9e-e646feceefa8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 07 06:05:56.767664 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 110/224] 10.222.0.24 () {56 vars in 1114 bytes} [Thu Apr 7 06:05:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:05:56.768627 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f383861-052a-4d95-9a9e-e646feceefa8 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:56.769860 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62491f23-bdfe-4ffa-a569-e89aa113cac3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:56.771562 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62491f23-bdfe-4ffa-a569-e89aa113cac3 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:56.871862 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f383861-052a-4d95-9a9e-e646feceefa8 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:56.873010 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 115/225] 10.222.0.24 () {58 vars in 1282 bytes} [Thu Apr 7 06:05:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 07 06:05:56.873937 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62491f23-bdfe-4ffa-a569-e89aa113cac3 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:56.905720 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce14b467-7226-4ec9-b6fb-eb9425b52f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:56.906603 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14b467-7226-4ec9-b6fb-eb9425b52f93 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:56.906889 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14b467-7226-4ec9-b6fb-eb9425b52f93 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:56.907168 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14b467-7226-4ec9-b6fb-eb9425b52f93 None admin] PATH_INFO: `/v3/users/978a1bc6f420436bb0026afaefb9b984` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:56.908391 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce14b467-7226-4ec9-b6fb-eb9425b52f93 None admin] RBAC: Authorizing `identity:get_user(user_id=978a1bc6f420436bb0026afaefb9b984)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:56.909842 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce14b467-7226-4ec9-b6fb-eb9425b52f93 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:56.911486 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 111/226] 10.222.0.24 () {56 vars in 1177 bytes} [Thu Apr 7 06:05:56 2022] GET /identity/v3/users/978a1bc6f420436bb0026afaefb9b984 => generated 283 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:56.912285 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce14b467-7226-4ec9-b6fb-eb9425b52f93 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:56.978140 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62491f23-bdfe-4ffa-a569-e89aa113cac3 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:57.012062 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b25b93a-827e-46e8-98f1-dcf84e56fc9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:57.012516 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce14b467-7226-4ec9-b6fb-eb9425b52f93 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:57.012737 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b25b93a-827e-46e8-98f1-dcf84e56fc9f None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:57.013021 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b25b93a-827e-46e8-98f1-dcf84e56fc9f None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:57.013296 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b25b93a-827e-46e8-98f1-dcf84e56fc9f None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:57.014046 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b25b93a-827e-46e8-98f1-dcf84e56fc9f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:05:57.014352 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b25b93a-827e-46e8-98f1-dcf84e56fc9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:57.015729 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b25b93a-827e-46e8-98f1-dcf84e56fc9f None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:57.023820 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 116/227] 10.222.0.24 () {56 vars in 1111 bytes} [Thu Apr 7 06:05:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:57.024699 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b25b93a-827e-46e8-98f1-dcf84e56fc9f None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:57.046417 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecceaedd-6f9f-432b-af52-fcf16a03e223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:57.047286 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecceaedd-6f9f-432b-af52-fcf16a03e223 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:57.047574 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecceaedd-6f9f-432b-af52-fcf16a03e223 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:57.047959 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecceaedd-6f9f-432b-af52-fcf16a03e223 None admin] PATH_INFO: `/v3/projects/fc392bd6c8534b789823b148310d9370` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:57.049066 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecceaedd-6f9f-432b-af52-fcf16a03e223 None admin] RBAC: Authorizing `identity:get_project(project_id=fc392bd6c8534b789823b148310d9370)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:57.050515 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecceaedd-6f9f-432b-af52-fcf16a03e223 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:57.052455 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 112/228] 10.222.0.24 () {56 vars in 1186 bytes} [Thu Apr 7 06:05:56 2022] GET /identity/v3/projects/fc392bd6c8534b789823b148310d9370 => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:57.053071 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecceaedd-6f9f-432b-af52-fcf16a03e223 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:57.126478 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b25b93a-827e-46e8-98f1-dcf84e56fc9f None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:57.151700 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecceaedd-6f9f-432b-af52-fcf16a03e223 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:57.159858 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b822b41c-89c7-42fe-a19f-af81f4a8f28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:57.160725 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822b41c-89c7-42fe-a19f-af81f4a8f28e None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:57.161005 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822b41c-89c7-42fe-a19f-af81f4a8f28e None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:57.161278 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822b41c-89c7-42fe-a19f-af81f4a8f28e None admin] PATH_INFO: `/v3/projects/fc392bd6c8534b789823b148310d9370` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:57.162453 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b822b41c-89c7-42fe-a19f-af81f4a8f28e None admin] RBAC: Authorizing `identity:get_project(project_id=fc392bd6c8534b789823b148310d9370)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:57.163912 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b822b41c-89c7-42fe-a19f-af81f4a8f28e None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:57.165599 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 117/229] 10.222.0.24 () {56 vars in 1186 bytes} [Thu Apr 7 06:05:57 2022] GET /identity/v3/projects/fc392bd6c8534b789823b148310d9370 => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:57.171106 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b822b41c-89c7-42fe-a19f-af81f4a8f28e None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:57.186069 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835932ca-70e2-44a1-8f6d-6357b8cc0552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:57.186951 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835932ca-70e2-44a1-8f6d-6357b8cc0552 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:57.187244 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835932ca-70e2-44a1-8f6d-6357b8cc0552 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:57.187522 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835932ca-70e2-44a1-8f6d-6357b8cc0552 None admin] PATH_INFO: `/v3/users/978a1bc6f420436bb0026afaefb9b984` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:57.188749 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835932ca-70e2-44a1-8f6d-6357b8cc0552 None admin] RBAC: Authorizing `identity:get_user(user_id=978a1bc6f420436bb0026afaefb9b984)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:57.190196 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835932ca-70e2-44a1-8f6d-6357b8cc0552 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:57.191855 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 113/230] 10.222.0.24 () {56 vars in 1177 bytes} [Thu Apr 7 06:05:57 2022] GET /identity/v3/users/978a1bc6f420436bb0026afaefb9b984 => generated 283 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:57.192590 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835932ca-70e2-44a1-8f6d-6357b8cc0552 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:57.269970 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b822b41c-89c7-42fe-a19f-af81f4a8f28e None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:57.292470 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835932ca-70e2-44a1-8f6d-6357b8cc0552 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:57.304123 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a34959-e4cd-4345-a148-dfedec7321a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:57.304785 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a34959-e4cd-4345-a148-dfedec7321a7 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:57.305067 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a34959-e4cd-4345-a148-dfedec7321a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:57.305343 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a34959-e4cd-4345-a148-dfedec7321a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:57.306183 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a34959-e4cd-4345-a148-dfedec7321a7 None admin] RBAC: Adding query filter params (role.id=7abd6a5977df4ff4a5476c2d95a1934b, scope.project.id=fc392bd6c8534b789823b148310d9370, user.id=068063830ff84695bea85e9e77356a8a) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:05:57.306494 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a34959-e4cd-4345-a148-dfedec7321a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:57.308478 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a34959-e4cd-4345-a148-dfedec7321a7 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:57.314319 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 118/231] 10.222.0.24 () {56 vars in 1374 bytes} [Thu Apr 7 06:05:57 2022] GET /identity/v3/role_assignments?user.id=068063830ff84695bea85e9e77356a8a&scope.project.id=fc392bd6c8534b789823b148310d9370&role.id=7abd6a5977df4ff4a5476c2d95a1934b => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:57.315235 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a34959-e4cd-4345-a148-dfedec7321a7 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:57.327604 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f13ebd8-6484-4dc0-9c1a-960c19ecbca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:57.328551 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13ebd8-6484-4dc0-9c1a-960c19ecbca6 None admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:57.328837 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13ebd8-6484-4dc0-9c1a-960c19ecbca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:57.329117 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13ebd8-6484-4dc0-9c1a-960c19ecbca6 None admin] PATH_INFO: `/v3/projects/fc392bd6c8534b789823b148310d9370/users/978a1bc6f420436bb0026afaefb9b984/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:57.331100 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f13ebd8-6484-4dc0-9c1a-960c19ecbca6 None admin] RBAC: Authorizing `identity:create_grant(project_id=fc392bd6c8534b789823b148310d9370, user_id=978a1bc6f420436bb0026afaefb9b984, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:57.332580 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f13ebd8-6484-4dc0-9c1a-960c19ecbca6 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:57.428824 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 114/232] 10.222.0.24 () {58 vars in 1439 bytes} [Thu Apr 7 06:05:57 2022] PUT /identity/v3/projects/fc392bd6c8534b789823b148310d9370/users/978a1bc6f420436bb0026afaefb9b984/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:05:57.441460 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a34959-e4cd-4345-a148-dfedec7321a7 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:57.502334 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f4e65-aa17-4c20-b229-6f75755583e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:57.503282 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f4e65-aa17-4c20-b229-6f75755583e3 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:57.503616 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f4e65-aa17-4c20-b229-6f75755583e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:57.503919 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f4e65-aa17-4c20-b229-6f75755583e3 None admin] PATH_INFO: `/v3/projects/fc392bd6c8534b789823b148310d9370` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:57.505179 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483f4e65-aa17-4c20-b229-6f75755583e3 None admin] RBAC: Authorizing `identity:get_project(project_id=fc392bd6c8534b789823b148310d9370)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:57.506654 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483f4e65-aa17-4c20-b229-6f75755583e3 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:57.508809 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 119/233] 10.222.0.24 () {56 vars in 1186 bytes} [Thu Apr 7 06:05:57 2022] GET /identity/v3/projects/fc392bd6c8534b789823b148310d9370 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:57.516002 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f13ebd8-6484-4dc0-9c1a-960c19ecbca6 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:57.624138 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f13ebd8-6484-4dc0-9c1a-960c19ecbca6 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:57.664909 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1a01c5-2a04-48b2-bf78-ef9f5d087aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:57.665830 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a01c5-2a04-48b2-bf78-ef9f5d087aef None admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:57.666164 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a01c5-2a04-48b2-bf78-ef9f5d087aef None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:57.666436 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a01c5-2a04-48b2-bf78-ef9f5d087aef None admin] PATH_INFO: `/v3/projects/fc392bd6c8534b789823b148310d9370/users/978a1bc6f420436bb0026afaefb9b984/roles/7ad9776ea3b0430cb02c4599d037c8be` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:57.669618 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1a01c5-2a04-48b2-bf78-ef9f5d087aef None admin] RBAC: Authorizing `identity:create_grant(project_id=fc392bd6c8534b789823b148310d9370, user_id=978a1bc6f420436bb0026afaefb9b984, role_id=7ad9776ea3b0430cb02c4599d037c8be)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:57.671112 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1a01c5-2a04-48b2-bf78-ef9f5d087aef None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:57.759164 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 115/234] 10.222.0.24 () {58 vars in 1439 bytes} [Thu Apr 7 06:05:57 2022] PUT /identity/v3/projects/fc392bd6c8534b789823b148310d9370/users/978a1bc6f420436bb0026afaefb9b984/roles/7ad9776ea3b0430cb02c4599d037c8be => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:05:59.206760 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e503d3-77ff-45a5-9b5e-2028de711278 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:59.207273 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e503d3-77ff-45a5-9b5e-2028de711278 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:59.207348 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e503d3-77ff-45a5-9b5e-2028de711278 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:59.208955 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 120/235] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:05:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:05:59.214545 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b9ce6-9e83-4531-a911-25b5c25bec8d None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:59.214995 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b9ce6-9e83-4531-a911-25b5c25bec8d None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:59.215171 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b9ce6-9e83-4531-a911-25b5c25bec8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:59.235035 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-da9b9ce6-9e83-4531-a911-25b5c25bec8d None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:05:59.236351 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-da9b9ce6-9e83-4531-a911-25b5c25bec8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:05:59.318150 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 116/236] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:05:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:05:59.363564 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e503d3-77ff-45a5-9b5e-2028de711278 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:59.393741 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b878716-1099-4f1b-a568-0300acd5e5b7 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:59.394356 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b878716-1099-4f1b-a568-0300acd5e5b7 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:59.394829 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b878716-1099-4f1b-a568-0300acd5e5b7 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:59.396725 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 117/237] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:05:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:05:59.401990 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996bf65f-cb7b-42d5-b992-ea1ee2a51f14 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:59.402534 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996bf65f-cb7b-42d5-b992-ea1ee2a51f14 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:59.403013 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996bf65f-cb7b-42d5-b992-ea1ee2a51f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:59.432225 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-996bf65f-cb7b-42d5-b992-ea1ee2a51f14 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:05:59.435448 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-996bf65f-cb7b-42d5-b992-ea1ee2a51f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:05:59.529634 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e503d3-77ff-45a5-9b5e-2028de711278 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:59.550018 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 118/238] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:05:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 07 06:05:59.589023 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996bf65f-cb7b-42d5-b992-ea1ee2a51f14 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:59.589677 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c36d406-3ce0-440c-8e2d-efa66049d21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:59.590729 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c36d406-3ce0-440c-8e2d-efa66049d21d None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:59.591213 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c36d406-3ce0-440c-8e2d-efa66049d21d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:59.591704 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c36d406-3ce0-440c-8e2d-efa66049d21d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:59.602339 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c36d406-3ce0-440c-8e2d-efa66049d21d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:05:59.609641 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-7c36d406-3ce0-440c-8e2d-efa66049d21d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 07 06:05:59.611120 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 121/239] 10.222.0.24 () {56 vars in 1099 bytes} [Thu Apr 7 06:05:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:05:59.624178 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c36d406-3ce0-440c-8e2d-efa66049d21d None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:59.785100 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996bf65f-cb7b-42d5-b992-ea1ee2a51f14 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:59.814499 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c36d406-3ce0-440c-8e2d-efa66049d21d None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:05:59.851844 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd714fb-60fa-48da-95b1-9b28eafe2309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:59.852947 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd714fb-60fa-48da-95b1-9b28eafe2309 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:59.853491 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd714fb-60fa-48da-95b1-9b28eafe2309 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:59.853943 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd714fb-60fa-48da-95b1-9b28eafe2309 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:59.856391 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd714fb-60fa-48da-95b1-9b28eafe2309 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:59.858036 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd714fb-60fa-48da-95b1-9b28eafe2309 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:59.860568 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 119/240] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:05:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:59.871345 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f214d-7553-4f77-89f6-5c2e1a5b26c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:05:59.872888 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd714fb-60fa-48da-95b1-9b28eafe2309 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:05:59.876070 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f214d-7553-4f77-89f6-5c2e1a5b26c5 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:05:59.877296 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f214d-7553-4f77-89f6-5c2e1a5b26c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:05:59.877760 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f214d-7553-4f77-89f6-5c2e1a5b26c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:05:59.882990 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31f214d-7553-4f77-89f6-5c2e1a5b26c5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:05:59.885807 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31f214d-7553-4f77-89f6-5c2e1a5b26c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:05:59.887397 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31f214d-7553-4f77-89f6-5c2e1a5b26c5 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:05:59.900590 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 122/241] 10.222.0.24 () {56 vars in 1101 bytes} [Thu Apr 7 06:05:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:05:59.908302 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f214d-7553-4f77-89f6-5c2e1a5b26c5 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:00.027361 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd714fb-60fa-48da-95b1-9b28eafe2309 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:00.087194 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f214d-7553-4f77-89f6-5c2e1a5b26c5 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:00.091435 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf77c11-4363-484a-8a31-061aab57ea9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:00.092384 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf77c11-4363-484a-8a31-061aab57ea9a None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:00.092859 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf77c11-4363-484a-8a31-061aab57ea9a None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:00.093299 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf77c11-4363-484a-8a31-061aab57ea9a None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:00.094203 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf77c11-4363-484a-8a31-061aab57ea9a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:00.097050 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf77c11-4363-484a-8a31-061aab57ea9a None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:00.126731 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed03231-154d-4654-baa3-a7be435d2056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:00.127651 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed03231-154d-4654-baa3-a7be435d2056 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:00.128220 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed03231-154d-4654-baa3-a7be435d2056 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:00.128499 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed03231-154d-4654-baa3-a7be435d2056 None admin] PATH_INFO: `/v3/users/3c89b57f850c4ef19aec98027c84b0ea` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:00.143866 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed03231-154d-4654-baa3-a7be435d2056 None admin] RBAC: Authorizing `identity:get_user(user_id=3c89b57f850c4ef19aec98027c84b0ea)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:00.145338 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed03231-154d-4654-baa3-a7be435d2056 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:00.151433 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 123/242] 10.222.0.24 () {56 vars in 1177 bytes} [Thu Apr 7 06:05:59 2022] GET /identity/v3/users/3c89b57f850c4ef19aec98027c84b0ea => generated 297 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:00.151433 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ade464-9744-462c-a53b-e347e8234cd6 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:00.151433 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ade464-9744-462c-a53b-e347e8234cd6 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:00.151433 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ade464-9744-462c-a53b-e347e8234cd6 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:00.151433 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 124/243] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:06:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:06:00.156535 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd513fe-46c5-4503-b425-41e41ec7d9f9 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:00.156832 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd513fe-46c5-4503-b425-41e41ec7d9f9 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:00.157116 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd513fe-46c5-4503-b425-41e41ec7d9f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:00.173213 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-bfd513fe-46c5-4503-b425-41e41ec7d9f9 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:06:00.174400 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-bfd513fe-46c5-4503-b425-41e41ec7d9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:06:00.207680 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 120/244] 10.222.0.24 () {60 vars in 1132 bytes} [Thu Apr 7 06:05:59 2022] POST /identity/v3/users => generated 293 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:06:00.208991 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf77c11-4363-484a-8a31-061aab57ea9a None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:00.247118 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 125/245] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:06:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:06:00.273569 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd513fe-46c5-4503-b425-41e41ec7d9f9 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:00.328345 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf77c11-4363-484a-8a31-061aab57ea9a None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:00.368119 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44819bed-205a-4683-b7b0-a2238fd3d271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:00.369710 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44819bed-205a-4683-b7b0-a2238fd3d271 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:00.370229 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44819bed-205a-4683-b7b0-a2238fd3d271 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:00.370710 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44819bed-205a-4683-b7b0-a2238fd3d271 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:00.383785 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd513fe-46c5-4503-b425-41e41ec7d9f9 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:00.420068 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17949ff8-5809-4628-b8b0-90534aad63bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:00.420915 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17949ff8-5809-4628-b8b0-90534aad63bf None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:00.421165 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17949ff8-5809-4628-b8b0-90534aad63bf None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:00.421436 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17949ff8-5809-4628-b8b0-90534aad63bf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:00.433252 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17949ff8-5809-4628-b8b0-90534aad63bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:06:00.440328 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-17949ff8-5809-4628-b8b0-90534aad63bf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 07 06:06:00.441766 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 126/246] 10.222.0.24 () {56 vars in 1096 bytes} [Thu Apr 7 06:06:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 07 06:06:00.443036 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c088e0-6746-4431-9655-5fbe4c8eb4fb None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:00.443491 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c088e0-6746-4431-9655-5fbe4c8eb4fb None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:00.443794 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c088e0-6746-4431-9655-5fbe4c8eb4fb None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:00.449383 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 127/247] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:06:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:06:00.450481 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c088e0-6746-4431-9655-5fbe4c8eb4fb None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:00.453712 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44819bed-205a-4683-b7b0-a2238fd3d271 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:00.455560 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44819bed-205a-4683-b7b0-a2238fd3d271 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:00.572595 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 121/248] 10.222.0.24 () {58 vars in 1282 bytes} [Thu Apr 7 06:06:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 07 06:06:00.573960 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5fc37a-677f-4e5e-8ea3-3a597cd6cdc0 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:00.574245 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5fc37a-677f-4e5e-8ea3-3a597cd6cdc0 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:00.574520 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5fc37a-677f-4e5e-8ea3-3a597cd6cdc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:00.575914 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c088e0-6746-4431-9655-5fbe4c8eb4fb None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:00.592972 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-1a5fc37a-677f-4e5e-8ea3-3a597cd6cdc0 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:06:00.594168 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-1a5fc37a-677f-4e5e-8ea3-3a597cd6cdc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:06:00.618214 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aca4bc-48de-469b-abab-c84bf911d2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:00.618836 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aca4bc-48de-469b-abab-c84bf911d2c2 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:00.619213 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aca4bc-48de-469b-abab-c84bf911d2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:00.619495 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aca4bc-48de-469b-abab-c84bf911d2c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:00.620382 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aca4bc-48de-469b-abab-c84bf911d2c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:00.620729 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aca4bc-48de-469b-abab-c84bf911d2c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:00.622868 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aca4bc-48de-469b-abab-c84bf911d2c2 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:00.633784 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 128/249] 10.222.0.24 () {56 vars in 1099 bytes} [Thu Apr 7 06:06:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:00.635431 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aca4bc-48de-469b-abab-c84bf911d2c2 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:00.680504 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 122/250] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:06:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:06:00.681827 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5fc37a-677f-4e5e-8ea3-3a597cd6cdc0 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:00.753894 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aca4bc-48de-469b-abab-c84bf911d2c2 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:00.796399 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62672bb-7e3b-40da-b458-0bcd0f7d85b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:00.797270 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62672bb-7e3b-40da-b458-0bcd0f7d85b5 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:00.797557 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62672bb-7e3b-40da-b458-0bcd0f7d85b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:00.797836 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62672bb-7e3b-40da-b458-0bcd0f7d85b5 None admin] PATH_INFO: `/v3/projects/fc392bd6c8534b789823b148310d9370` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:00.799025 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62672bb-7e3b-40da-b458-0bcd0f7d85b5 None admin] RBAC: Authorizing `identity:get_project(project_id=fc392bd6c8534b789823b148310d9370)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:00.800585 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62672bb-7e3b-40da-b458-0bcd0f7d85b5 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:00.802518 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 129/251] 10.222.0.24 () {56 vars in 1186 bytes} [Thu Apr 7 06:06:00 2022] GET /identity/v3/projects/fc392bd6c8534b789823b148310d9370 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:00.807464 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c1c11b-a3a5-42df-8860-5f8fc331af1f None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:00.807464 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c1c11b-a3a5-42df-8860-5f8fc331af1f None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:00.807464 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c1c11b-a3a5-42df-8860-5f8fc331af1f None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:00.807464 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 130/252] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:06:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:06:00.807464 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c1c11b-a3a5-42df-8860-5f8fc331af1f None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:00.840089 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5fc37a-677f-4e5e-8ea3-3a597cd6cdc0 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:00.881119 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e92a64b-1656-4b6a-82d6-f9fb510a021f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:00.881918 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92a64b-1656-4b6a-82d6-f9fb510a021f None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:00.882361 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92a64b-1656-4b6a-82d6-f9fb510a021f None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:00.882647 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92a64b-1656-4b6a-82d6-f9fb510a021f None admin] PATH_INFO: `/v3/users/978a1bc6f420436bb0026afaefb9b984` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:00.884356 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e92a64b-1656-4b6a-82d6-f9fb510a021f None admin] RBAC: Authorizing `identity:get_user(user_id=978a1bc6f420436bb0026afaefb9b984)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:00.886803 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e92a64b-1656-4b6a-82d6-f9fb510a021f None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:00.890487 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 123/253] 10.222.0.24 () {56 vars in 1177 bytes} [Thu Apr 7 06:06:00 2022] GET /identity/v3/users/978a1bc6f420436bb0026afaefb9b984 => generated 283 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:00.891293 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e92a64b-1656-4b6a-82d6-f9fb510a021f None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:00.922313 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c1c11b-a3a5-42df-8860-5f8fc331af1f None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:00.956781 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaac264-372e-4b3f-9446-3a25747c52e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:00.957705 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaac264-372e-4b3f-9446-3a25747c52e0 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:00.958144 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaac264-372e-4b3f-9446-3a25747c52e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:00.958488 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaac264-372e-4b3f-9446-3a25747c52e0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:00.969162 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaac264-372e-4b3f-9446-3a25747c52e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:06:00.977381 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-acaac264-372e-4b3f-9446-3a25747c52e0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 07 06:06:00.983896 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 131/254] 10.222.0.24 () {56 vars in 1099 bytes} [Thu Apr 7 06:06:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:00.983896 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d9a56-20d1-48f1-b824-f92a5750e6b4 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:00.983896 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d9a56-20d1-48f1-b824-f92a5750e6b4 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:00.983896 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d9a56-20d1-48f1-b824-f92a5750e6b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:01.002982 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-c21d9a56-20d1-48f1-b824-f92a5750e6b4 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:06:01.003127 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e92a64b-1656-4b6a-82d6-f9fb510a021f None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:01.004743 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c21d9a56-20d1-48f1-b824-f92a5750e6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:06:01.042324 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874f1f53-2643-423c-acb1-8b3515ce0a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:01.043026 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f1f53-2643-423c-acb1-8b3515ce0a03 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:01.043291 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f1f53-2643-423c-acb1-8b3515ce0a03 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:01.043565 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f1f53-2643-423c-acb1-8b3515ce0a03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:01.044436 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874f1f53-2643-423c-acb1-8b3515ce0a03 None admin] RBAC: Adding query filter params (role.id=a1818b2066464c9caae41106650b2c17, scope.project.id=fc392bd6c8534b789823b148310d9370, user.id=3c89b57f850c4ef19aec98027c84b0ea) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:01.044747 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874f1f53-2643-423c-acb1-8b3515ce0a03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:01.046354 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874f1f53-2643-423c-acb1-8b3515ce0a03 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:01.054963 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 124/255] 10.222.0.24 () {56 vars in 1374 bytes} [Thu Apr 7 06:06:00 2022] GET /identity/v3/role_assignments?user.id=3c89b57f850c4ef19aec98027c84b0ea&scope.project.id=fc392bd6c8534b789823b148310d9370&role.id=a1818b2066464c9caae41106650b2c17 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:01.060922 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874f1f53-2643-423c-acb1-8b3515ce0a03 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:01.090676 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 132/256] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:06:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:06:01.091564 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21d9a56-20d1-48f1-b824-f92a5750e6b4 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:01.172090 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874f1f53-2643-423c-acb1-8b3515ce0a03 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:01.237428 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21d9a56-20d1-48f1-b824-f92a5750e6b4 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:01.260155 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeae9f1-3332-47d3-a19c-3cb41c5dd8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:01.260842 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeae9f1-3332-47d3-a19c-3cb41c5dd8f8 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:01.261123 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeae9f1-3332-47d3-a19c-3cb41c5dd8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:01.261396 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeae9f1-3332-47d3-a19c-3cb41c5dd8f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:01.286402 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7a72dc-f229-401b-b34c-bee0ae6f0f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:01.287156 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a72dc-f229-401b-b34c-bee0ae6f0f6b None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:01.287444 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a72dc-f229-401b-b34c-bee0ae6f0f6b None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:01.287715 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a72dc-f229-401b-b34c-bee0ae6f0f6b None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:01.288514 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7a72dc-f229-401b-b34c-bee0ae6f0f6b None admin] RBAC: Adding query filter params (name=member) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:01.288824 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7a72dc-f229-401b-b34c-bee0ae6f0f6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:01.290261 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7a72dc-f229-401b-b34c-bee0ae6f0f6b None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:01.311599 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 133/257] 10.222.0.24 () {56 vars in 1101 bytes} [Thu Apr 7 06:06:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:01.312793 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7a72dc-f229-401b-b34c-bee0ae6f0f6b None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:01.332241 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeae9f1-3332-47d3-a19c-3cb41c5dd8f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:01.334034 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeae9f1-3332-47d3-a19c-3cb41c5dd8f8 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:01.435012 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 125/258] 10.222.0.24 () {58 vars in 1282 bytes} [Thu Apr 7 06:06:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 07 06:06:01.435844 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeae9f1-3332-47d3-a19c-3cb41c5dd8f8 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:01.446562 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7a72dc-f229-401b-b34c-bee0ae6f0f6b None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:01.481221 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b4279-82c4-4f87-af37-af9754185090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:01.482045 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b4279-82c4-4f87-af37-af9754185090 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:01.482333 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b4279-82c4-4f87-af37-af9754185090 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:01.482616 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b4279-82c4-4f87-af37-af9754185090 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:01.493244 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857b4279-82c4-4f87-af37-af9754185090 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:06:01.500856 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-857b4279-82c4-4f87-af37-af9754185090 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 07 06:06:01.502381 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 134/259] 10.222.0.24 () {56 vars in 1114 bytes} [Thu Apr 7 06:06:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:01.503177 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b4279-82c4-4f87-af37-af9754185090 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:01.536838 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeae9f1-3332-47d3-a19c-3cb41c5dd8f8 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:01.570953 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30155de-1ac5-41c9-8c6c-5a49a7df4d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:01.571865 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30155de-1ac5-41c9-8c6c-5a49a7df4d71 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:01.572177 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30155de-1ac5-41c9-8c6c-5a49a7df4d71 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:01.572450 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30155de-1ac5-41c9-8c6c-5a49a7df4d71 None admin] PATH_INFO: `/v3/users/068063830ff84695bea85e9e77356a8a` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:01.573646 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30155de-1ac5-41c9-8c6c-5a49a7df4d71 None admin] RBAC: Authorizing `identity:get_user(user_id=068063830ff84695bea85e9e77356a8a)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:01.575116 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30155de-1ac5-41c9-8c6c-5a49a7df4d71 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:01.576965 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 126/260] 10.222.0.24 () {56 vars in 1177 bytes} [Thu Apr 7 06:06:01 2022] GET /identity/v3/users/068063830ff84695bea85e9e77356a8a => generated 297 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:01.577648 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30155de-1ac5-41c9-8c6c-5a49a7df4d71 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:01.607969 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b4279-82c4-4f87-af37-af9754185090 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:01.669487 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f042cd-8863-4d1f-a179-222f1cbcabe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:01.670380 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f042cd-8863-4d1f-a179-222f1cbcabe6 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:01.670667 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f042cd-8863-4d1f-a179-222f1cbcabe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:01.670943 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f042cd-8863-4d1f-a179-222f1cbcabe6 None admin] PATH_INFO: `/v3/projects/fc392bd6c8534b789823b148310d9370` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:01.676524 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f042cd-8863-4d1f-a179-222f1cbcabe6 None admin] RBAC: Authorizing `identity:get_project(project_id=fc392bd6c8534b789823b148310d9370)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:01.677773 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30155de-1ac5-41c9-8c6c-5a49a7df4d71 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:01.678022 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f042cd-8863-4d1f-a179-222f1cbcabe6 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:01.679765 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 135/261] 10.222.0.24 () {56 vars in 1186 bytes} [Thu Apr 7 06:06:01 2022] GET /identity/v3/projects/fc392bd6c8534b789823b148310d9370 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:01.680566 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f042cd-8863-4d1f-a179-222f1cbcabe6 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:01.712996 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a1b7d3-df94-42bd-a4b4-e906d2c84c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:01.713591 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1b7d3-df94-42bd-a4b4-e906d2c84c63 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:01.713874 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1b7d3-df94-42bd-a4b4-e906d2c84c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:01.714141 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1b7d3-df94-42bd-a4b4-e906d2c84c63 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:01.714888 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a1b7d3-df94-42bd-a4b4-e906d2c84c63 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:01.715184 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a1b7d3-df94-42bd-a4b4-e906d2c84c63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:01.716593 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a1b7d3-df94-42bd-a4b4-e906d2c84c63 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:01.724723 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 127/262] 10.222.0.24 () {56 vars in 1111 bytes} [Thu Apr 7 06:06:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:01.725618 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a1b7d3-df94-42bd-a4b4-e906d2c84c63 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:01.826802 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a1b7d3-df94-42bd-a4b4-e906d2c84c63 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:01.827550 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f042cd-8863-4d1f-a179-222f1cbcabe6 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:01.859352 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6c2e8-d3f4-443b-9727-b65de305d15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:01.860300 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6c2e8-d3f4-443b-9727-b65de305d15c None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:01.860724 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6c2e8-d3f4-443b-9727-b65de305d15c None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:01.861081 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1405f5-4b7e-4f16-ac50-563a025bc677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:01.861295 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6c2e8-d3f4-443b-9727-b65de305d15c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:01.862145 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1405f5-4b7e-4f16-ac50-563a025bc677 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:01.862436 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c6c2e8-d3f4-443b-9727-b65de305d15c None admin] RBAC: Adding query filter params (role.id=0fab680bc76f4a73826e9beb59e8129b, scope.project.id=fc392bd6c8534b789823b148310d9370, user.id=978a1bc6f420436bb0026afaefb9b984) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:01.862623 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1405f5-4b7e-4f16-ac50-563a025bc677 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:01.862997 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1405f5-4b7e-4f16-ac50-563a025bc677 None admin] PATH_INFO: `/v3/projects/fc392bd6c8534b789823b148310d9370` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:01.863153 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c6c2e8-d3f4-443b-9727-b65de305d15c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:01.864387 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1405f5-4b7e-4f16-ac50-563a025bc677 None admin] RBAC: Authorizing `identity:get_project(project_id=fc392bd6c8534b789823b148310d9370)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:01.864748 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c6c2e8-d3f4-443b-9727-b65de305d15c None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:01.866518 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1405f5-4b7e-4f16-ac50-563a025bc677 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:01.868793 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 136/263] 10.222.0.24 () {56 vars in 1186 bytes} [Thu Apr 7 06:06:01 2022] GET /identity/v3/projects/fc392bd6c8534b789823b148310d9370 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:01.870299 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1405f5-4b7e-4f16-ac50-563a025bc677 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:01.871517 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 128/264] 10.222.0.24 () {56 vars in 1374 bytes} [Thu Apr 7 06:06:01 2022] GET /identity/v3/role_assignments?user.id=978a1bc6f420436bb0026afaefb9b984&scope.project.id=fc392bd6c8534b789823b148310d9370&role.id=0fab680bc76f4a73826e9beb59e8129b => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:01.877431 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6c2e8-d3f4-443b-9727-b65de305d15c None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:01.976355 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1405f5-4b7e-4f16-ac50-563a025bc677 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:02.013653 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ae82a-cee6-4e72-ae6c-1704cbcac35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:02.014983 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ae82a-cee6-4e72-ae6c-1704cbcac35f None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:02.015497 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ae82a-cee6-4e72-ae6c-1704cbcac35f None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:02.016046 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ae82a-cee6-4e72-ae6c-1704cbcac35f None admin] PATH_INFO: `/v3/users/978a1bc6f420436bb0026afaefb9b984` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:02.017464 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6ae82a-cee6-4e72-ae6c-1704cbcac35f None admin] RBAC: Authorizing `identity:get_user(user_id=978a1bc6f420436bb0026afaefb9b984)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:02.019117 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6ae82a-cee6-4e72-ae6c-1704cbcac35f None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:02.021360 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 137/265] 10.222.0.24 () {56 vars in 1177 bytes} [Thu Apr 7 06:06:01 2022] GET /identity/v3/users/978a1bc6f420436bb0026afaefb9b984 => generated 283 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:02.026388 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ae82a-cee6-4e72-ae6c-1704cbcac35f None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:02.034857 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6c2e8-d3f4-443b-9727-b65de305d15c None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:02.094554 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcaa659-1d24-4144-8598-4794922a659e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:02.095958 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcaa659-1d24-4144-8598-4794922a659e None admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:02.096488 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcaa659-1d24-4144-8598-4794922a659e None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:02.096963 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcaa659-1d24-4144-8598-4794922a659e None admin] PATH_INFO: `/v3/projects/fc392bd6c8534b789823b148310d9370/users/068063830ff84695bea85e9e77356a8a/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:02.099180 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcaa659-1d24-4144-8598-4794922a659e None admin] RBAC: Authorizing `identity:create_grant(project_id=fc392bd6c8534b789823b148310d9370, user_id=068063830ff84695bea85e9e77356a8a, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:02.101295 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcaa659-1d24-4144-8598-4794922a659e None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:02.176212 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ae82a-cee6-4e72-ae6c-1704cbcac35f None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:02.179617 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 129/266] 10.222.0.24 () {58 vars in 1439 bytes} [Thu Apr 7 06:06:01 2022] PUT /identity/v3/projects/fc392bd6c8534b789823b148310d9370/users/068063830ff84695bea85e9e77356a8a/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:06:02.218633 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeb52da-6c16-4c75-a9c1-6da7de674730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:02.219368 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb52da-6c16-4c75-a9c1-6da7de674730 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:02.219666 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb52da-6c16-4c75-a9c1-6da7de674730 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:02.219968 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb52da-6c16-4c75-a9c1-6da7de674730 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:02.297208 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeb52da-6c16-4c75-a9c1-6da7de674730 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:02.298702 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeb52da-6c16-4c75-a9c1-6da7de674730 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:02.405270 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 138/267] 10.222.0.24 () {58 vars in 1282 bytes} [Thu Apr 7 06:06:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 07 06:06:02.410865 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcaa659-1d24-4144-8598-4794922a659e None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:02.520095 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcaa659-1d24-4144-8598-4794922a659e None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:02.554600 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59236981-9606-4278-8dad-21cc2fdf717c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:02.555805 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59236981-9606-4278-8dad-21cc2fdf717c None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:02.556305 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59236981-9606-4278-8dad-21cc2fdf717c None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:02.557305 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59236981-9606-4278-8dad-21cc2fdf717c None admin] PATH_INFO: `/v3/projects/fc392bd6c8534b789823b148310d9370` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:02.558735 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59236981-9606-4278-8dad-21cc2fdf717c None admin] RBAC: Authorizing `identity:get_project(project_id=fc392bd6c8534b789823b148310d9370)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:02.560419 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59236981-9606-4278-8dad-21cc2fdf717c None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:02.562663 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 130/268] 10.222.0.24 () {56 vars in 1186 bytes} [Thu Apr 7 06:06:02 2022] GET /identity/v3/projects/fc392bd6c8534b789823b148310d9370 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:02.568121 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeb52da-6c16-4c75-a9c1-6da7de674730 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:02.673293 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeb52da-6c16-4c75-a9c1-6da7de674730 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:02.715878 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c016bbc-8659-4876-b373-ff46b7bcce81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:02.716955 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c016bbc-8659-4876-b373-ff46b7bcce81 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:02.717579 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c016bbc-8659-4876-b373-ff46b7bcce81 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:02.718111 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c016bbc-8659-4876-b373-ff46b7bcce81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:02.719178 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c016bbc-8659-4876-b373-ff46b7bcce81 None admin] RBAC: Adding query filter params (role.id=7ad9776ea3b0430cb02c4599d037c8be, scope.project.id=fc392bd6c8534b789823b148310d9370, user.id=978a1bc6f420436bb0026afaefb9b984) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:02.719697 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c016bbc-8659-4876-b373-ff46b7bcce81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:02.721546 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c016bbc-8659-4876-b373-ff46b7bcce81 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:02.731105 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 139/269] 10.222.0.24 () {56 vars in 1374 bytes} [Thu Apr 7 06:06:02 2022] GET /identity/v3/role_assignments?user.id=978a1bc6f420436bb0026afaefb9b984&scope.project.id=fc392bd6c8534b789823b148310d9370&role.id=7ad9776ea3b0430cb02c4599d037c8be => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:03.299225 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af59e2-814c-4d14-8d88-4360a047ed57 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:03.299612 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af59e2-814c-4d14-8d88-4360a047ed57 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:03.299836 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af59e2-814c-4d14-8d88-4360a047ed57 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:03.301181 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 131/270] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:06:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:06:03.307231 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c44ff-f87f-43fa-8053-7c8f4ca936ef None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:03.308175 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c44ff-f87f-43fa-8053-7c8f4ca936ef None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:03.308666 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c44ff-f87f-43fa-8053-7c8f4ca936ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:03.325816 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-990c44ff-f87f-43fa-8053-7c8f4ca936ef None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:06:03.327319 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-990c44ff-f87f-43fa-8053-7c8f4ca936ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:06:03.396120 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 140/271] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:06:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:06:03.420265 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec072e28-6fef-4638-af3b-720f9c1831dc None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:03.420756 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec072e28-6fef-4638-af3b-720f9c1831dc None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:03.420831 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec072e28-6fef-4638-af3b-720f9c1831dc None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:03.422322 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 132/272] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:06:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:06:03.423993 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c44ff-f87f-43fa-8053-7c8f4ca936ef None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:03.427980 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da84fd5c-6f6b-43b3-b420-e58fe1aa0466 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:03.427980 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da84fd5c-6f6b-43b3-b420-e58fe1aa0466 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:03.427980 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da84fd5c-6f6b-43b3-b420-e58fe1aa0466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:03.446393 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-da84fd5c-6f6b-43b3-b420-e58fe1aa0466 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:06:03.447295 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-da84fd5c-6f6b-43b3-b420-e58fe1aa0466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:06:03.515074 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 133/273] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:06:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 07 06:06:03.526170 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c44ff-f87f-43fa-8053-7c8f4ca936ef None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:03.539934 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da84fd5c-6f6b-43b3-b420-e58fe1aa0466 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:03.563507 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd74423-8ea5-4f5a-95cd-05f01e3cf4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:03.564730 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd74423-8ea5-4f5a-95cd-05f01e3cf4f1 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:03.565248 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd74423-8ea5-4f5a-95cd-05f01e3cf4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:03.565726 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd74423-8ea5-4f5a-95cd-05f01e3cf4f1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:03.567155 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd74423-8ea5-4f5a-95cd-05f01e3cf4f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:03.568867 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd74423-8ea5-4f5a-95cd-05f01e3cf4f1 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:03.570737 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 141/274] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:06:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:03.576878 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd74423-8ea5-4f5a-95cd-05f01e3cf4f1 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:03.640573 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da84fd5c-6f6b-43b3-b420-e58fe1aa0466 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:03.676297 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e1007-97cf-497e-bec4-fb25be3c6b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:03.677111 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e1007-97cf-497e-bec4-fb25be3c6b24 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:03.677430 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e1007-97cf-497e-bec4-fb25be3c6b24 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:03.677665 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e1007-97cf-497e-bec4-fb25be3c6b24 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:03.679908 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd74423-8ea5-4f5a-95cd-05f01e3cf4f1 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:03.688437 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2e1007-97cf-497e-bec4-fb25be3c6b24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:06:03.695500 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-ee2e1007-97cf-497e-bec4-fb25be3c6b24 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 07 06:06:03.702397 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 134/275] 10.222.0.24 () {56 vars in 1099 bytes} [Thu Apr 7 06:06:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 07 06:06:03.703579 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e1007-97cf-497e-bec4-fb25be3c6b24 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:03.719219 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb18201f-6b16-4905-8ebc-d91665f82fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:03.720373 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18201f-6b16-4905-8ebc-d91665f82fbd None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:03.720873 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18201f-6b16-4905-8ebc-d91665f82fbd None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:03.721354 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18201f-6b16-4905-8ebc-d91665f82fbd None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:03.722315 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb18201f-6b16-4905-8ebc-d91665f82fbd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:03.724134 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb18201f-6b16-4905-8ebc-d91665f82fbd None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:03.812226 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e1007-97cf-497e-bec4-fb25be3c6b24 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:03.843796 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3822747a-ae59-4995-8fa9-2f68ba62621a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:03.844407 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822747a-ae59-4995-8fa9-2f68ba62621a None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:03.844697 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822747a-ae59-4995-8fa9-2f68ba62621a None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:03.844971 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822747a-ae59-4995-8fa9-2f68ba62621a None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:03.845727 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3822747a-ae59-4995-8fa9-2f68ba62621a None admin] RBAC: Adding query filter params (name=member) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:03.846036 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3822747a-ae59-4995-8fa9-2f68ba62621a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:03.847422 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3822747a-ae59-4995-8fa9-2f68ba62621a None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:03.856404 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 135/276] 10.222.0.24 () {56 vars in 1101 bytes} [Thu Apr 7 06:06:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:06:03.861573 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3822747a-ae59-4995-8fa9-2f68ba62621a None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:03.955566 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3822747a-ae59-4995-8fa9-2f68ba62621a None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:03.987853 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c107988-a04c-48e2-9eb2-6e78e3ad90ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:03.988728 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c107988-a04c-48e2-9eb2-6e78e3ad90ca None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:03.989047 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c107988-a04c-48e2-9eb2-6e78e3ad90ca None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:03.989325 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c107988-a04c-48e2-9eb2-6e78e3ad90ca None admin] PATH_INFO: `/v3/users/3988826728984733bbdf462e9ba89ef8` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:04.003813 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c107988-a04c-48e2-9eb2-6e78e3ad90ca None admin] RBAC: Authorizing `identity:get_user(user_id=3988826728984733bbdf462e9ba89ef8)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:04.005298 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c107988-a04c-48e2-9eb2-6e78e3ad90ca None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:04.007330 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 136/277] 10.222.0.24 () {56 vars in 1177 bytes} [Thu Apr 7 06:06:03 2022] GET /identity/v3/users/3988826728984733bbdf462e9ba89ef8 => generated 293 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:06:04.012694 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c107988-a04c-48e2-9eb2-6e78e3ad90ca None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:04.078524 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 142/278] 10.222.0.24 () {60 vars in 1132 bytes} [Thu Apr 7 06:06:03 2022] POST /identity/v3/users => generated 293 bytes in 502 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:06:04.103098 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a275b7-a441-4134-a24c-d8d18b443b75 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:04.103475 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a275b7-a441-4134-a24c-d8d18b443b75 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:04.103667 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a275b7-a441-4134-a24c-d8d18b443b75 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:04.109512 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 143/279] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:06:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 07 06:06:04.117668 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847d57f-20dc-4851-911d-08f113c50a10 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:04.117668 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847d57f-20dc-4851-911d-08f113c50a10 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:04.117668 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847d57f-20dc-4851-911d-08f113c50a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:04.122250 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c107988-a04c-48e2-9eb2-6e78e3ad90ca None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:04.131181 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-f847d57f-20dc-4851-911d-08f113c50a10 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:06:04.132919 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f847d57f-20dc-4851-911d-08f113c50a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:06:04.162860 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d1b65-cc8f-497f-b8a8-8b4f0e9a7365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:04.163975 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d1b65-cc8f-497f-b8a8-8b4f0e9a7365 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:04.164521 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d1b65-cc8f-497f-b8a8-8b4f0e9a7365 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:04.165048 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d1b65-cc8f-497f-b8a8-8b4f0e9a7365 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:04.166004 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d1b65-cc8f-497f-b8a8-8b4f0e9a7365 None admin] RBAC: Adding query filter params (role.id=7abd6a5977df4ff4a5476c2d95a1934b, user.id=3988826728984733bbdf462e9ba89ef8, scope.system=all) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:04.166317 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d1b65-cc8f-497f-b8a8-8b4f0e9a7365 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:04.167924 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d1b65-cc8f-497f-b8a8-8b4f0e9a7365 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:04.179778 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 137/280] 10.222.0.24 () {56 vars in 1308 bytes} [Thu Apr 7 06:06:04 2022] GET /identity/v3/role_assignments?user.id=3988826728984733bbdf462e9ba89ef8&scope.system=all&role.id=7abd6a5977df4ff4a5476c2d95a1934b => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:06:04.209953 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 144/281] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:06:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:06:04.233760 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d1b65-cc8f-497f-b8a8-8b4f0e9a7365 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:04.357057 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d1b65-cc8f-497f-b8a8-8b4f0e9a7365 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:04.393089 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3448a8e9-0db9-488e-90e7-6da22c43c238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:04.393887 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448a8e9-0db9-488e-90e7-6da22c43c238 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:04.394173 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448a8e9-0db9-488e-90e7-6da22c43c238 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:04.394440 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448a8e9-0db9-488e-90e7-6da22c43c238 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:04.405114 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3448a8e9-0db9-488e-90e7-6da22c43c238 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:06:04.412044 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-3448a8e9-0db9-488e-90e7-6da22c43c238 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 07 06:06:04.416223 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 138/282] 10.222.0.24 () {56 vars in 1099 bytes} [Thu Apr 7 06:06:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:04.420039 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847d57f-20dc-4851-911d-08f113c50a10 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:04.535857 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847d57f-20dc-4851-911d-08f113c50a10 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:04.574863 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cd4a1f-9a6f-4f70-b2db-6fa1ce2904d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:04.575523 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd4a1f-9a6f-4f70-b2db-6fa1ce2904d1 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:04.575832 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd4a1f-9a6f-4f70-b2db-6fa1ce2904d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:04.576108 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd4a1f-9a6f-4f70-b2db-6fa1ce2904d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:04.576918 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cd4a1f-9a6f-4f70-b2db-6fa1ce2904d1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:04.577229 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cd4a1f-9a6f-4f70-b2db-6fa1ce2904d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:04.578595 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cd4a1f-9a6f-4f70-b2db-6fa1ce2904d1 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:04.589431 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 145/283] 10.222.0.24 () {56 vars in 1101 bytes} [Thu Apr 7 06:06:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:04.596504 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3448a8e9-0db9-488e-90e7-6da22c43c238 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:04.726960 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3448a8e9-0db9-488e-90e7-6da22c43c238 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:04.765891 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb4bd76-dbed-4d6e-a76a-f31f3a9389a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:04.766785 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4bd76-dbed-4d6e-a76a-f31f3a9389a7 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:04.767066 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4bd76-dbed-4d6e-a76a-f31f3a9389a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:04.767337 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4bd76-dbed-4d6e-a76a-f31f3a9389a7 None admin] PATH_INFO: `/v3/users/3c89b57f850c4ef19aec98027c84b0ea` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:04.772543 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb4bd76-dbed-4d6e-a76a-f31f3a9389a7 None admin] RBAC: Authorizing `identity:get_user(user_id=3c89b57f850c4ef19aec98027c84b0ea)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:04.774021 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb4bd76-dbed-4d6e-a76a-f31f3a9389a7 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:04.777807 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 139/284] 10.222.0.24 () {56 vars in 1177 bytes} [Thu Apr 7 06:06:04 2022] GET /identity/v3/users/3c89b57f850c4ef19aec98027c84b0ea => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:04.782295 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cd4a1f-9a6f-4f70-b2db-6fa1ce2904d1 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:04.920125 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cd4a1f-9a6f-4f70-b2db-6fa1ce2904d1 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:04.968470 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e9cc2-ee69-4c36-bcb1-648006b61a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:04.969357 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e9cc2-ee69-4c36-bcb1-648006b61a6e None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:04.969645 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e9cc2-ee69-4c36-bcb1-648006b61a6e None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:04.969924 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e9cc2-ee69-4c36-bcb1-648006b61a6e None admin] PATH_INFO: `/v3/projects/fc392bd6c8534b789823b148310d9370` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:04.971158 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e9cc2-ee69-4c36-bcb1-648006b61a6e None admin] RBAC: Authorizing `identity:get_project(project_id=fc392bd6c8534b789823b148310d9370)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:04.972646 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e9cc2-ee69-4c36-bcb1-648006b61a6e None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:04.974544 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 146/285] 10.222.0.24 () {56 vars in 1186 bytes} [Thu Apr 7 06:06:04 2022] GET /identity/v3/projects/fc392bd6c8534b789823b148310d9370 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:04.980717 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb4bd76-dbed-4d6e-a76a-f31f3a9389a7 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:05.006409 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b7603-89e9-48fd-b53e-943471f9dfcb None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:05.006712 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b7603-89e9-48fd-b53e-943471f9dfcb None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:05.006980 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b7603-89e9-48fd-b53e-943471f9dfcb None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:05.008539 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 147/286] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:06:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 07 06:06:05.013343 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345fe65-431c-40fb-9174-69ad0a3ddf2b None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:05.013638 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345fe65-431c-40fb-9174-69ad0a3ddf2b None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:05.013924 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345fe65-431c-40fb-9174-69ad0a3ddf2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:05.033762 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-1345fe65-431c-40fb-9174-69ad0a3ddf2b None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:06:05.034936 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-1345fe65-431c-40fb-9174-69ad0a3ddf2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:06:05.118888 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb4bd76-dbed-4d6e-a76a-f31f3a9389a7 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:05.154867 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d410548e-7b29-4ebf-ab1c-c7eb4b3d7ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:05.155980 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410548e-7b29-4ebf-ab1c-c7eb4b3d7ed0 None admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:05.156269 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410548e-7b29-4ebf-ab1c-c7eb4b3d7ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:05.156546 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410548e-7b29-4ebf-ab1c-c7eb4b3d7ed0 None admin] PATH_INFO: `/v3/projects/fc392bd6c8534b789823b148310d9370/users/3c89b57f850c4ef19aec98027c84b0ea/roles/a1818b2066464c9caae41106650b2c17` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:05.158819 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d410548e-7b29-4ebf-ab1c-c7eb4b3d7ed0 None admin] RBAC: Authorizing `identity:create_grant(project_id=fc392bd6c8534b789823b148310d9370, user_id=3c89b57f850c4ef19aec98027c84b0ea, role_id=a1818b2066464c9caae41106650b2c17)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:05.160422 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d410548e-7b29-4ebf-ab1c-c7eb4b3d7ed0 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:05.181601 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 148/287] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:06:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 07 06:06:05.205993 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1345fe65-431c-40fb-9174-69ad0a3ddf2b None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:05.232495 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 140/288] 10.222.0.24 () {58 vars in 1439 bytes} [Thu Apr 7 06:06:04 2022] PUT /identity/v3/projects/fc392bd6c8534b789823b148310d9370/users/3c89b57f850c4ef19aec98027c84b0ea/roles/a1818b2066464c9caae41106650b2c17 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:06:05.314191 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1345fe65-431c-40fb-9174-69ad0a3ddf2b None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:05.370192 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b914115c-0014-40b0-a53c-39cf2bd69786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:05.371035 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914115c-0014-40b0-a53c-39cf2bd69786 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:05.371324 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914115c-0014-40b0-a53c-39cf2bd69786 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:05.371603 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914115c-0014-40b0-a53c-39cf2bd69786 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:05.387498 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b914115c-0014-40b0-a53c-39cf2bd69786 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:06:05.394885 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-b914115c-0014-40b0-a53c-39cf2bd69786 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 07 06:06:05.396436 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 149/289] 10.222.0.24 () {56 vars in 1099 bytes} [Thu Apr 7 06:06:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 07 06:06:05.402511 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d410548e-7b29-4ebf-ab1c-c7eb4b3d7ed0 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:05.517222 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d410548e-7b29-4ebf-ab1c-c7eb4b3d7ed0 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:05.551475 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1cbecc-f568-4bcc-ad31-1a0cdb4aa7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:05.552189 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1cbecc-f568-4bcc-ad31-1a0cdb4aa7b0 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:05.552475 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1cbecc-f568-4bcc-ad31-1a0cdb4aa7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:05.552750 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1cbecc-f568-4bcc-ad31-1a0cdb4aa7b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:05.553520 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1cbecc-f568-4bcc-ad31-1a0cdb4aa7b0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:05.553831 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1cbecc-f568-4bcc-ad31-1a0cdb4aa7b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:05.555236 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1cbecc-f568-4bcc-ad31-1a0cdb4aa7b0 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:05.564423 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 141/290] 10.222.0.24 () {56 vars in 1101 bytes} [Thu Apr 7 06:06:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:05.570113 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b914115c-0014-40b0-a53c-39cf2bd69786 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:05.680753 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b914115c-0014-40b0-a53c-39cf2bd69786 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:05.719250 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68534db2-dc27-46c5-a02e-58664e3af48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:05.720163 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68534db2-dc27-46c5-a02e-58664e3af48c None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:05.720446 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68534db2-dc27-46c5-a02e-58664e3af48c None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:05.720719 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68534db2-dc27-46c5-a02e-58664e3af48c None admin] PATH_INFO: `/v3/users/068063830ff84695bea85e9e77356a8a` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:05.721931 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68534db2-dc27-46c5-a02e-58664e3af48c None admin] RBAC: Authorizing `identity:get_user(user_id=068063830ff84695bea85e9e77356a8a)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:05.723368 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68534db2-dc27-46c5-a02e-58664e3af48c None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:05.725360 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 150/291] 10.222.0.24 () {56 vars in 1177 bytes} [Thu Apr 7 06:06:05 2022] GET /identity/v3/users/068063830ff84695bea85e9e77356a8a => generated 297 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:05.731219 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1cbecc-f568-4bcc-ad31-1a0cdb4aa7b0 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:05.910211 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1cbecc-f568-4bcc-ad31-1a0cdb4aa7b0 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:05.953608 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b20e097-ec5d-42b6-8afb-d7ccc6cf687a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:05.954298 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b20e097-ec5d-42b6-8afb-d7ccc6cf687a None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:05.954581 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b20e097-ec5d-42b6-8afb-d7ccc6cf687a None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:05.954858 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b20e097-ec5d-42b6-8afb-d7ccc6cf687a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:06.051087 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b20e097-ec5d-42b6-8afb-d7ccc6cf687a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:06.052600 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b20e097-ec5d-42b6-8afb-d7ccc6cf687a None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:06.177021 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 142/292] 10.222.0.24 () {58 vars in 1282 bytes} [Thu Apr 7 06:06:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 07 06:06:06.182670 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68534db2-dc27-46c5-a02e-58664e3af48c None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:06.303229 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68534db2-dc27-46c5-a02e-58664e3af48c None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:06.347323 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e65203a-ea0d-4eea-b5b6-fe0c3d11d43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:06.348227 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65203a-ea0d-4eea-b5b6-fe0c3d11d43c None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:06.348526 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65203a-ea0d-4eea-b5b6-fe0c3d11d43c None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:06.348804 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65203a-ea0d-4eea-b5b6-fe0c3d11d43c None admin] PATH_INFO: `/v3/projects/fc392bd6c8534b789823b148310d9370` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:06.350034 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e65203a-ea0d-4eea-b5b6-fe0c3d11d43c None admin] RBAC: Authorizing `identity:get_project(project_id=fc392bd6c8534b789823b148310d9370)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:06.351477 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e65203a-ea0d-4eea-b5b6-fe0c3d11d43c None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:06.353291 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 151/293] 10.222.0.24 () {56 vars in 1186 bytes} [Thu Apr 7 06:06:06 2022] GET /identity/v3/projects/fc392bd6c8534b789823b148310d9370 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:06.359394 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b20e097-ec5d-42b6-8afb-d7ccc6cf687a None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:06.492205 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b20e097-ec5d-42b6-8afb-d7ccc6cf687a None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:06.549928 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f12798-3204-4661-b6aa-6e2a5cdcaf70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:06.550604 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f12798-3204-4661-b6aa-6e2a5cdcaf70 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:06.550887 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f12798-3204-4661-b6aa-6e2a5cdcaf70 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:06.551253 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f12798-3204-4661-b6aa-6e2a5cdcaf70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:06.552124 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f12798-3204-4661-b6aa-6e2a5cdcaf70 None admin] RBAC: Adding query filter params (role.id=7abd6a5977df4ff4a5476c2d95a1934b, scope.project.id=fc392bd6c8534b789823b148310d9370, user.id=068063830ff84695bea85e9e77356a8a) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:06.552502 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f12798-3204-4661-b6aa-6e2a5cdcaf70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:06.554054 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f12798-3204-4661-b6aa-6e2a5cdcaf70 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:06.565845 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 143/294] 10.222.0.24 () {56 vars in 1374 bytes} [Thu Apr 7 06:06:06 2022] GET /identity/v3/role_assignments?user.id=068063830ff84695bea85e9e77356a8a&scope.project.id=fc392bd6c8534b789823b148310d9370&role.id=7abd6a5977df4ff4a5476c2d95a1934b => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:06.672410 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb24dc8-d481-46d2-88f4-66d9f40d19d4 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:06.673414 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb24dc8-d481-46d2-88f4-66d9f40d19d4 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:06.673907 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb24dc8-d481-46d2-88f4-66d9f40d19d4 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:06.676100 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 152/295] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:06:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:06:06.682540 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa68e0e4-5790-47e1-89ed-3492d622cf96 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:06.682956 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa68e0e4-5790-47e1-89ed-3492d622cf96 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:06.683236 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa68e0e4-5790-47e1-89ed-3492d622cf96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:06.717658 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-fa68e0e4-5790-47e1-89ed-3492d622cf96 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:06:06.719165 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-fa68e0e4-5790-47e1-89ed-3492d622cf96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:06:06.828350 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 144/296] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:06:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:06:06.851467 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb24dc8-d481-46d2-88f4-66d9f40d19d4 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:06.972442 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb24dc8-d481-46d2-88f4-66d9f40d19d4 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:07.013699 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda36af9-68f4-4f13-958a-7ee10c641a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:07.014913 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda36af9-68f4-4f13-958a-7ee10c641a1b None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:07.015411 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda36af9-68f4-4f13-958a-7ee10c641a1b None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:07.015968 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda36af9-68f4-4f13-958a-7ee10c641a1b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:07.030102 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda36af9-68f4-4f13-958a-7ee10c641a1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:06:07.037796 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-bda36af9-68f4-4f13-958a-7ee10c641a1b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 07 06:06:07.039456 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 153/297] 10.222.0.24 () {56 vars in 1099 bytes} [Thu Apr 7 06:06:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:07.048006 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa68e0e4-5790-47e1-89ed-3492d622cf96 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:07.161981 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa68e0e4-5790-47e1-89ed-3492d622cf96 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:07.168471 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42322cf5-1951-4bf0-a1c5-29b17027b97f None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:07.169051 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42322cf5-1951-4bf0-a1c5-29b17027b97f None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:07.169528 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42322cf5-1951-4bf0-a1c5-29b17027b97f None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:07.171094 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 154/298] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:06:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 07 06:06:07.177193 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76853f8f-b7ae-4e44-afaf-66f18ed8a25c None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:07.177480 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76853f8f-b7ae-4e44-afaf-66f18ed8a25c None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:07.177928 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76853f8f-b7ae-4e44-afaf-66f18ed8a25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:07.198151 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-76853f8f-b7ae-4e44-afaf-66f18ed8a25c None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:06:07.199860 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-76853f8f-b7ae-4e44-afaf-66f18ed8a25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:06:07.214849 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aaa03e-b098-4c0e-9024-64931934c063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:07.215900 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aaa03e-b098-4c0e-9024-64931934c063 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:07.216188 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aaa03e-b098-4c0e-9024-64931934c063 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:07.216466 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aaa03e-b098-4c0e-9024-64931934c063 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:07.218021 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aaa03e-b098-4c0e-9024-64931934c063 None admin] RBAC: Adding query filter params (name=member) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:07.218331 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aaa03e-b098-4c0e-9024-64931934c063 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:07.219906 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aaa03e-b098-4c0e-9024-64931934c063 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:07.231316 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 145/299] 10.222.0.24 () {56 vars in 1101 bytes} [Thu Apr 7 06:06:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:07.238391 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aaa03e-b098-4c0e-9024-64931934c063 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:07.276911 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 155/300] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:06:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:06:07.302120 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76853f8f-b7ae-4e44-afaf-66f18ed8a25c None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:07.355520 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aaa03e-b098-4c0e-9024-64931934c063 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:07.389354 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f384a1b-d930-4186-9ad4-1d4c37bf91e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:07.390227 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f384a1b-d930-4186-9ad4-1d4c37bf91e1 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:07.390516 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f384a1b-d930-4186-9ad4-1d4c37bf91e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:07.390794 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f384a1b-d930-4186-9ad4-1d4c37bf91e1 None admin] PATH_INFO: `/v3/users/3988826728984733bbdf462e9ba89ef8` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:07.392029 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f384a1b-d930-4186-9ad4-1d4c37bf91e1 None admin] RBAC: Authorizing `identity:get_user(user_id=3988826728984733bbdf462e9ba89ef8)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:07.393488 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f384a1b-d930-4186-9ad4-1d4c37bf91e1 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:07.395132 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 146/301] 10.222.0.24 () {56 vars in 1177 bytes} [Thu Apr 7 06:06:07 2022] GET /identity/v3/users/3988826728984733bbdf462e9ba89ef8 => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:07.397654 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16fd5a-3463-444e-b1f6-34ef907f56b6 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:07.398051 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16fd5a-3463-444e-b1f6-34ef907f56b6 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:07.398430 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16fd5a-3463-444e-b1f6-34ef907f56b6 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:07.400904 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 147/302] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:06:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:06:07.401997 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a16fd5a-3463-444e-b1f6-34ef907f56b6 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:07.403461 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76853f8f-b7ae-4e44-afaf-66f18ed8a25c None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:07.437458 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eecd46-e6b5-4ae1-ade8-3b3c717cc878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:07.438191 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eecd46-e6b5-4ae1-ade8-3b3c717cc878 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:07.438484 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eecd46-e6b5-4ae1-ade8-3b3c717cc878 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:07.438755 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eecd46-e6b5-4ae1-ade8-3b3c717cc878 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:07.449063 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eecd46-e6b5-4ae1-ade8-3b3c717cc878 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:06:07.456063 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-51eecd46-e6b5-4ae1-ade8-3b3c717cc878 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 07 06:06:07.457266 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 156/303] 10.222.0.24 () {56 vars in 1099 bytes} [Thu Apr 7 06:06:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 07 06:06:07.458421 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4233af-e298-4ecf-955a-9ecdf0c31ace None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:07.458709 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4233af-e298-4ecf-955a-9ecdf0c31ace None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:07.458990 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4233af-e298-4ecf-955a-9ecdf0c31ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:07.475371 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-3f4233af-e298-4ecf-955a-9ecdf0c31ace None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:06:07.476583 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-3f4233af-e298-4ecf-955a-9ecdf0c31ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:06:07.510466 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a16fd5a-3463-444e-b1f6-34ef907f56b6 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:07.541867 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 157/304] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:06:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:06:07.542927 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4233af-e298-4ecf-955a-9ecdf0c31ace None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:07.543665 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cfdda4-0b30-4ec0-b385-5e71372c8cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:07.544553 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cfdda4-0b30-4ec0-b385-5e71372c8cef None admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:07.544838 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cfdda4-0b30-4ec0-b385-5e71372c8cef None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:07.545114 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cfdda4-0b30-4ec0-b385-5e71372c8cef None admin] PATH_INFO: `/v3/system/users/3988826728984733bbdf462e9ba89ef8/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:07.546594 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cfdda4-0b30-4ec0-b385-5e71372c8cef None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3988826728984733bbdf462e9ba89ef8, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:07.547996 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cfdda4-0b30-4ec0-b385-5e71372c8cef None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:07.644549 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4233af-e298-4ecf-955a-9ecdf0c31ace None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:07.646542 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 148/305] 10.222.0.24 () {58 vars in 1334 bytes} [Thu Apr 7 06:06:07 2022] PUT /identity/v3/system/users/3988826728984733bbdf462e9ba89ef8/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:06:07.652618 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cfdda4-0b30-4ec0-b385-5e71372c8cef None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:07.684336 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c57769-eab3-44fd-932e-4d1339d698ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:07.685655 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c57769-eab3-44fd-932e-4d1339d698ba None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:07.686119 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c57769-eab3-44fd-932e-4d1339d698ba None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:07.686576 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c57769-eab3-44fd-932e-4d1339d698ba None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:07.687622 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c57769-eab3-44fd-932e-4d1339d698ba None admin] RBAC: Adding query filter params (name=reader) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:07.688116 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c57769-eab3-44fd-932e-4d1339d698ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:07.689676 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c57769-eab3-44fd-932e-4d1339d698ba None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:07.699308 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 158/306] 10.222.0.24 () {56 vars in 1101 bytes} [Thu Apr 7 06:06:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:07.704738 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c57769-eab3-44fd-932e-4d1339d698ba None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:07.789567 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cfdda4-0b30-4ec0-b385-5e71372c8cef None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:07.872738 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d12175d-673d-46e2-99de-1ac580785106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:07.873596 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d12175d-673d-46e2-99de-1ac580785106 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:07.873882 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d12175d-673d-46e2-99de-1ac580785106 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:07.874160 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d12175d-673d-46e2-99de-1ac580785106 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:07.875341 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d12175d-673d-46e2-99de-1ac580785106 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:07.876914 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d12175d-673d-46e2-99de-1ac580785106 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:07.877216 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c57769-eab3-44fd-932e-4d1339d698ba None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:07.878728 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 149/307] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:06:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:07.884171 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d12175d-673d-46e2-99de-1ac580785106 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:07.922576 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c5644-8641-4bd9-9bdc-6319ed8c5823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:07.923469 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c5644-8641-4bd9-9bdc-6319ed8c5823 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:07.923765 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c5644-8641-4bd9-9bdc-6319ed8c5823 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:07.924039 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c5644-8641-4bd9-9bdc-6319ed8c5823 None admin] PATH_INFO: `/v3/users/f43954bdb89e45cd969f3c107152605d` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:07.938786 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4c5644-8641-4bd9-9bdc-6319ed8c5823 None admin] RBAC: Authorizing `identity:get_user(user_id=f43954bdb89e45cd969f3c107152605d)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:07.940197 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4c5644-8641-4bd9-9bdc-6319ed8c5823 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:07.942294 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 159/308] 10.222.0.24 () {56 vars in 1177 bytes} [Thu Apr 7 06:06:07 2022] GET /identity/v3/users/f43954bdb89e45cd969f3c107152605d => generated 293 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:06:07.947987 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c5644-8641-4bd9-9bdc-6319ed8c5823 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:07.994374 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d12175d-673d-46e2-99de-1ac580785106 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:08.030299 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a779a035-3e25-4d69-9edc-e2a85c6fc9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:08.030975 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779a035-3e25-4d69-9edc-e2a85c6fc9f2 None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:08.031258 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779a035-3e25-4d69-9edc-e2a85c6fc9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:08.031533 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779a035-3e25-4d69-9edc-e2a85c6fc9f2 None admin] PATH_INFO: `/v3/groups` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:08.032273 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a779a035-3e25-4d69-9edc-e2a85c6fc9f2 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:08.033798 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a779a035-3e25-4d69-9edc-e2a85c6fc9f2 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:08.063926 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c5644-8641-4bd9-9bdc-6319ed8c5823 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:08.116085 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 150/309] 10.222.0.24 () {60 vars in 1134 bytes} [Thu Apr 7 06:06:07 2022] POST /identity/v3/groups => generated 229 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:06:08.120854 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b8839-8798-43b4-9032-28275a0fe1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:08.121762 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b8839-8798-43b4-9032-28275a0fe1e8 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:08.122226 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b8839-8798-43b4-9032-28275a0fe1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:08.122672 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b8839-8798-43b4-9032-28275a0fe1e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:08.123675 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7b8839-8798-43b4-9032-28275a0fe1e8 None admin] RBAC: Adding query filter params (role.id=a1818b2066464c9caae41106650b2c17, user.id=f43954bdb89e45cd969f3c107152605d, scope.system=all) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:08.124211 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7b8839-8798-43b4-9032-28275a0fe1e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:08.125815 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7b8839-8798-43b4-9032-28275a0fe1e8 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:08.132212 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 160/310] 10.222.0.24 () {56 vars in 1308 bytes} [Thu Apr 7 06:06:07 2022] GET /identity/v3/role_assignments?user.id=f43954bdb89e45cd969f3c107152605d&scope.system=all&role.id=a1818b2066464c9caae41106650b2c17 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:06:08.382913 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df02b4-aa0d-487c-8bae-5dc0c2357eb2 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:08.383287 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df02b4-aa0d-487c-8bae-5dc0c2357eb2 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:08.383461 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df02b4-aa0d-487c-8bae-5dc0c2357eb2 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:08.385699 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 151/311] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:06:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:06:08.391387 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30dc828-82e4-4500-89de-85ef46f669e5 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:08.391781 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30dc828-82e4-4500-89de-85ef46f669e5 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:08.392076 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30dc828-82e4-4500-89de-85ef46f669e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:08.424256 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-d30dc828-82e4-4500-89de-85ef46f669e5 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:06:08.425441 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d30dc828-82e4-4500-89de-85ef46f669e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:06:08.515767 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 161/312] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:06:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:06:08.536966 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df02b4-aa0d-487c-8bae-5dc0c2357eb2 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:08.640821 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df02b4-aa0d-487c-8bae-5dc0c2357eb2 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:08.674303 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95819e07-bce3-43f2-9625-74dfb418ee02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:08.675100 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95819e07-bce3-43f2-9625-74dfb418ee02 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:08.675383 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95819e07-bce3-43f2-9625-74dfb418ee02 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:08.675676 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95819e07-bce3-43f2-9625-74dfb418ee02 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:08.686412 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95819e07-bce3-43f2-9625-74dfb418ee02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:06:08.693472 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-95819e07-bce3-43f2-9625-74dfb418ee02 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 07 06:06:08.694973 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 152/313] 10.222.0.24 () {56 vars in 1099 bytes} [Thu Apr 7 06:06:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 07 06:06:08.703139 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30dc828-82e4-4500-89de-85ef46f669e5 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:08.804799 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30dc828-82e4-4500-89de-85ef46f669e5 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:08.840130 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0312aee2-3e32-4b8d-b896-ab5a6c41db9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:08.840824 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312aee2-3e32-4b8d-b896-ab5a6c41db9c None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:08.841108 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312aee2-3e32-4b8d-b896-ab5a6c41db9c None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:08.841401 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312aee2-3e32-4b8d-b896-ab5a6c41db9c None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:08.842151 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0312aee2-3e32-4b8d-b896-ab5a6c41db9c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:08.842453 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0312aee2-3e32-4b8d-b896-ab5a6c41db9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:08.843850 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0312aee2-3e32-4b8d-b896-ab5a6c41db9c None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:08.852350 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 162/314] 10.222.0.24 () {56 vars in 1101 bytes} [Thu Apr 7 06:06:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:08.858237 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95819e07-bce3-43f2-9625-74dfb418ee02 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:08.960607 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95819e07-bce3-43f2-9625-74dfb418ee02 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:08.996171 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe6ea8-7007-48f3-871e-9ac0ea9d08c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:08.997460 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe6ea8-7007-48f3-871e-9ac0ea9d08c0 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:08.997940 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe6ea8-7007-48f3-871e-9ac0ea9d08c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:08.998418 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe6ea8-7007-48f3-871e-9ac0ea9d08c0 None admin] PATH_INFO: `/v3/users/3c89b57f850c4ef19aec98027c84b0ea` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:09.000009 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fe6ea8-7007-48f3-871e-9ac0ea9d08c0 None admin] RBAC: Authorizing `identity:get_user(user_id=3c89b57f850c4ef19aec98027c84b0ea)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:09.006633 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fe6ea8-7007-48f3-871e-9ac0ea9d08c0 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:09.009145 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 153/315] 10.222.0.24 () {56 vars in 1177 bytes} [Thu Apr 7 06:06:08 2022] GET /identity/v3/users/3c89b57f850c4ef19aec98027c84b0ea => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:09.019797 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0312aee2-3e32-4b8d-b896-ab5a6c41db9c None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:09.116563 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0312aee2-3e32-4b8d-b896-ab5a6c41db9c None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:09.150455 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1e42a-77db-426e-ab38-9daac133e03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:09.151094 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1e42a-77db-426e-ab38-9daac133e03e None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:09.151377 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1e42a-77db-426e-ab38-9daac133e03e None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:09.151653 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1e42a-77db-426e-ab38-9daac133e03e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:09.217550 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f1e42a-77db-426e-ab38-9daac133e03e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:09.218940 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f1e42a-77db-426e-ab38-9daac133e03e None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:09.318115 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 163/316] 10.222.0.24 () {58 vars in 1282 bytes} [Thu Apr 7 06:06:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 07 06:06:09.323777 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe6ea8-7007-48f3-871e-9ac0ea9d08c0 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:09.537293 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe6ea8-7007-48f3-871e-9ac0ea9d08c0 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:09.575365 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c789b8-37f4-4df0-9cee-b9788056aca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:09.576592 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c789b8-37f4-4df0-9cee-b9788056aca3 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:09.577100 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c789b8-37f4-4df0-9cee-b9788056aca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:09.577609 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c789b8-37f4-4df0-9cee-b9788056aca3 None admin] PATH_INFO: `/v3/projects/fc392bd6c8534b789823b148310d9370` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:09.579010 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c789b8-37f4-4df0-9cee-b9788056aca3 None admin] RBAC: Authorizing `identity:get_project(project_id=fc392bd6c8534b789823b148310d9370)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:09.580687 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c789b8-37f4-4df0-9cee-b9788056aca3 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:09.582952 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 154/317] 10.222.0.24 () {56 vars in 1186 bytes} [Thu Apr 7 06:06:09 2022] GET /identity/v3/projects/fc392bd6c8534b789823b148310d9370 => generated 302 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:09.589087 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1e42a-77db-426e-ab38-9daac133e03e None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:09.687602 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1e42a-77db-426e-ab38-9daac133e03e None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:09.722176 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9217fb47-f031-4090-b47b-b4591531e820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:09.723611 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217fb47-f031-4090-b47b-b4591531e820 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:09.724127 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217fb47-f031-4090-b47b-b4591531e820 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:09.724685 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217fb47-f031-4090-b47b-b4591531e820 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:09.725706 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9217fb47-f031-4090-b47b-b4591531e820 None admin] RBAC: Adding query filter params (role.id=a1818b2066464c9caae41106650b2c17, scope.project.id=fc392bd6c8534b789823b148310d9370, user.id=3c89b57f850c4ef19aec98027c84b0ea) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:09.726209 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9217fb47-f031-4090-b47b-b4591531e820 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:09.728451 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9217fb47-f031-4090-b47b-b4591531e820 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:09.734945 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 164/318] 10.222.0.24 () {56 vars in 1374 bytes} [Thu Apr 7 06:06:09 2022] GET /identity/v3/role_assignments?user.id=3c89b57f850c4ef19aec98027c84b0ea&scope.project.id=fc392bd6c8534b789823b148310d9370&role.id=a1818b2066464c9caae41106650b2c17 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:10.248453 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe654fb1-558a-4519-ba8a-1edc378fd0a9 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:10.248963 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe654fb1-558a-4519-ba8a-1edc378fd0a9 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:10.249063 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe654fb1-558a-4519-ba8a-1edc378fd0a9 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:10.250551 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 155/319] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:06:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:06:10.255402 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae0be0-d935-4d29-9c5b-b1b7f5f46aab None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:10.255697 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae0be0-d935-4d29-9c5b-b1b7f5f46aab None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:10.256007 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae0be0-d935-4d29-9c5b-b1b7f5f46aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:10.272067 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-e3ae0be0-d935-4d29-9c5b-b1b7f5f46aab None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:06:10.273243 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e3ae0be0-d935-4d29-9c5b-b1b7f5f46aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:06:10.335505 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 165/320] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:06:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:06:10.360142 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe654fb1-558a-4519-ba8a-1edc378fd0a9 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:10.456749 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe654fb1-558a-4519-ba8a-1edc378fd0a9 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:10.490296 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d7ddb-65c7-426d-99b4-51a3018f2ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:10.491388 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d7ddb-65c7-426d-99b4-51a3018f2ec6 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:10.491878 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d7ddb-65c7-426d-99b4-51a3018f2ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:10.492343 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d7ddb-65c7-426d-99b4-51a3018f2ec6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:10.495085 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61bc3af-5f3b-4e67-8113-c85f3fdb868b None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:10.495382 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61bc3af-5f3b-4e67-8113-c85f3fdb868b None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:10.495665 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61bc3af-5f3b-4e67-8113-c85f3fdb868b None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:10.497319 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 166/321] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:06:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:06:10.502205 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97666f-e29f-41ad-80aa-3cda4f61f427 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:10.502448 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97666f-e29f-41ad-80aa-3cda4f61f427 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:10.502732 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97666f-e29f-41ad-80aa-3cda4f61f427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:10.503439 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731d7ddb-65c7-426d-99b4-51a3018f2ec6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:06:10.511193 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-731d7ddb-65c7-426d-99b4-51a3018f2ec6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 07 06:06:10.512569 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 156/322] 10.222.0.24 () {56 vars in 1099 bytes} [Thu Apr 7 06:06:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:10.517961 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d7ddb-65c7-426d-99b4-51a3018f2ec6 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:10.519914 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-cf97666f-e29f-41ad-80aa-3cda4f61f427 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:06:10.521100 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-cf97666f-e29f-41ad-80aa-3cda4f61f427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:06:10.584843 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 167/323] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:06:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 07 06:06:10.607540 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf97666f-e29f-41ad-80aa-3cda4f61f427 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:10.615727 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d7ddb-65c7-426d-99b4-51a3018f2ec6 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:10.648934 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c05c295-4636-4f54-a582-deac6b8d646c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:10.649619 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05c295-4636-4f54-a582-deac6b8d646c None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:10.650544 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05c295-4636-4f54-a582-deac6b8d646c None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:10.650829 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05c295-4636-4f54-a582-deac6b8d646c None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:10.651590 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c05c295-4636-4f54-a582-deac6b8d646c None admin] RBAC: Adding query filter params (name=member) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:10.651936 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c05c295-4636-4f54-a582-deac6b8d646c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:10.653314 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c05c295-4636-4f54-a582-deac6b8d646c None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:10.661872 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 157/324] 10.222.0.24 () {56 vars in 1101 bytes} [Thu Apr 7 06:06:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:06:10.667229 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c05c295-4636-4f54-a582-deac6b8d646c None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:10.701691 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf97666f-e29f-41ad-80aa-3cda4f61f427 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:10.733574 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0fc1d-5bce-4f35-b82a-3f08d87d51cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:10.734501 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0fc1d-5bce-4f35-b82a-3f08d87d51cd None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:10.734783 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0fc1d-5bce-4f35-b82a-3f08d87d51cd None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:10.735055 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0fc1d-5bce-4f35-b82a-3f08d87d51cd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:10.745658 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca0fc1d-5bce-4f35-b82a-3f08d87d51cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:06:10.752774 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-5ca0fc1d-5bce-4f35-b82a-3f08d87d51cd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 07 06:06:10.754126 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 168/325] 10.222.0.24 () {56 vars in 1099 bytes} [Thu Apr 7 06:06:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 07 06:06:10.760216 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0fc1d-5bce-4f35-b82a-3f08d87d51cd None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:10.767830 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c05c295-4636-4f54-a582-deac6b8d646c None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:10.800574 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a107579-d6e3-4d9c-99be-2e34072d74a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:10.801445 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a107579-d6e3-4d9c-99be-2e34072d74a6 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:10.801730 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a107579-d6e3-4d9c-99be-2e34072d74a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:10.802003 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a107579-d6e3-4d9c-99be-2e34072d74a6 None admin] PATH_INFO: `/v3/users/3988826728984733bbdf462e9ba89ef8` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:10.803174 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a107579-d6e3-4d9c-99be-2e34072d74a6 None admin] RBAC: Authorizing `identity:get_user(user_id=3988826728984733bbdf462e9ba89ef8)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:10.804765 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a107579-d6e3-4d9c-99be-2e34072d74a6 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:10.807132 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 158/326] 10.222.0.24 () {56 vars in 1177 bytes} [Thu Apr 7 06:06:10 2022] GET /identity/v3/users/3988826728984733bbdf462e9ba89ef8 => generated 293 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:06:10.812595 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a107579-d6e3-4d9c-99be-2e34072d74a6 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:10.866067 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0fc1d-5bce-4f35-b82a-3f08d87d51cd None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:10.900294 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec6a76-2cfb-4684-a15c-5898376ade90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:10.900964 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec6a76-2cfb-4684-a15c-5898376ade90 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:10.901251 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec6a76-2cfb-4684-a15c-5898376ade90 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:10.901525 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec6a76-2cfb-4684-a15c-5898376ade90 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:10.902269 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec6a76-2cfb-4684-a15c-5898376ade90 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:10.902571 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec6a76-2cfb-4684-a15c-5898376ade90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:10.903971 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec6a76-2cfb-4684-a15c-5898376ade90 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:10.917541 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 169/327] 10.222.0.24 () {56 vars in 1101 bytes} [Thu Apr 7 06:06:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:06:10.918585 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec6a76-2cfb-4684-a15c-5898376ade90 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:10.928509 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a107579-d6e3-4d9c-99be-2e34072d74a6 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:10.960930 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc6d2dd-923e-4dea-ae35-647cd4e33d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:10.961583 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc6d2dd-923e-4dea-ae35-647cd4e33d75 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:10.961866 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc6d2dd-923e-4dea-ae35-647cd4e33d75 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:10.962140 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc6d2dd-923e-4dea-ae35-647cd4e33d75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:10.963496 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc6d2dd-923e-4dea-ae35-647cd4e33d75 None admin] RBAC: Adding query filter params (role.id=7abd6a5977df4ff4a5476c2d95a1934b, user.id=3988826728984733bbdf462e9ba89ef8, scope.system=all) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:10.963834 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc6d2dd-923e-4dea-ae35-647cd4e33d75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:10.965251 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc6d2dd-923e-4dea-ae35-647cd4e33d75 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:10.987786 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 159/328] 10.222.0.24 () {56 vars in 1308 bytes} [Thu Apr 7 06:06:10 2022] GET /identity/v3/role_assignments?user.id=3988826728984733bbdf462e9ba89ef8&scope.system=all&role.id=7abd6a5977df4ff4a5476c2d95a1934b => generated 510 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:06:11.022025 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec6a76-2cfb-4684-a15c-5898376ade90 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:11.057616 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b0e73a-ee53-42df-b022-a7364ee09fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:11.058525 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b0e73a-ee53-42df-b022-a7364ee09fe8 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:11.058802 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b0e73a-ee53-42df-b022-a7364ee09fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:11.059070 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b0e73a-ee53-42df-b022-a7364ee09fe8 None admin] PATH_INFO: `/v3/users/f43954bdb89e45cd969f3c107152605d` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:11.060385 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b0e73a-ee53-42df-b022-a7364ee09fe8 None admin] RBAC: Authorizing `identity:get_user(user_id=f43954bdb89e45cd969f3c107152605d)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:11.061842 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b0e73a-ee53-42df-b022-a7364ee09fe8 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:11.063824 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 170/329] 10.222.0.24 () {56 vars in 1177 bytes} [Thu Apr 7 06:06:10 2022] GET /identity/v3/users/f43954bdb89e45cd969f3c107152605d => generated 293 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:06:11.069340 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc6d2dd-923e-4dea-ae35-647cd4e33d75 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:11.176168 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc6d2dd-923e-4dea-ae35-647cd4e33d75 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:11.209984 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfc1773-89b2-43c5-be41-c311b9b3ec74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:11.210850 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc1773-89b2-43c5-be41-c311b9b3ec74 None admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:11.211136 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc1773-89b2-43c5-be41-c311b9b3ec74 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:11.211416 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc1773-89b2-43c5-be41-c311b9b3ec74 None admin] PATH_INFO: `/v3/system/users/f43954bdb89e45cd969f3c107152605d/roles/a1818b2066464c9caae41106650b2c17` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:11.212962 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfc1773-89b2-43c5-be41-c311b9b3ec74 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f43954bdb89e45cd969f3c107152605d, role_id=a1818b2066464c9caae41106650b2c17)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:11.214359 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfc1773-89b2-43c5-be41-c311b9b3ec74 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:11.286259 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 160/330] 10.222.0.24 () {58 vars in 1334 bytes} [Thu Apr 7 06:06:11 2022] PUT /identity/v3/system/users/f43954bdb89e45cd969f3c107152605d/roles/a1818b2066464c9caae41106650b2c17 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:06:11.320269 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acfedb7-6c67-446c-bf26-285fa11cefa9 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:11.320562 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acfedb7-6c67-446c-bf26-285fa11cefa9 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:11.320842 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acfedb7-6c67-446c-bf26-285fa11cefa9 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:11.322300 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 171/331] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:06:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:06:11.328280 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05223e64-3671-4eaf-906a-fdc850284a42 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:11.328584 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05223e64-3671-4eaf-906a-fdc850284a42 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:11.328848 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05223e64-3671-4eaf-906a-fdc850284a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:11.346310 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-05223e64-3671-4eaf-906a-fdc850284a42 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:06:11.347562 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-05223e64-3671-4eaf-906a-fdc850284a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:06:11.416997 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 161/332] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:06:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 07 06:06:11.441818 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acfedb7-6c67-446c-bf26-285fa11cefa9 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:11.539935 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acfedb7-6c67-446c-bf26-285fa11cefa9 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:11.570937 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f7805e-051f-40d5-bdef-cfc271e4e3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:11.571727 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7805e-051f-40d5-bdef-cfc271e4e3cd None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:11.572034 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7805e-051f-40d5-bdef-cfc271e4e3cd None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:11.572308 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7805e-051f-40d5-bdef-cfc271e4e3cd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:11.573444 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f7805e-051f-40d5-bdef-cfc271e4e3cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:11.574895 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f7805e-051f-40d5-bdef-cfc271e4e3cd None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:11.576534 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 172/333] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:06:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:11.581966 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05223e64-3671-4eaf-906a-fdc850284a42 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:11.675343 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05223e64-3671-4eaf-906a-fdc850284a42 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:11.708645 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501312b-60cf-4270-b662-0675ffadb23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:11.709318 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501312b-60cf-4270-b662-0675ffadb23d None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:11.709607 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501312b-60cf-4270-b662-0675ffadb23d None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:11.709885 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501312b-60cf-4270-b662-0675ffadb23d None admin] PATH_INFO: `/v3/groups` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:11.710581 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1501312b-60cf-4270-b662-0675ffadb23d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:11.712052 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1501312b-60cf-4270-b662-0675ffadb23d None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:11.804788 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 162/334] 10.222.0.24 () {60 vars in 1134 bytes} [Thu Apr 7 06:06:11 2022] POST /identity/v3/groups => generated 226 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:06:13.896343 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b27f33b-e587-4ff7-a448-36f932eb74d1 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:13.896856 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b27f33b-e587-4ff7-a448-36f932eb74d1 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:13.896943 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b27f33b-e587-4ff7-a448-36f932eb74d1 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:13.898446 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 173/335] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:06:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:06:13.913348 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112a8e4-4733-4d41-b540-fd68526cf724 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:13.913836 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112a8e4-4733-4d41-b540-fd68526cf724 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:13.913910 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112a8e4-4733-4d41-b540-fd68526cf724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:13.936778 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-d112a8e4-4733-4d41-b540-fd68526cf724 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:06:13.937980 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d112a8e4-4733-4d41-b540-fd68526cf724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:06:14.021418 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 163/336] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:06:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:06:14.062571 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b27f33b-e587-4ff7-a448-36f932eb74d1 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:14.166406 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b27f33b-e587-4ff7-a448-36f932eb74d1 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:14.205535 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ca431-d4a0-484a-90de-965dd7f4be2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:14.206369 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ca431-d4a0-484a-90de-965dd7f4be2a None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:14.206660 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ca431-d4a0-484a-90de-965dd7f4be2a None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:14.206931 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ca431-d4a0-484a-90de-965dd7f4be2a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:14.221578 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1ca431-d4a0-484a-90de-965dd7f4be2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:06:14.229137 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-6f1ca431-d4a0-484a-90de-965dd7f4be2a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 07 06:06:14.230677 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 174/337] 10.222.0.24 () {56 vars in 1099 bytes} [Thu Apr 7 06:06:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:14.237518 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d112a8e4-4733-4d41-b540-fd68526cf724 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:14.350278 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d112a8e4-4733-4d41-b540-fd68526cf724 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:14.387327 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9652240e-74f2-4271-b652-48af90571b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:14.388036 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9652240e-74f2-4271-b652-48af90571b25 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:14.388327 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9652240e-74f2-4271-b652-48af90571b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:14.388607 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9652240e-74f2-4271-b652-48af90571b25 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:14.389375 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9652240e-74f2-4271-b652-48af90571b25 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:14.389682 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9652240e-74f2-4271-b652-48af90571b25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:14.391056 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9652240e-74f2-4271-b652-48af90571b25 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:14.399636 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 164/338] 10.222.0.24 () {56 vars in 1101 bytes} [Thu Apr 7 06:06:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:14.405955 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ca431-d4a0-484a-90de-965dd7f4be2a None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:14.517439 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ca431-d4a0-484a-90de-965dd7f4be2a None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:14.563656 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcaa274-d5e7-4560-9d37-9fc09acb5aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:14.564645 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcaa274-d5e7-4560-9d37-9fc09acb5aa0 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:14.564911 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcaa274-d5e7-4560-9d37-9fc09acb5aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:14.565181 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcaa274-d5e7-4560-9d37-9fc09acb5aa0 None admin] PATH_INFO: `/v3/users/f43954bdb89e45cd969f3c107152605d` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:14.566387 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcaa274-d5e7-4560-9d37-9fc09acb5aa0 None admin] RBAC: Authorizing `identity:get_user(user_id=f43954bdb89e45cd969f3c107152605d)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:14.567854 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcaa274-d5e7-4560-9d37-9fc09acb5aa0 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:14.569680 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 175/339] 10.222.0.24 () {56 vars in 1177 bytes} [Thu Apr 7 06:06:14 2022] GET /identity/v3/users/f43954bdb89e45cd969f3c107152605d => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:14.575466 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9652240e-74f2-4271-b652-48af90571b25 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:14.686906 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9652240e-74f2-4271-b652-48af90571b25 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:14.731772 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aa19f7-ed4d-4131-8411-0e6da23ccea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:14.731772 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa19f7-ed4d-4131-8411-0e6da23ccea9 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:14.731772 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa19f7-ed4d-4131-8411-0e6da23ccea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:14.731772 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa19f7-ed4d-4131-8411-0e6da23ccea9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:14.732171 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aa19f7-ed4d-4131-8411-0e6da23ccea9 None admin] RBAC: Adding query filter params (role.id=a1818b2066464c9caae41106650b2c17, user.id=f43954bdb89e45cd969f3c107152605d, scope.system=all) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:14.732171 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aa19f7-ed4d-4131-8411-0e6da23ccea9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:14.732171 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aa19f7-ed4d-4131-8411-0e6da23ccea9 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:14.748099 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 165/340] 10.222.0.24 () {56 vars in 1308 bytes} [Thu Apr 7 06:06:14 2022] GET /identity/v3/role_assignments?user.id=f43954bdb89e45cd969f3c107152605d&scope.system=all&role.id=a1818b2066464c9caae41106650b2c17 => generated 510 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:15.110163 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b40c3-247c-4344-aab0-a1213c7e8aea None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:15.111010 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b40c3-247c-4344-aab0-a1213c7e8aea None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:15.111427 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b40c3-247c-4344-aab0-a1213c7e8aea None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:15.113226 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 176/341] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:06:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:06:15.119422 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ec9eb-bb7a-454a-a9a4-4255a31e7692 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:15.119950 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ec9eb-bb7a-454a-a9a4-4255a31e7692 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:15.120023 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ec9eb-bb7a-454a-a9a4-4255a31e7692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:15.140648 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-7e2ec9eb-bb7a-454a-a9a4-4255a31e7692 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:06:15.142182 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-7e2ec9eb-bb7a-454a-a9a4-4255a31e7692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:06:15.219154 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 166/342] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:06:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:06:15.260845 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b40c3-247c-4344-aab0-a1213c7e8aea None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:15.330460 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3136d-a252-4c1b-aece-b16071d145f2 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:15.331082 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3136d-a252-4c1b-aece-b16071d145f2 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:15.331552 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3136d-a252-4c1b-aece-b16071d145f2 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:15.333160 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 167/343] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:06:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 07 06:06:15.344227 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23452ba-4c51-476b-b6f8-1207321645d3 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:15.344512 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23452ba-4c51-476b-b6f8-1207321645d3 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:15.344977 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23452ba-4c51-476b-b6f8-1207321645d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:15.380857 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-e23452ba-4c51-476b-b6f8-1207321645d3 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:06:15.382314 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-e23452ba-4c51-476b-b6f8-1207321645d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:06:15.396385 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b40c3-247c-4344-aab0-a1213c7e8aea None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:15.464290 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd6df2-9ebf-4687-a960-0df90be21bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:15.465396 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd6df2-9ebf-4687-a960-0df90be21bea None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:15.465680 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd6df2-9ebf-4687-a960-0df90be21bea None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:15.469142 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd6df2-9ebf-4687-a960-0df90be21bea None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:15.483527 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cd6df2-9ebf-4687-a960-0df90be21bea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:06:15.491154 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 168/344] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:06:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:06:15.492764 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f5c70-2743-4720-9c4c-3bfb7a435235 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:15.493147 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f5c70-2743-4720-9c4c-3bfb7a435235 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:15.494041 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f5c70-2743-4720-9c4c-3bfb7a435235 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:15.499766 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-c4cd6df2-9ebf-4687-a960-0df90be21bea None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 07 06:06:15.499928 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 169/345] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:06:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:06:15.501661 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 177/346] 10.222.0.24 () {56 vars in 1114 bytes} [Thu Apr 7 06:06:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:15.507363 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f5c70-2743-4720-9c4c-3bfb7a435235 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:15.518429 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1c572-d790-49f1-aa15-af0c7c094f2e None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:15.520792 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1c572-d790-49f1-aa15-af0c7c094f2e None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:15.520792 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1c572-d790-49f1-aa15-af0c7c094f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:15.543168 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-23a1c572-d790-49f1-aa15-af0c7c094f2e None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:06:15.544785 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-23a1c572-d790-49f1-aa15-af0c7c094f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:06:15.629648 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 178/347] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:06:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:06:15.630602 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a1c572-d790-49f1-aa15-af0c7c094f2e None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:15.642538 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f5c70-2743-4720-9c4c-3bfb7a435235 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:15.700784 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed85ce-5c31-4aad-8003-7679a09b4b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:15.701789 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed85ce-5c31-4aad-8003-7679a09b4b42 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:15.702265 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed85ce-5c31-4aad-8003-7679a09b4b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:15.702751 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed85ce-5c31-4aad-8003-7679a09b4b42 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:15.703690 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ed85ce-5c31-4aad-8003-7679a09b4b42 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:15.704233 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ed85ce-5c31-4aad-8003-7679a09b4b42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:15.705796 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ed85ce-5c31-4aad-8003-7679a09b4b42 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:15.714571 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 170/348] 10.222.0.24 () {56 vars in 1111 bytes} [Thu Apr 7 06:06:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:15.715697 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed85ce-5c31-4aad-8003-7679a09b4b42 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:15.755769 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a1c572-d790-49f1-aa15-af0c7c094f2e None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:15.797600 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f8f849-4761-4a7b-88bb-8bbf3c36a78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:15.798674 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8f849-4761-4a7b-88bb-8bbf3c36a78e None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:15.798964 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8f849-4761-4a7b-88bb-8bbf3c36a78e None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:15.799400 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8f849-4761-4a7b-88bb-8bbf3c36a78e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:15.812551 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f8f849-4761-4a7b-88bb-8bbf3c36a78e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:06:15.822359 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-d7f8f849-4761-4a7b-88bb-8bbf3c36a78e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 07 06:06:15.823776 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 179/349] 10.222.0.24 () {56 vars in 1099 bytes} [Thu Apr 7 06:06:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:15.824414 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f8f849-4761-4a7b-88bb-8bbf3c36a78e None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:15.841912 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed85ce-5c31-4aad-8003-7679a09b4b42 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:15.879199 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6bb58f-bf76-4d10-8a0b-dc616c77985d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:15.880053 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6bb58f-bf76-4d10-8a0b-dc616c77985d None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:15.880337 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6bb58f-bf76-4d10-8a0b-dc616c77985d None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:15.880609 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6bb58f-bf76-4d10-8a0b-dc616c77985d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:15.893599 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6bb58f-bf76-4d10-8a0b-dc616c77985d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:06:15.901344 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-0e6bb58f-bf76-4d10-8a0b-dc616c77985d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 07 06:06:15.902749 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 171/350] 10.222.0.24 () {56 vars in 1099 bytes} [Thu Apr 7 06:06:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:15.903584 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6bb58f-bf76-4d10-8a0b-dc616c77985d None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:15.941914 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f8f849-4761-4a7b-88bb-8bbf3c36a78e None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:15.975993 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba38b8f6-fa8e-40f8-8df9-45d89f9454f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:15.976655 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38b8f6-fa8e-40f8-8df9-45d89f9454f7 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:15.976940 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38b8f6-fa8e-40f8-8df9-45d89f9454f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:15.977218 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38b8f6-fa8e-40f8-8df9-45d89f9454f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:16.029339 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6bb58f-bf76-4d10-8a0b-dc616c77985d None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:16.067627 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba38b8f6-fa8e-40f8-8df9-45d89f9454f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:16.071187 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba38b8f6-fa8e-40f8-8df9-45d89f9454f7 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:16.073142 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45794273-2086-4e65-bfb0-8b4cfda6e181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:16.074035 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45794273-2086-4e65-bfb0-8b4cfda6e181 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:16.074324 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45794273-2086-4e65-bfb0-8b4cfda6e181 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:16.074631 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45794273-2086-4e65-bfb0-8b4cfda6e181 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:16.075404 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45794273-2086-4e65-bfb0-8b4cfda6e181 None admin] RBAC: Adding query filter params (name=member) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:16.075718 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45794273-2086-4e65-bfb0-8b4cfda6e181 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:16.077116 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45794273-2086-4e65-bfb0-8b4cfda6e181 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:16.088524 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 172/351] 10.222.0.24 () {56 vars in 1101 bytes} [Thu Apr 7 06:06:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:16.089845 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d4ce0-356a-4512-ae22-bad0cb8cc6ab None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:16.090148 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d4ce0-356a-4512-ae22-bad0cb8cc6ab None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:16.090428 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d4ce0-356a-4512-ae22-bad0cb8cc6ab None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:16.091712 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 173/352] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:06:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:06:16.094045 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d4ce0-356a-4512-ae22-bad0cb8cc6ab None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:16.205697 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d4ce0-356a-4512-ae22-bad0cb8cc6ab None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:16.206741 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 180/353] 10.222.0.24 () {58 vars in 1282 bytes} [Thu Apr 7 06:06:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 07 06:06:16.208699 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5d9a6-52c0-46e6-a540-90a6423897c9 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:16.209146 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5d9a6-52c0-46e6-a540-90a6423897c9 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:16.209589 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5d9a6-52c0-46e6-a540-90a6423897c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:16.227082 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-3fa5d9a6-52c0-46e6-a540-90a6423897c9 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:06:16.228379 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-3fa5d9a6-52c0-46e6-a540-90a6423897c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:06:16.242793 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52997ef-3813-4530-904b-546633f58bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:16.244031 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52997ef-3813-4530-904b-546633f58bfb None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:16.244318 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52997ef-3813-4530-904b-546633f58bfb None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:16.244592 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52997ef-3813-4530-904b-546633f58bfb None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:16.245352 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52997ef-3813-4530-904b-546633f58bfb None admin] RBAC: Adding query filter params (name=member) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:16.245671 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52997ef-3813-4530-904b-546633f58bfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:16.247041 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52997ef-3813-4530-904b-546633f58bfb None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:16.255798 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 174/354] 10.222.0.24 () {56 vars in 1101 bytes} [Thu Apr 7 06:06:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:16.256783 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52997ef-3813-4530-904b-546633f58bfb None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:16.300243 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 181/355] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:06:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:06:16.301116 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa5d9a6-52c0-46e6-a540-90a6423897c9 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:16.382033 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52997ef-3813-4530-904b-546633f58bfb None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:16.420179 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6ecd4-e2f9-4ec0-b4f6-78e16df0312a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:16.421279 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6ecd4-e2f9-4ec0-b4f6-78e16df0312a None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:16.421797 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6ecd4-e2f9-4ec0-b4f6-78e16df0312a None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:16.422267 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6ecd4-e2f9-4ec0-b4f6-78e16df0312a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:16.501384 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db6ecd4-e2f9-4ec0-b4f6-78e16df0312a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:16.503164 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db6ecd4-e2f9-4ec0-b4f6-78e16df0312a None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:16.548605 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa5d9a6-52c0-46e6-a540-90a6423897c9 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:16.591279 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094085db-d953-4a09-9911-3da7531962e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:16.592190 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094085db-d953-4a09-9911-3da7531962e9 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:16.592478 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094085db-d953-4a09-9911-3da7531962e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:16.592756 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094085db-d953-4a09-9911-3da7531962e9 None admin] PATH_INFO: `/v3/projects/f2feaca3faed4ec0a547bb377a6f494e` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:16.593952 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094085db-d953-4a09-9911-3da7531962e9 None admin] RBAC: Authorizing `identity:get_project(project_id=f2feaca3faed4ec0a547bb377a6f494e)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:16.595395 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094085db-d953-4a09-9911-3da7531962e9 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:16.597132 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 182/356] 10.222.0.24 () {56 vars in 1186 bytes} [Thu Apr 7 06:06:16 2022] GET /identity/v3/projects/f2feaca3faed4ec0a547bb377a6f494e => generated 298 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:16.597981 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094085db-d953-4a09-9911-3da7531962e9 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:16.636168 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 175/357] 10.222.0.24 () {58 vars in 1282 bytes} [Thu Apr 7 06:06:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 07 06:06:16.636168 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6ecd4-e2f9-4ec0-b4f6-78e16df0312a None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:16.706680 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094085db-d953-4a09-9911-3da7531962e9 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:16.740928 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6ecd4-e2f9-4ec0-b4f6-78e16df0312a None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:16.747111 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deea6d6b-c7b8-4d63-b04b-0753f1ecf8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:16.747794 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea6d6b-c7b8-4d63-b04b-0753f1ecf8ce None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:16.748081 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea6d6b-c7b8-4d63-b04b-0753f1ecf8ce None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:16.748787 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea6d6b-c7b8-4d63-b04b-0753f1ecf8ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:16.785531 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09e0f36-1c39-4bb3-a3fa-d455f894d501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:16.786355 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e0f36-1c39-4bb3-a3fa-d455f894d501 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:16.786641 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e0f36-1c39-4bb3-a3fa-d455f894d501 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:16.786912 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e0f36-1c39-4bb3-a3fa-d455f894d501 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:16.798329 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09e0f36-1c39-4bb3-a3fa-d455f894d501 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:06:16.806542 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-c09e0f36-1c39-4bb3-a3fa-d455f894d501 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 07 06:06:16.807780 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 176/358] 10.222.0.24 () {56 vars in 1114 bytes} [Thu Apr 7 06:06:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:16.809006 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dcccb5-eca7-47fe-a918-64a3d85bb9af None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:16.809289 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dcccb5-eca7-47fe-a918-64a3d85bb9af None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:16.809562 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dcccb5-eca7-47fe-a918-64a3d85bb9af None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:16.810823 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 177/359] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:06:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:06:16.811517 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dcccb5-eca7-47fe-a918-64a3d85bb9af None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:16.830710 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deea6d6b-c7b8-4d63-b04b-0753f1ecf8ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:16.832209 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deea6d6b-c7b8-4d63-b04b-0753f1ecf8ce None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:16.924619 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dcccb5-eca7-47fe-a918-64a3d85bb9af None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:16.949978 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 183/360] 10.222.0.24 () {58 vars in 1282 bytes} [Thu Apr 7 06:06:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 07 06:06:16.950839 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deea6d6b-c7b8-4d63-b04b-0753f1ecf8ce None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:16.960679 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b27c8a-f6f2-40c2-934e-fef437b67bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:16.962061 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b27c8a-f6f2-40c2-934e-fef437b67bab None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:16.962061 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b27c8a-f6f2-40c2-934e-fef437b67bab None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:16.962229 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b27c8a-f6f2-40c2-934e-fef437b67bab None admin] PATH_INFO: `/v3/groups/5e9d968f4dfa4f6ba105ccc5c511298a` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:16.968129 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b27c8a-f6f2-40c2-934e-fef437b67bab None admin] RBAC: Authorizing `identity:get_group(group_id=5e9d968f4dfa4f6ba105ccc5c511298a)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:16.969572 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b27c8a-f6f2-40c2-934e-fef437b67bab None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:16.971596 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 178/361] 10.222.0.24 () {56 vars in 1180 bytes} [Thu Apr 7 06:06:16 2022] GET /identity/v3/groups/5e9d968f4dfa4f6ba105ccc5c511298a => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:16.972404 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b27c8a-f6f2-40c2-934e-fef437b67bab None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:17.071624 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deea6d6b-c7b8-4d63-b04b-0753f1ecf8ce None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:17.085568 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b27c8a-f6f2-40c2-934e-fef437b67bab None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:17.111908 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83e3f32-9082-468e-949d-7e6d5ffbe2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:17.112783 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e3f32-9082-468e-949d-7e6d5ffbe2e6 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:17.113071 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e3f32-9082-468e-949d-7e6d5ffbe2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:17.113349 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e3f32-9082-468e-949d-7e6d5ffbe2e6 None admin] PATH_INFO: `/v3/projects/f2feaca3faed4ec0a547bb377a6f494e` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:17.114548 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83e3f32-9082-468e-949d-7e6d5ffbe2e6 None admin] RBAC: Authorizing `identity:get_project(project_id=f2feaca3faed4ec0a547bb377a6f494e)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:17.116550 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83e3f32-9082-468e-949d-7e6d5ffbe2e6 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:17.118438 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 184/362] 10.222.0.24 () {56 vars in 1186 bytes} [Thu Apr 7 06:06:16 2022] GET /identity/v3/projects/f2feaca3faed4ec0a547bb377a6f494e => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:17.119660 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c8f54-e730-4669-ac85-d2d00dc9d1b3 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:17.120043 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c8f54-e730-4669-ac85-d2d00dc9d1b3 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:17.120323 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c8f54-e730-4669-ac85-d2d00dc9d1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:17.126011 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c88dd0-89d0-42c4-945f-2a97c6c038d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:17.126954 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c88dd0-89d0-42c4-945f-2a97c6c038d1 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:17.127388 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c88dd0-89d0-42c4-945f-2a97c6c038d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:17.127889 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c88dd0-89d0-42c4-945f-2a97c6c038d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:17.128652 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c88dd0-89d0-42c4-945f-2a97c6c038d1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:17.128962 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c88dd0-89d0-42c4-945f-2a97c6c038d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:17.130335 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c88dd0-89d0-42c4-945f-2a97c6c038d1 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:17.142458 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 179/363] 10.222.0.24 () {56 vars in 1111 bytes} [Thu Apr 7 06:06:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:17.142458 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c88dd0-89d0-42c4-945f-2a97c6c038d1 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:17.142709 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-931c8f54-e730-4669-ac85-d2d00dc9d1b3 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:06:17.142709 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-931c8f54-e730-4669-ac85-d2d00dc9d1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:06:17.214988 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 185/364] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:06:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:06:17.215701 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931c8f54-e730-4669-ac85-d2d00dc9d1b3 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:17.243327 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c88dd0-89d0-42c4-945f-2a97c6c038d1 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:17.277461 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c973adb-6da5-4ee4-92de-e88c801031f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:17.278348 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c973adb-6da5-4ee4-92de-e88c801031f3 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:17.278631 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c973adb-6da5-4ee4-92de-e88c801031f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:17.278906 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c973adb-6da5-4ee4-92de-e88c801031f3 None admin] PATH_INFO: `/v3/projects/fc392bd6c8534b789823b148310d9370` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:17.280178 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c973adb-6da5-4ee4-92de-e88c801031f3 None admin] RBAC: Authorizing `identity:get_project(project_id=fc392bd6c8534b789823b148310d9370)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:17.281624 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c973adb-6da5-4ee4-92de-e88c801031f3 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:17.283329 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 180/365] 10.222.0.24 () {56 vars in 1186 bytes} [Thu Apr 7 06:06:17 2022] GET /identity/v3/projects/fc392bd6c8534b789823b148310d9370 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:17.284130 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c973adb-6da5-4ee4-92de-e88c801031f3 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:17.322596 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931c8f54-e730-4669-ac85-d2d00dc9d1b3 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:17.358576 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bbe622-d83b-428b-adc1-07878ed332b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:17.359246 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbe622-d83b-428b-adc1-07878ed332b8 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:17.359528 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbe622-d83b-428b-adc1-07878ed332b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:17.359834 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbe622-d83b-428b-adc1-07878ed332b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:17.360668 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bbe622-d83b-428b-adc1-07878ed332b8 None admin] RBAC: Adding query filter params (group.id=5e9d968f4dfa4f6ba105ccc5c511298a, role.id=7ad9776ea3b0430cb02c4599d037c8be, scope.project.id=f2feaca3faed4ec0a547bb377a6f494e) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:17.361080 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bbe622-d83b-428b-adc1-07878ed332b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:17.362467 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bbe622-d83b-428b-adc1-07878ed332b8 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:17.371878 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 186/366] 10.222.0.24 () {56 vars in 1376 bytes} [Thu Apr 7 06:06:17 2022] GET /identity/v3/role_assignments?group.id=5e9d968f4dfa4f6ba105ccc5c511298a&scope.project.id=f2feaca3faed4ec0a547bb377a6f494e&role.id=7ad9776ea3b0430cb02c4599d037c8be => generated 260 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:17.372732 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bbe622-d83b-428b-adc1-07878ed332b8 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:17.406167 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c973adb-6da5-4ee4-92de-e88c801031f3 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:17.455796 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0475be1d-9a20-4323-b67a-f201c3a980b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:17.457127 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0475be1d-9a20-4323-b67a-f201c3a980b5 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:17.457127 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0475be1d-9a20-4323-b67a-f201c3a980b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:17.457127 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0475be1d-9a20-4323-b67a-f201c3a980b5 None admin] PATH_INFO: `/v3/groups/5e9d968f4dfa4f6ba105ccc5c511298a` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:17.458616 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0475be1d-9a20-4323-b67a-f201c3a980b5 None admin] RBAC: Authorizing `identity:get_group(group_id=5e9d968f4dfa4f6ba105ccc5c511298a)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:17.460878 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0475be1d-9a20-4323-b67a-f201c3a980b5 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:17.462967 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 181/367] 10.222.0.24 () {56 vars in 1180 bytes} [Thu Apr 7 06:06:17 2022] GET /identity/v3/groups/5e9d968f4dfa4f6ba105ccc5c511298a => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:17.463973 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0475be1d-9a20-4323-b67a-f201c3a980b5 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:17.503838 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bbe622-d83b-428b-adc1-07878ed332b8 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:17.547901 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b73d1-df61-42ec-8d98-e84c09cff3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:17.548532 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b73d1-df61-42ec-8d98-e84c09cff3a7 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:17.548806 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b73d1-df61-42ec-8d98-e84c09cff3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:17.549075 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b73d1-df61-42ec-8d98-e84c09cff3a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:17.598062 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0475be1d-9a20-4323-b67a-f201c3a980b5 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:17.631873 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055b73d1-df61-42ec-8d98-e84c09cff3a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:17.633573 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055b73d1-df61-42ec-8d98-e84c09cff3a7 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:17.639114 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a1322-068c-4803-b1f1-fcdfb8705d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:17.640012 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a1322-068c-4803-b1f1-fcdfb8705d58 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:17.640302 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a1322-068c-4803-b1f1-fcdfb8705d58 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:17.640579 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a1322-068c-4803-b1f1-fcdfb8705d58 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:17.656589 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73a1322-068c-4803-b1f1-fcdfb8705d58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:06:17.666963 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-c73a1322-068c-4803-b1f1-fcdfb8705d58 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 07 06:06:17.669180 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 182/368] 10.222.0.24 () {56 vars in 1096 bytes} [Thu Apr 7 06:06:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:17.670127 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a1322-068c-4803-b1f1-fcdfb8705d58 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:17.746196 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 187/369] 10.222.0.24 () {58 vars in 1282 bytes} [Thu Apr 7 06:06:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 07 06:06:17.747054 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b73d1-df61-42ec-8d98-e84c09cff3a7 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:17.778893 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a1322-068c-4803-b1f1-fcdfb8705d58 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:17.811581 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c2c0a-fb29-49fd-9b12-736aba93b5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:17.812475 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c2c0a-fb29-49fd-9b12-736aba93b5ba None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:17.812762 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c2c0a-fb29-49fd-9b12-736aba93b5ba None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:17.813037 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c2c0a-fb29-49fd-9b12-736aba93b5ba None admin] PATH_INFO: `/v3/groups/5e9d968f4dfa4f6ba105ccc5c511298a` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:17.814212 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4c2c0a-fb29-49fd-9b12-736aba93b5ba None admin] RBAC: Authorizing `identity:get_group(group_id=5e9d968f4dfa4f6ba105ccc5c511298a)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:17.815646 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4c2c0a-fb29-49fd-9b12-736aba93b5ba None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:17.822335 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 183/370] 10.222.0.24 () {56 vars in 1180 bytes} [Thu Apr 7 06:06:17 2022] GET /identity/v3/groups/5e9d968f4dfa4f6ba105ccc5c511298a => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:17.822335 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c2c0a-fb29-49fd-9b12-736aba93b5ba None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:17.854479 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b73d1-df61-42ec-8d98-e84c09cff3a7 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:17.886392 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33427e63-3768-44c6-9baa-1f92eb879d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:17.887045 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33427e63-3768-44c6-9baa-1f92eb879d17 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:17.887323 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33427e63-3768-44c6-9baa-1f92eb879d17 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:17.887591 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33427e63-3768-44c6-9baa-1f92eb879d17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:17.888459 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33427e63-3768-44c6-9baa-1f92eb879d17 None admin] RBAC: Adding query filter params (group.id=5e9d968f4dfa4f6ba105ccc5c511298a, role.id=7abd6a5977df4ff4a5476c2d95a1934b, scope.project.id=f2feaca3faed4ec0a547bb377a6f494e) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:17.888766 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33427e63-3768-44c6-9baa-1f92eb879d17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:17.890174 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33427e63-3768-44c6-9baa-1f92eb879d17 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:17.895263 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 188/371] 10.222.0.24 () {56 vars in 1376 bytes} [Thu Apr 7 06:06:17 2022] GET /identity/v3/role_assignments?group.id=5e9d968f4dfa4f6ba105ccc5c511298a&scope.project.id=f2feaca3faed4ec0a547bb377a6f494e&role.id=7abd6a5977df4ff4a5476c2d95a1934b => generated 260 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:17.896061 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33427e63-3768-44c6-9baa-1f92eb879d17 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:17.938120 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c2c0a-fb29-49fd-9b12-736aba93b5ba None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:17.985546 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d97a4b6-0eab-40a3-b727-3374db901bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:17.986795 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97a4b6-0eab-40a3-b727-3374db901bab None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:17.987458 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97a4b6-0eab-40a3-b727-3374db901bab None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:17.987939 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97a4b6-0eab-40a3-b727-3374db901bab None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:17.989211 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d97a4b6-0eab-40a3-b727-3374db901bab None admin] RBAC: Adding query filter params (name=admin) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:17.989704 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d97a4b6-0eab-40a3-b727-3374db901bab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:17.992105 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d97a4b6-0eab-40a3-b727-3374db901bab None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:18.004159 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33427e63-3768-44c6-9baa-1f92eb879d17 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:18.009939 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 184/372] 10.222.0.24 () {56 vars in 1099 bytes} [Thu Apr 7 06:06:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:18.009939 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d97a4b6-0eab-40a3-b727-3374db901bab None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:18.046157 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7072de3-1a73-46ad-82b9-027e53c2eb79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:18.046967 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7072de3-1a73-46ad-82b9-027e53c2eb79 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:18.047246 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7072de3-1a73-46ad-82b9-027e53c2eb79 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:18.047515 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7072de3-1a73-46ad-82b9-027e53c2eb79 None admin] PATH_INFO: `/v3/projects/fc392bd6c8534b789823b148310d9370` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:18.048926 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7072de3-1a73-46ad-82b9-027e53c2eb79 None admin] RBAC: Authorizing `identity:get_project(project_id=fc392bd6c8534b789823b148310d9370)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:18.050401 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7072de3-1a73-46ad-82b9-027e53c2eb79 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:18.052467 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 189/373] 10.222.0.24 () {56 vars in 1186 bytes} [Thu Apr 7 06:06:17 2022] GET /identity/v3/projects/fc392bd6c8534b789823b148310d9370 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:18.053086 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7072de3-1a73-46ad-82b9-027e53c2eb79 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:18.131072 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d97a4b6-0eab-40a3-b727-3374db901bab None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:18.165816 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3332c6d-2ab5-4486-a6c9-719e52b5dca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:18.166480 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3332c6d-2ab5-4486-a6c9-719e52b5dca7 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:18.166767 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3332c6d-2ab5-4486-a6c9-719e52b5dca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:18.167045 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3332c6d-2ab5-4486-a6c9-719e52b5dca7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:18.167921 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3332c6d-2ab5-4486-a6c9-719e52b5dca7 None admin] RBAC: Adding query filter params (group.id=5e9d968f4dfa4f6ba105ccc5c511298a, role.id=7abd6a5977df4ff4a5476c2d95a1934b, scope.project.id=fc392bd6c8534b789823b148310d9370) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:18.168234 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3332c6d-2ab5-4486-a6c9-719e52b5dca7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:18.169671 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3332c6d-2ab5-4486-a6c9-719e52b5dca7 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:18.172784 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7072de3-1a73-46ad-82b9-027e53c2eb79 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:18.175459 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 185/374] 10.222.0.24 () {56 vars in 1376 bytes} [Thu Apr 7 06:06:18 2022] GET /identity/v3/role_assignments?group.id=5e9d968f4dfa4f6ba105ccc5c511298a&scope.project.id=fc392bd6c8534b789823b148310d9370&role.id=7abd6a5977df4ff4a5476c2d95a1934b => generated 260 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:18.176397 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3332c6d-2ab5-4486-a6c9-719e52b5dca7 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:18.210275 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af0777-4455-47c1-b994-a1cae42a5793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:18.210941 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af0777-4455-47c1-b994-a1cae42a5793 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:18.211223 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af0777-4455-47c1-b994-a1cae42a5793 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:18.211502 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af0777-4455-47c1-b994-a1cae42a5793 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:18.283969 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55af0777-4455-47c1-b994-a1cae42a5793 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:18.285499 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55af0777-4455-47c1-b994-a1cae42a5793 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:18.389785 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 190/375] 10.222.0.24 () {58 vars in 1282 bytes} [Thu Apr 7 06:06:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 07 06:06:18.395222 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af0777-4455-47c1-b994-a1cae42a5793 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:18.409413 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3332c6d-2ab5-4486-a6c9-719e52b5dca7 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:18.472313 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e7037d-2505-4462-a8d5-f991ddaa0b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:18.473522 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e7037d-2505-4462-a8d5-f991ddaa0b96 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:18.474009 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e7037d-2505-4462-a8d5-f991ddaa0b96 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:18.474506 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e7037d-2505-4462-a8d5-f991ddaa0b96 None admin] PATH_INFO: `/v3/groups/5e9d968f4dfa4f6ba105ccc5c511298a` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:18.475933 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e7037d-2505-4462-a8d5-f991ddaa0b96 None admin] RBAC: Authorizing `identity:get_group(group_id=5e9d968f4dfa4f6ba105ccc5c511298a)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:18.477617 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e7037d-2505-4462-a8d5-f991ddaa0b96 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:18.479969 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 186/376] 10.222.0.24 () {56 vars in 1180 bytes} [Thu Apr 7 06:06:18 2022] GET /identity/v3/groups/5e9d968f4dfa4f6ba105ccc5c511298a => generated 226 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:18.488742 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e7037d-2505-4462-a8d5-f991ddaa0b96 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:18.498756 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af0777-4455-47c1-b994-a1cae42a5793 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:18.541065 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c25f9-575a-490e-9977-631570c3dc03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:18.541936 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c25f9-575a-490e-9977-631570c3dc03 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:18.542220 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c25f9-575a-490e-9977-631570c3dc03 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:18.542490 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c25f9-575a-490e-9977-631570c3dc03 None admin] PATH_INFO: `/v3/projects/166c17adce104ad88442ca1e7dd22799` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:18.544987 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483c25f9-575a-490e-9977-631570c3dc03 None admin] RBAC: Authorizing `identity:get_project(project_id=166c17adce104ad88442ca1e7dd22799)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:18.547704 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483c25f9-575a-490e-9977-631570c3dc03 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:18.552667 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 191/377] 10.222.0.24 () {56 vars in 1186 bytes} [Thu Apr 7 06:06:18 2022] GET /identity/v3/projects/166c17adce104ad88442ca1e7dd22799 => generated 344 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:06:18.558889 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c25f9-575a-490e-9977-631570c3dc03 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:18.712970 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e7037d-2505-4462-a8d5-f991ddaa0b96 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:18.759683 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c25f9-575a-490e-9977-631570c3dc03 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:18.796704 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec05bee-1aff-4176-b7c4-7fbb5de10642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:18.798860 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec05bee-1aff-4176-b7c4-7fbb5de10642 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:18.799786 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec05bee-1aff-4176-b7c4-7fbb5de10642 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:18.800594 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec05bee-1aff-4176-b7c4-7fbb5de10642 None admin] PATH_INFO: `/v3/groups/b81b86431d7c470490318289a50b99df` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:18.802023 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd7de18-baa6-4925-9e64-a2d2a3e05e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:18.803440 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd7de18-baa6-4925-9e64-a2d2a3e05e72 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:18.804104 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd7de18-baa6-4925-9e64-a2d2a3e05e72 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:18.806036 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd7de18-baa6-4925-9e64-a2d2a3e05e72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:18.809134 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd7de18-baa6-4925-9e64-a2d2a3e05e72 None admin] RBAC: Adding query filter params (group.id=5e9d968f4dfa4f6ba105ccc5c511298a, role.id=7ad9776ea3b0430cb02c4599d037c8be, scope.project.id=fc392bd6c8534b789823b148310d9370) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:18.809707 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd7de18-baa6-4925-9e64-a2d2a3e05e72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:18.811375 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd7de18-baa6-4925-9e64-a2d2a3e05e72 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:18.817108 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec05bee-1aff-4176-b7c4-7fbb5de10642 None admin] RBAC: Authorizing `identity:get_group(group_id=b81b86431d7c470490318289a50b99df)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:18.818862 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec05bee-1aff-4176-b7c4-7fbb5de10642 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:18.822362 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 192/378] 10.222.0.24 () {56 vars in 1180 bytes} [Thu Apr 7 06:06:18 2022] GET /identity/v3/groups/b81b86431d7c470490318289a50b99df => generated 229 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:18.824982 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 187/379] 10.222.0.24 () {56 vars in 1376 bytes} [Thu Apr 7 06:06:18 2022] GET /identity/v3/role_assignments?group.id=5e9d968f4dfa4f6ba105ccc5c511298a&scope.project.id=fc392bd6c8534b789823b148310d9370&role.id=7ad9776ea3b0430cb02c4599d037c8be => generated 260 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:18.828242 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec05bee-1aff-4176-b7c4-7fbb5de10642 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:18.933076 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec05bee-1aff-4176-b7c4-7fbb5de10642 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:18.968258 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939d247b-8385-42e0-8db4-6a428175c680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:18.969317 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d247b-8385-42e0-8db4-6a428175c680 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:18.969807 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d247b-8385-42e0-8db4-6a428175c680 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:18.970281 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d247b-8385-42e0-8db4-6a428175c680 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:18.971357 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939d247b-8385-42e0-8db4-6a428175c680 None admin] RBAC: Adding query filter params (group.id=b81b86431d7c470490318289a50b99df, role.id=0fab680bc76f4a73826e9beb59e8129b, scope.project.id=166c17adce104ad88442ca1e7dd22799) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:18.971937 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939d247b-8385-42e0-8db4-6a428175c680 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:18.973671 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939d247b-8385-42e0-8db4-6a428175c680 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:18.980946 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 193/380] 10.222.0.24 () {56 vars in 1376 bytes} [Thu Apr 7 06:06:18 2022] GET /identity/v3/role_assignments?group.id=b81b86431d7c470490318289a50b99df&scope.project.id=166c17adce104ad88442ca1e7dd22799&role.id=0fab680bc76f4a73826e9beb59e8129b => generated 260 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:06:20.536758 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85141595-5013-4af2-a882-94b6400113a7 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:20.537273 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85141595-5013-4af2-a882-94b6400113a7 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:20.537391 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85141595-5013-4af2-a882-94b6400113a7 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:20.538790 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 188/381] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:06:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:06:20.544263 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa882c-388f-4592-a114-2c3870486d79 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:20.545047 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa882c-388f-4592-a114-2c3870486d79 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:20.545498 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa882c-388f-4592-a114-2c3870486d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:20.568931 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-fafa882c-388f-4592-a114-2c3870486d79 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:06:20.570633 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-fafa882c-388f-4592-a114-2c3870486d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:06:20.658557 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 194/382] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:06:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:06:20.689630 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85141595-5013-4af2-a882-94b6400113a7 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:20.817415 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85141595-5013-4af2-a882-94b6400113a7 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:20.861648 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad2d6d3-15d5-46b4-b089-1266ed111a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:20.862503 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2d6d3-15d5-46b4-b089-1266ed111a6c None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:20.862785 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2d6d3-15d5-46b4-b089-1266ed111a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:20.863059 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2d6d3-15d5-46b4-b089-1266ed111a6c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:20.880819 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad2d6d3-15d5-46b4-b089-1266ed111a6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:06:20.888857 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-bad2d6d3-15d5-46b4-b089-1266ed111a6c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 07 06:06:20.890275 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 189/383] 10.222.0.24 () {56 vars in 1114 bytes} [Thu Apr 7 06:06:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:20.896150 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa882c-388f-4592-a114-2c3870486d79 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:20.998901 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa882c-388f-4592-a114-2c3870486d79 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:21.032626 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9111e31-d9c2-4c4f-8542-50aa1293d1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:21.033561 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9111e31-d9c2-4c4f-8542-50aa1293d1a1 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:21.033989 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9111e31-d9c2-4c4f-8542-50aa1293d1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:21.034408 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9111e31-d9c2-4c4f-8542-50aa1293d1a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:21.035301 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9111e31-d9c2-4c4f-8542-50aa1293d1a1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:21.035787 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9111e31-d9c2-4c4f-8542-50aa1293d1a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:21.037282 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9111e31-d9c2-4c4f-8542-50aa1293d1a1 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:21.046487 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 195/384] 10.222.0.24 () {56 vars in 1111 bytes} [Thu Apr 7 06:06:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:21.052970 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9111e31-d9c2-4c4f-8542-50aa1293d1a1 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:21.053601 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f9d10-3b79-4a4b-b3d7-0e252de6efc2 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:21.054091 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f9d10-3b79-4a4b-b3d7-0e252de6efc2 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:21.054579 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f9d10-3b79-4a4b-b3d7-0e252de6efc2 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:21.056495 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 190/385] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:06:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:06:21.072990 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48edf581-a939-46e5-9764-deb2a6a0b6de None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:21.073555 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48edf581-a939-46e5-9764-deb2a6a0b6de None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:21.074027 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48edf581-a939-46e5-9764-deb2a6a0b6de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:21.100658 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-48edf581-a939-46e5-9764-deb2a6a0b6de None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:06:21.101885 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-48edf581-a939-46e5-9764-deb2a6a0b6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:06:21.209001 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 191/386] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:06:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 07 06:06:21.212457 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9111e31-d9c2-4c4f-8542-50aa1293d1a1 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:21.231736 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48edf581-a939-46e5-9764-deb2a6a0b6de None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:21.269481 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c054f8d-7b04-4248-9381-83a26e90f3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:21.270642 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c054f8d-7b04-4248-9381-83a26e90f3f9 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:21.271098 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c054f8d-7b04-4248-9381-83a26e90f3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:21.271541 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c054f8d-7b04-4248-9381-83a26e90f3f9 None admin] PATH_INFO: `/v3/groups/5e9d968f4dfa4f6ba105ccc5c511298a` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:21.274154 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c054f8d-7b04-4248-9381-83a26e90f3f9 None admin] RBAC: Authorizing `identity:get_group(group_id=5e9d968f4dfa4f6ba105ccc5c511298a)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:21.276520 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c054f8d-7b04-4248-9381-83a26e90f3f9 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:21.284490 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 196/387] 10.222.0.24 () {56 vars in 1180 bytes} [Thu Apr 7 06:06:21 2022] GET /identity/v3/groups/5e9d968f4dfa4f6ba105ccc5c511298a => generated 226 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:06:21.288362 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c054f8d-7b04-4248-9381-83a26e90f3f9 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:21.359015 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48edf581-a939-46e5-9764-deb2a6a0b6de None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:21.393963 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f551fe85-649f-4580-b60a-feb3b4c11196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:21.394767 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551fe85-649f-4580-b60a-feb3b4c11196 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:21.395053 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551fe85-649f-4580-b60a-feb3b4c11196 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:21.395325 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551fe85-649f-4580-b60a-feb3b4c11196 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:21.404957 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c054f8d-7b04-4248-9381-83a26e90f3f9 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:21.406224 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f551fe85-649f-4580-b60a-feb3b4c11196 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:06:21.413379 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-f551fe85-649f-4580-b60a-feb3b4c11196 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 07 06:06:21.414995 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 192/388] 10.222.0.24 () {56 vars in 1099 bytes} [Thu Apr 7 06:06:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 07 06:06:21.416270 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba14e7-20d4-4d7f-9866-279c92ab6cb8 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:21.416558 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba14e7-20d4-4d7f-9866-279c92ab6cb8 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:21.416834 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba14e7-20d4-4d7f-9866-279c92ab6cb8 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:21.418334 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 193/389] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:06:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:06:21.421187 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba14e7-20d4-4d7f-9866-279c92ab6cb8 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:21.447517 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf0ee0a-93d4-4abd-9054-7cda60133df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:21.448999 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0ee0a-93d4-4abd-9054-7cda60133df5 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:21.449294 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0ee0a-93d4-4abd-9054-7cda60133df5 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:21.449575 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0ee0a-93d4-4abd-9054-7cda60133df5 None admin] PATH_INFO: `/v3/projects/f2feaca3faed4ec0a547bb377a6f494e` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:21.450958 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf0ee0a-93d4-4abd-9054-7cda60133df5 None admin] RBAC: Authorizing `identity:get_project(project_id=f2feaca3faed4ec0a547bb377a6f494e)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:21.453057 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf0ee0a-93d4-4abd-9054-7cda60133df5 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:21.459826 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 197/390] 10.222.0.24 () {56 vars in 1186 bytes} [Thu Apr 7 06:06:21 2022] GET /identity/v3/projects/f2feaca3faed4ec0a547bb377a6f494e => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:06:21.459826 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b792c3-5aa2-4d17-8536-e650ec5829db None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:21.459826 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b792c3-5aa2-4d17-8536-e650ec5829db None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:21.459826 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b792c3-5aa2-4d17-8536-e650ec5829db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:21.478075 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-03b792c3-5aa2-4d17-8536-e650ec5829db None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:06:21.479542 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-03b792c3-5aa2-4d17-8536-e650ec5829db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:06:21.545107 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba14e7-20d4-4d7f-9866-279c92ab6cb8 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:21.549269 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 198/391] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:06:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:06:21.556945 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b792c3-5aa2-4d17-8536-e650ec5829db None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:21.579868 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385030cc-232c-4780-86af-95818f35a78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:21.580819 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385030cc-232c-4780-86af-95818f35a78e None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:21.581313 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385030cc-232c-4780-86af-95818f35a78e None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:21.581644 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385030cc-232c-4780-86af-95818f35a78e None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:21.582385 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385030cc-232c-4780-86af-95818f35a78e None admin] RBAC: Adding query filter params (name=member) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:21.582705 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385030cc-232c-4780-86af-95818f35a78e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:21.584083 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385030cc-232c-4780-86af-95818f35a78e None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:21.598638 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 194/392] 10.222.0.24 () {56 vars in 1101 bytes} [Thu Apr 7 06:06:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:21.599781 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d984d-bf98-433e-bd1f-6a4cf5fa655d None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:21.600069 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d984d-bf98-433e-bd1f-6a4cf5fa655d None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:21.600346 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d984d-bf98-433e-bd1f-6a4cf5fa655d None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:21.604057 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 195/393] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:06:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:06:21.604057 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d984d-bf98-433e-bd1f-6a4cf5fa655d None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:21.659969 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b792c3-5aa2-4d17-8536-e650ec5829db None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:21.692299 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a21000-5299-4dea-bf51-5edbfad8d2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:21.693207 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a21000-5299-4dea-bf51-5edbfad8d2da None admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:21.693490 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a21000-5299-4dea-bf51-5edbfad8d2da None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:21.693765 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a21000-5299-4dea-bf51-5edbfad8d2da None admin] PATH_INFO: `/v3/projects/f2feaca3faed4ec0a547bb377a6f494e/groups/5e9d968f4dfa4f6ba105ccc5c511298a/roles/7ad9776ea3b0430cb02c4599d037c8be` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:21.697038 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a21000-5299-4dea-bf51-5edbfad8d2da None admin] RBAC: Authorizing `identity:create_grant(project_id=f2feaca3faed4ec0a547bb377a6f494e, group_id=5e9d968f4dfa4f6ba105ccc5c511298a, role_id=7ad9776ea3b0430cb02c4599d037c8be)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:21.698532 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a21000-5299-4dea-bf51-5edbfad8d2da None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:21.710714 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d984d-bf98-433e-bd1f-6a4cf5fa655d None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:21.745207 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc80aa-a1d9-4f23-844c-0164fdbbf9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:21.746005 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc80aa-a1d9-4f23-844c-0164fdbbf9bb None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:21.746295 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc80aa-a1d9-4f23-844c-0164fdbbf9bb None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:21.746575 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc80aa-a1d9-4f23-844c-0164fdbbf9bb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:21.756443 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dc80aa-a1d9-4f23-844c-0164fdbbf9bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:06:21.764111 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-90dc80aa-a1d9-4f23-844c-0164fdbbf9bb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 07 06:06:21.765345 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 196/394] 10.222.0.24 () {56 vars in 1099 bytes} [Thu Apr 7 06:06:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:21.766129 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc80aa-a1d9-4f23-844c-0164fdbbf9bb None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:21.781819 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 199/395] 10.222.0.24 () {58 vars in 1442 bytes} [Thu Apr 7 06:06:21 2022] PUT /identity/v3/projects/f2feaca3faed4ec0a547bb377a6f494e/groups/5e9d968f4dfa4f6ba105ccc5c511298a/roles/7ad9776ea3b0430cb02c4599d037c8be => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:06:21.783410 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7907b8f-e823-41e8-8f3e-b4cb4d49886f None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:21.783812 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7907b8f-e823-41e8-8f3e-b4cb4d49886f None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:21.784163 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7907b8f-e823-41e8-8f3e-b4cb4d49886f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:21.802907 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-b7907b8f-e823-41e8-8f3e-b4cb4d49886f None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:06:21.804330 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b7907b8f-e823-41e8-8f3e-b4cb4d49886f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:06:21.886097 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 200/396] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:06:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:06:21.887436 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7907b8f-e823-41e8-8f3e-b4cb4d49886f None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:21.934919 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc80aa-a1d9-4f23-844c-0164fdbbf9bb None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:21.970708 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df9735-7ac2-46fe-a06b-3bf3a25b6af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:21.971704 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df9735-7ac2-46fe-a06b-3bf3a25b6af9 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:21.972017 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df9735-7ac2-46fe-a06b-3bf3a25b6af9 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:21.972290 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df9735-7ac2-46fe-a06b-3bf3a25b6af9 None admin] PATH_INFO: `/v3/groups/5e9d968f4dfa4f6ba105ccc5c511298a` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:21.973465 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57df9735-7ac2-46fe-a06b-3bf3a25b6af9 None admin] RBAC: Authorizing `identity:get_group(group_id=5e9d968f4dfa4f6ba105ccc5c511298a)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:21.974917 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57df9735-7ac2-46fe-a06b-3bf3a25b6af9 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:21.976947 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 197/397] 10.222.0.24 () {56 vars in 1180 bytes} [Thu Apr 7 06:06:21 2022] GET /identity/v3/groups/5e9d968f4dfa4f6ba105ccc5c511298a => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:21.978269 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df9735-7ac2-46fe-a06b-3bf3a25b6af9 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:22.018313 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7907b8f-e823-41e8-8f3e-b4cb4d49886f None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:22.062110 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abe1b92-803e-4828-b3d0-8270fb5dc72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:22.062789 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe1b92-803e-4828-b3d0-8270fb5dc72e None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:22.063073 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe1b92-803e-4828-b3d0-8270fb5dc72e None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:22.063348 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe1b92-803e-4828-b3d0-8270fb5dc72e None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:22.064129 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abe1b92-803e-4828-b3d0-8270fb5dc72e None admin] RBAC: Adding query filter params (name=member) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:22.064433 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abe1b92-803e-4828-b3d0-8270fb5dc72e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:22.065793 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abe1b92-803e-4828-b3d0-8270fb5dc72e None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:22.074354 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 201/398] 10.222.0.24 () {56 vars in 1101 bytes} [Thu Apr 7 06:06:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:22.075244 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abe1b92-803e-4828-b3d0-8270fb5dc72e None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:22.084213 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df9735-7ac2-46fe-a06b-3bf3a25b6af9 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:22.117177 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79887929-c6c8-43ca-a462-efd0c38ed677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:22.118018 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79887929-c6c8-43ca-a462-efd0c38ed677 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:22.118305 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79887929-c6c8-43ca-a462-efd0c38ed677 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:22.118579 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79887929-c6c8-43ca-a462-efd0c38ed677 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:22.128383 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79887929-c6c8-43ca-a462-efd0c38ed677 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:06:22.135654 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-79887929-c6c8-43ca-a462-efd0c38ed677 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 07 06:06:22.137054 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 198/399] 10.222.0.24 () {56 vars in 1114 bytes} [Thu Apr 7 06:06:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:22.138108 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3cf87-0311-4023-8337-05bb132c07cb None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:22.138397 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3cf87-0311-4023-8337-05bb132c07cb None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:22.138672 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3cf87-0311-4023-8337-05bb132c07cb None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:22.139934 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 199/400] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:06:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:06:22.140622 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e3cf87-0311-4023-8337-05bb132c07cb None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:22.179574 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abe1b92-803e-4828-b3d0-8270fb5dc72e None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:22.214835 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743104f-0c27-4d06-8f0a-9103fb984f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:22.215624 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743104f-0c27-4d06-8f0a-9103fb984f0a None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:22.215943 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743104f-0c27-4d06-8f0a-9103fb984f0a None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:22.216220 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743104f-0c27-4d06-8f0a-9103fb984f0a None admin] PATH_INFO: `/v3/projects/f2feaca3faed4ec0a547bb377a6f494e` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:22.217417 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8743104f-0c27-4d06-8f0a-9103fb984f0a None admin] RBAC: Authorizing `identity:get_project(project_id=f2feaca3faed4ec0a547bb377a6f494e)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:22.218840 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8743104f-0c27-4d06-8f0a-9103fb984f0a None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:22.225028 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 202/401] 10.222.0.24 () {56 vars in 1186 bytes} [Thu Apr 7 06:06:22 2022] GET /identity/v3/projects/f2feaca3faed4ec0a547bb377a6f494e => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:22.225028 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743104f-0c27-4d06-8f0a-9103fb984f0a None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:22.250978 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e3cf87-0311-4023-8337-05bb132c07cb None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:22.283210 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104dee91-ae30-478c-b8bf-449a66962050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:22.284091 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104dee91-ae30-478c-b8bf-449a66962050 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:22.284383 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104dee91-ae30-478c-b8bf-449a66962050 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:22.284660 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104dee91-ae30-478c-b8bf-449a66962050 None admin] PATH_INFO: `/v3/groups/5e9d968f4dfa4f6ba105ccc5c511298a` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:22.285823 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104dee91-ae30-478c-b8bf-449a66962050 None admin] RBAC: Authorizing `identity:get_group(group_id=5e9d968f4dfa4f6ba105ccc5c511298a)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:22.287270 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104dee91-ae30-478c-b8bf-449a66962050 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:22.289255 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 200/402] 10.222.0.24 () {56 vars in 1180 bytes} [Thu Apr 7 06:06:22 2022] GET /identity/v3/groups/5e9d968f4dfa4f6ba105ccc5c511298a => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:22.290518 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b2133-303f-4263-9353-14d408ae3a77 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:22.290811 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b2133-303f-4263-9353-14d408ae3a77 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:22.291089 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b2133-303f-4263-9353-14d408ae3a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:22.307177 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-bb9b2133-303f-4263-9353-14d408ae3a77 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:06:22.308372 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-bb9b2133-303f-4263-9353-14d408ae3a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:06:22.323731 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743104f-0c27-4d06-8f0a-9103fb984f0a None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:22.356298 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a72679-88b4-448c-ba1b-4df68f164aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:22.356968 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a72679-88b4-448c-ba1b-4df68f164aa0 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:22.357255 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a72679-88b4-448c-ba1b-4df68f164aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:22.357536 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a72679-88b4-448c-ba1b-4df68f164aa0 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:22.358311 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a72679-88b4-448c-ba1b-4df68f164aa0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:22.358617 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a72679-88b4-448c-ba1b-4df68f164aa0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:22.360001 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a72679-88b4-448c-ba1b-4df68f164aa0 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:22.367920 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 203/403] 10.222.0.24 () {56 vars in 1111 bytes} [Thu Apr 7 06:06:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:22.368612 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a72679-88b4-448c-ba1b-4df68f164aa0 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:22.378040 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 201/404] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:06:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:06:22.388646 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b2133-303f-4263-9353-14d408ae3a77 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:22.464523 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a72679-88b4-448c-ba1b-4df68f164aa0 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:22.487703 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b2133-303f-4263-9353-14d408ae3a77 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:22.497083 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e933c-d496-4308-bfb2-8e5a8455c21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:22.497975 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e933c-d496-4308-bfb2-8e5a8455c21c None admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:22.498261 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e933c-d496-4308-bfb2-8e5a8455c21c None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:22.498536 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e933c-d496-4308-bfb2-8e5a8455c21c None admin] PATH_INFO: `/v3/projects/f2feaca3faed4ec0a547bb377a6f494e/groups/5e9d968f4dfa4f6ba105ccc5c511298a/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:22.501974 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e933c-d496-4308-bfb2-8e5a8455c21c None admin] RBAC: Authorizing `identity:create_grant(project_id=f2feaca3faed4ec0a547bb377a6f494e, group_id=5e9d968f4dfa4f6ba105ccc5c511298a, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:22.501974 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e933c-d496-4308-bfb2-8e5a8455c21c None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:22.527625 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fede4a-2202-4289-8572-0c561afa04c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:22.528520 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fede4a-2202-4289-8572-0c561afa04c5 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:22.529066 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fede4a-2202-4289-8572-0c561afa04c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:22.529150 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fede4a-2202-4289-8572-0c561afa04c5 None admin] PATH_INFO: `/v3/projects/fc392bd6c8534b789823b148310d9370` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:22.530384 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fede4a-2202-4289-8572-0c561afa04c5 None admin] RBAC: Authorizing `identity:get_project(project_id=fc392bd6c8534b789823b148310d9370)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:22.531843 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fede4a-2202-4289-8572-0c561afa04c5 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:22.533684 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 202/405] 10.222.0.24 () {56 vars in 1186 bytes} [Thu Apr 7 06:06:22 2022] GET /identity/v3/projects/fc392bd6c8534b789823b148310d9370 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:22.534368 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fede4a-2202-4289-8572-0c561afa04c5 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:22.595787 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 204/406] 10.222.0.24 () {58 vars in 1442 bytes} [Thu Apr 7 06:06:22 2022] PUT /identity/v3/projects/f2feaca3faed4ec0a547bb377a6f494e/groups/5e9d968f4dfa4f6ba105ccc5c511298a/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:06:22.595787 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e933c-d496-4308-bfb2-8e5a8455c21c None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:22.638271 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fede4a-2202-4289-8572-0c561afa04c5 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:22.682715 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a616d-5ce0-4737-b542-77f36e923490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:22.684001 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a616d-5ce0-4737-b542-77f36e923490 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:22.684290 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a616d-5ce0-4737-b542-77f36e923490 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:22.684573 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a616d-5ce0-4737-b542-77f36e923490 None admin] PATH_INFO: `/v3/groups/5e9d968f4dfa4f6ba105ccc5c511298a` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:22.685865 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3a616d-5ce0-4737-b542-77f36e923490 None admin] RBAC: Authorizing `identity:get_group(group_id=5e9d968f4dfa4f6ba105ccc5c511298a)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:22.688206 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3a616d-5ce0-4737-b542-77f36e923490 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:22.690530 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 203/407] 10.222.0.24 () {56 vars in 1180 bytes} [Thu Apr 7 06:06:22 2022] GET /identity/v3/groups/5e9d968f4dfa4f6ba105ccc5c511298a => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:22.691332 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a616d-5ce0-4737-b542-77f36e923490 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:22.708326 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e933c-d496-4308-bfb2-8e5a8455c21c None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:22.745588 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e368c-ddb7-4b72-9370-dcbc1f1597b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:22.746410 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e368c-ddb7-4b72-9370-dcbc1f1597b8 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:22.746700 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e368c-ddb7-4b72-9370-dcbc1f1597b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:22.747098 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e368c-ddb7-4b72-9370-dcbc1f1597b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:22.759228 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e368c-ddb7-4b72-9370-dcbc1f1597b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:06:22.769399 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-ff4e368c-ddb7-4b72-9370-dcbc1f1597b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 07 06:06:22.771046 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 205/408] 10.222.0.24 () {56 vars in 1096 bytes} [Thu Apr 7 06:06:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:22.771965 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e368c-ddb7-4b72-9370-dcbc1f1597b8 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:22.805385 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a616d-5ce0-4737-b542-77f36e923490 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:22.853710 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70e4913-bbd0-47c8-949e-e74aeec8d4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:22.854938 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e4913-bbd0-47c8-949e-e74aeec8d4e6 None admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:22.855398 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e4913-bbd0-47c8-949e-e74aeec8d4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:22.855912 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e4913-bbd0-47c8-949e-e74aeec8d4e6 None admin] PATH_INFO: `/v3/projects/fc392bd6c8534b789823b148310d9370/groups/5e9d968f4dfa4f6ba105ccc5c511298a/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:22.858121 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70e4913-bbd0-47c8-949e-e74aeec8d4e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=fc392bd6c8534b789823b148310d9370, group_id=5e9d968f4dfa4f6ba105ccc5c511298a, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:22.859826 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70e4913-bbd0-47c8-949e-e74aeec8d4e6 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:22.888416 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e368c-ddb7-4b72-9370-dcbc1f1597b8 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:22.922282 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cd78e5-bbf0-47dc-8fba-810d81a82549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:22.923156 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd78e5-bbf0-47dc-8fba-810d81a82549 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:22.923441 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd78e5-bbf0-47dc-8fba-810d81a82549 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:22.923719 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd78e5-bbf0-47dc-8fba-810d81a82549 None admin] PATH_INFO: `/v3/projects/fc392bd6c8534b789823b148310d9370` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:22.925042 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cd78e5-bbf0-47dc-8fba-810d81a82549 None admin] RBAC: Authorizing `identity:get_project(project_id=fc392bd6c8534b789823b148310d9370)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:22.926545 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cd78e5-bbf0-47dc-8fba-810d81a82549 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:22.928263 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 206/409] 10.222.0.24 () {56 vars in 1186 bytes} [Thu Apr 7 06:06:22 2022] GET /identity/v3/projects/fc392bd6c8534b789823b148310d9370 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:22.929031 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cd78e5-bbf0-47dc-8fba-810d81a82549 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:22.987783 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 204/410] 10.222.0.24 () {58 vars in 1442 bytes} [Thu Apr 7 06:06:22 2022] PUT /identity/v3/projects/fc392bd6c8534b789823b148310d9370/groups/5e9d968f4dfa4f6ba105ccc5c511298a/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:06:22.987783 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70e4913-bbd0-47c8-949e-e74aeec8d4e6 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:23.094657 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cd78e5-bbf0-47dc-8fba-810d81a82549 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:23.168568 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603d93f-ed30-4b06-afe3-03d373962314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:23.169258 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603d93f-ed30-4b06-afe3-03d373962314 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:23.169542 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603d93f-ed30-4b06-afe3-03d373962314 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:23.169816 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603d93f-ed30-4b06-afe3-03d373962314 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:23.170591 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4603d93f-ed30-4b06-afe3-03d373962314 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:23.170897 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4603d93f-ed30-4b06-afe3-03d373962314 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:23.172314 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4603d93f-ed30-4b06-afe3-03d373962314 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:23.187733 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 207/411] 10.222.0.24 () {56 vars in 1099 bytes} [Thu Apr 7 06:06:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:23.190549 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70e4913-bbd0-47c8-949e-e74aeec8d4e6 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:23.194990 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603d93f-ed30-4b06-afe3-03d373962314 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:23.234678 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f3b625-f46b-4de1-9e91-83c3cc6f6c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:23.235937 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f3b625-f46b-4de1-9e91-83c3cc6f6c6e None admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:23.236437 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f3b625-f46b-4de1-9e91-83c3cc6f6c6e None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:23.236901 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f3b625-f46b-4de1-9e91-83c3cc6f6c6e None admin] PATH_INFO: `/v3/projects/fc392bd6c8534b789823b148310d9370/groups/5e9d968f4dfa4f6ba105ccc5c511298a/roles/7ad9776ea3b0430cb02c4599d037c8be` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:23.239385 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f3b625-f46b-4de1-9e91-83c3cc6f6c6e None admin] RBAC: Authorizing `identity:create_grant(project_id=fc392bd6c8534b789823b148310d9370, group_id=5e9d968f4dfa4f6ba105ccc5c511298a, role_id=7ad9776ea3b0430cb02c4599d037c8be)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:23.241307 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f3b625-f46b-4de1-9e91-83c3cc6f6c6e None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:23.309785 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603d93f-ed30-4b06-afe3-03d373962314 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:23.336321 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 205/412] 10.222.0.24 () {58 vars in 1442 bytes} [Thu Apr 7 06:06:22 2022] PUT /identity/v3/projects/fc392bd6c8534b789823b148310d9370/groups/5e9d968f4dfa4f6ba105ccc5c511298a/roles/7ad9776ea3b0430cb02c4599d037c8be => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:06:23.355289 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b89194b-270b-447d-82fa-8eb5e1e4d7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:23.356548 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89194b-270b-447d-82fa-8eb5e1e4d7eb None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:23.357089 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89194b-270b-447d-82fa-8eb5e1e4d7eb None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:23.357602 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89194b-270b-447d-82fa-8eb5e1e4d7eb None admin] PATH_INFO: `/v3/groups/b81b86431d7c470490318289a50b99df` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:23.359032 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b89194b-270b-447d-82fa-8eb5e1e4d7eb None admin] RBAC: Authorizing `identity:get_group(group_id=b81b86431d7c470490318289a50b99df)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:23.360757 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b89194b-270b-447d-82fa-8eb5e1e4d7eb None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:23.363002 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 208/413] 10.222.0.24 () {56 vars in 1180 bytes} [Thu Apr 7 06:06:23 2022] GET /identity/v3/groups/b81b86431d7c470490318289a50b99df => generated 229 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:23.368949 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f3b625-f46b-4de1-9e91-83c3cc6f6c6e None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:23.494070 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f3b625-f46b-4de1-9e91-83c3cc6f6c6e None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:23.533399 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445ad99-2535-4866-b78d-55b4d08776c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:23.534647 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445ad99-2535-4866-b78d-55b4d08776c4 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:23.535145 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445ad99-2535-4866-b78d-55b4d08776c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:23.535645 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445ad99-2535-4866-b78d-55b4d08776c4 None admin] PATH_INFO: `/v3/projects/166c17adce104ad88442ca1e7dd22799` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:23.537186 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5445ad99-2535-4866-b78d-55b4d08776c4 None admin] RBAC: Authorizing `identity:get_project(project_id=166c17adce104ad88442ca1e7dd22799)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:23.538811 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5445ad99-2535-4866-b78d-55b4d08776c4 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:23.541636 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 206/414] 10.222.0.24 () {56 vars in 1186 bytes} [Thu Apr 7 06:06:23 2022] GET /identity/v3/projects/166c17adce104ad88442ca1e7dd22799 => generated 344 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:23.548798 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b89194b-270b-447d-82fa-8eb5e1e4d7eb None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:23.660135 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b89194b-270b-447d-82fa-8eb5e1e4d7eb None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:23.694943 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa79ed-44ec-4f64-9690-26cdaf024cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:23.696333 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa79ed-44ec-4f64-9690-26cdaf024cf2 None admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:23.696816 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa79ed-44ec-4f64-9690-26cdaf024cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:23.697375 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa79ed-44ec-4f64-9690-26cdaf024cf2 None admin] PATH_INFO: `/v3/projects/166c17adce104ad88442ca1e7dd22799/groups/b81b86431d7c470490318289a50b99df/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:23.699521 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffa79ed-44ec-4f64-9690-26cdaf024cf2 None admin] RBAC: Authorizing `identity:create_grant(project_id=166c17adce104ad88442ca1e7dd22799, group_id=b81b86431d7c470490318289a50b99df, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:23.701254 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffa79ed-44ec-4f64-9690-26cdaf024cf2 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:23.793071 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 209/415] 10.222.0.24 () {58 vars in 1442 bytes} [Thu Apr 7 06:06:23 2022] PUT /identity/v3/projects/166c17adce104ad88442ca1e7dd22799/groups/b81b86431d7c470490318289a50b99df/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:06:24.507145 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ff236-116e-46ee-bdd3-e9d5ca012a1d None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:24.508183 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ff236-116e-46ee-bdd3-e9d5ca012a1d None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:24.508761 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ff236-116e-46ee-bdd3-e9d5ca012a1d None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:24.510637 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 207/416] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:06:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:06:24.515455 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ebce4-0481-4ae4-a9b1-f01bdb59dfb0 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:24.515996 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ebce4-0481-4ae4-a9b1-f01bdb59dfb0 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:24.516471 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ebce4-0481-4ae4-a9b1-f01bdb59dfb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:24.537744 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-639ebce4-0481-4ae4-a9b1-f01bdb59dfb0 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:06:24.539172 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-639ebce4-0481-4ae4-a9b1-f01bdb59dfb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:06:24.607432 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 210/417] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:06:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:06:24.640290 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ff236-116e-46ee-bdd3-e9d5ca012a1d None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:24.776593 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ff236-116e-46ee-bdd3-e9d5ca012a1d None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:24.822811 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80e0027-9570-4f28-a43f-3a4b95863466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:24.824053 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e0027-9570-4f28-a43f-3a4b95863466 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:24.824563 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e0027-9570-4f28-a43f-3a4b95863466 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:24.825037 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e0027-9570-4f28-a43f-3a4b95863466 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:24.843035 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80e0027-9570-4f28-a43f-3a4b95863466 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:06:24.851010 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-b80e0027-9570-4f28-a43f-3a4b95863466 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 07 06:06:24.853577 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 208/418] 10.222.0.24 () {56 vars in 1114 bytes} [Thu Apr 7 06:06:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:24.859076 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ebce4-0481-4ae4-a9b1-f01bdb59dfb0 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:24.958521 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ebce4-0481-4ae4-a9b1-f01bdb59dfb0 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:24.993711 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c481ff3f-8785-4671-afcc-0b4b9e01154e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:24.994726 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481ff3f-8785-4671-afcc-0b4b9e01154e None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:24.995223 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481ff3f-8785-4671-afcc-0b4b9e01154e None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:24.995777 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481ff3f-8785-4671-afcc-0b4b9e01154e None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:24.996753 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c481ff3f-8785-4671-afcc-0b4b9e01154e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:24.997309 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c481ff3f-8785-4671-afcc-0b4b9e01154e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:24.998914 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c481ff3f-8785-4671-afcc-0b4b9e01154e None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:25.007635 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 211/419] 10.222.0.24 () {56 vars in 1111 bytes} [Thu Apr 7 06:06:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:25.012927 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80e0027-9570-4f28-a43f-3a4b95863466 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:25.135269 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80e0027-9570-4f28-a43f-3a4b95863466 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:25.180173 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8335b6a-113b-4f08-a81b-021e42869a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:25.181818 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8335b6a-113b-4f08-a81b-021e42869a00 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:25.182297 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8335b6a-113b-4f08-a81b-021e42869a00 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:25.182783 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8335b6a-113b-4f08-a81b-021e42869a00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:25.275177 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8335b6a-113b-4f08-a81b-021e42869a00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:25.277025 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8335b6a-113b-4f08-a81b-021e42869a00 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:25.397312 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178113a6-d4a2-485c-8220-134edecbc48e None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:25.397915 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178113a6-d4a2-485c-8220-134edecbc48e None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:25.398404 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178113a6-d4a2-485c-8220-134edecbc48e None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:25.400317 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 209/421] 10.222.0.24 () {58 vars in 1282 bytes} [Thu Apr 7 06:06:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 07 06:06:25.400531 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 212/421] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:06:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:06:25.405645 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8335b6a-113b-4f08-a81b-021e42869a00 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:25.409527 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae004f-c130-437c-b6f0-c90d7b55ca59 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:25.409818 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae004f-c130-437c-b6f0-c90d7b55ca59 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:25.410100 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae004f-c130-437c-b6f0-c90d7b55ca59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:25.438552 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-8aae004f-c130-437c-b6f0-c90d7b55ca59 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:06:25.439755 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-8aae004f-c130-437c-b6f0-c90d7b55ca59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:06:25.553167 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8335b6a-113b-4f08-a81b-021e42869a00 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:25.569117 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 213/422] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:06:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 07 06:06:25.587393 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2776c6f-07a0-4df8-b410-16425dbd7e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:25.588287 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2776c6f-07a0-4df8-b410-16425dbd7e43 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:25.588575 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2776c6f-07a0-4df8-b410-16425dbd7e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:25.588849 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2776c6f-07a0-4df8-b410-16425dbd7e43 None admin] PATH_INFO: `/v3/projects/f2feaca3faed4ec0a547bb377a6f494e` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:25.590055 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2776c6f-07a0-4df8-b410-16425dbd7e43 None admin] RBAC: Authorizing `identity:get_project(project_id=f2feaca3faed4ec0a547bb377a6f494e)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:25.591501 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2776c6f-07a0-4df8-b410-16425dbd7e43 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:25.593380 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 210/423] 10.222.0.24 () {56 vars in 1186 bytes} [Thu Apr 7 06:06:25 2022] GET /identity/v3/projects/f2feaca3faed4ec0a547bb377a6f494e => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:25.598650 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aae004f-c130-437c-b6f0-c90d7b55ca59 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:25.611217 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2776c6f-07a0-4df8-b410-16425dbd7e43 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:25.714263 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2776c6f-07a0-4df8-b410-16425dbd7e43 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:25.723546 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aae004f-c130-437c-b6f0-c90d7b55ca59 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:25.750048 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d0faee-9e3b-4495-b43e-f248bb169f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:25.750852 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d0faee-9e3b-4495-b43e-f248bb169f85 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:25.751141 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d0faee-9e3b-4495-b43e-f248bb169f85 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:25.751421 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d0faee-9e3b-4495-b43e-f248bb169f85 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:25.762019 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d0faee-9e3b-4495-b43e-f248bb169f85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:06:25.769484 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-f0d0faee-9e3b-4495-b43e-f248bb169f85 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 07 06:06:25.770615 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 211/424] 10.222.0.24 () {56 vars in 1099 bytes} [Thu Apr 7 06:06:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 07 06:06:25.775902 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef07a8-eb1a-42ce-a97c-ce4a779a0b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:25.776677 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d0faee-9e3b-4495-b43e-f248bb169f85 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:25.776785 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef07a8-eb1a-42ce-a97c-ce4a779a0b48 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:25.777059 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef07a8-eb1a-42ce-a97c-ce4a779a0b48 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:25.777333 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef07a8-eb1a-42ce-a97c-ce4a779a0b48 None admin] PATH_INFO: `/v3/groups/5e9d968f4dfa4f6ba105ccc5c511298a` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:25.784494 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ef07a8-eb1a-42ce-a97c-ce4a779a0b48 None admin] RBAC: Authorizing `identity:get_group(group_id=5e9d968f4dfa4f6ba105ccc5c511298a)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:25.785957 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ef07a8-eb1a-42ce-a97c-ce4a779a0b48 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:25.787616 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 214/425] 10.222.0.24 () {56 vars in 1180 bytes} [Thu Apr 7 06:06:25 2022] GET /identity/v3/groups/5e9d968f4dfa4f6ba105ccc5c511298a => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:25.793562 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef07a8-eb1a-42ce-a97c-ce4a779a0b48 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:25.879778 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d0faee-9e3b-4495-b43e-f248bb169f85 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:25.915515 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e887329f-b960-4196-bcb4-e9f8987fc5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:25.916559 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e887329f-b960-4196-bcb4-e9f8987fc5d7 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:25.917029 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e887329f-b960-4196-bcb4-e9f8987fc5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:25.917485 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e887329f-b960-4196-bcb4-e9f8987fc5d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:25.918439 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e887329f-b960-4196-bcb4-e9f8987fc5d7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:25.918954 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e887329f-b960-4196-bcb4-e9f8987fc5d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:25.920549 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e887329f-b960-4196-bcb4-e9f8987fc5d7 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:25.930772 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 212/426] 10.222.0.24 () {56 vars in 1101 bytes} [Thu Apr 7 06:06:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:06:25.938378 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e887329f-b960-4196-bcb4-e9f8987fc5d7 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:25.991859 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef07a8-eb1a-42ce-a97c-ce4a779a0b48 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:26.026555 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83dad46-7167-4cfb-8092-018d01ce27c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:26.027219 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83dad46-7167-4cfb-8092-018d01ce27c9 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:26.027503 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83dad46-7167-4cfb-8092-018d01ce27c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:26.027799 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83dad46-7167-4cfb-8092-018d01ce27c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:26.028637 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83dad46-7167-4cfb-8092-018d01ce27c9 None admin] RBAC: Adding query filter params (group.id=5e9d968f4dfa4f6ba105ccc5c511298a, role.id=7ad9776ea3b0430cb02c4599d037c8be, scope.project.id=f2feaca3faed4ec0a547bb377a6f494e) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:26.028946 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83dad46-7167-4cfb-8092-018d01ce27c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:26.030375 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83dad46-7167-4cfb-8092-018d01ce27c9 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:26.036562 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 215/427] 10.222.0.24 () {56 vars in 1376 bytes} [Thu Apr 7 06:06:25 2022] GET /identity/v3/role_assignments?group.id=5e9d968f4dfa4f6ba105ccc5c511298a&scope.project.id=f2feaca3faed4ec0a547bb377a6f494e&role.id=7ad9776ea3b0430cb02c4599d037c8be => generated 611 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:26.037905 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3976d-dc72-42b1-8f98-cca1f03eef4a None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:26.038194 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3976d-dc72-42b1-8f98-cca1f03eef4a None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:26.038474 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3976d-dc72-42b1-8f98-cca1f03eef4a None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:26.044078 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 216/428] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:06:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:06:26.045991 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4382ac-35a8-48d6-a432-2bd578765b26 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:26.046349 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4382ac-35a8-48d6-a432-2bd578765b26 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:26.046702 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4382ac-35a8-48d6-a432-2bd578765b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:26.056706 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e887329f-b960-4196-bcb4-e9f8987fc5d7 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:26.065184 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-9b4382ac-35a8-48d6-a432-2bd578765b26 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:06:26.066411 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-9b4382ac-35a8-48d6-a432-2bd578765b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:06:26.105567 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08674187-12e7-40f0-a100-21980aa9bfa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:26.106242 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08674187-12e7-40f0-a100-21980aa9bfa6 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:26.106530 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08674187-12e7-40f0-a100-21980aa9bfa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:26.106808 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08674187-12e7-40f0-a100-21980aa9bfa6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:26.143926 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 217/429] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:06:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:06:26.166120 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4382ac-35a8-48d6-a432-2bd578765b26 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:26.251885 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08674187-12e7-40f0-a100-21980aa9bfa6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:26.256501 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08674187-12e7-40f0-a100-21980aa9bfa6 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:26.278379 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4382ac-35a8-48d6-a432-2bd578765b26 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:26.316713 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f6ee7d-8564-4d7d-96cc-88574285da4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:26.317953 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6ee7d-8564-4d7d-96cc-88574285da4f None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:26.318441 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6ee7d-8564-4d7d-96cc-88574285da4f None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:26.318979 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6ee7d-8564-4d7d-96cc-88574285da4f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:26.330377 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f6ee7d-8564-4d7d-96cc-88574285da4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:06:26.338003 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-43f6ee7d-8564-4d7d-96cc-88574285da4f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 07 06:06:26.339345 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 218/430] 10.222.0.24 () {56 vars in 1099 bytes} [Thu Apr 7 06:06:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:26.340660 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bbd868-099f-4862-a6d9-2d09c52562b9 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:26.340952 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bbd868-099f-4862-a6d9-2d09c52562b9 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:26.341232 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bbd868-099f-4862-a6d9-2d09c52562b9 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:26.342765 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 219/431] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:06:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:06:26.346654 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bbd868-099f-4862-a6d9-2d09c52562b9 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:26.369866 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 213/432] 10.222.0.24 () {58 vars in 1282 bytes} [Thu Apr 7 06:06:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 07 06:06:26.371309 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999c36f-86d4-4e17-9c9d-b22f3b7fac4e None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:26.371601 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999c36f-86d4-4e17-9c9d-b22f3b7fac4e None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:26.371904 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999c36f-86d4-4e17-9c9d-b22f3b7fac4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:26.392379 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-0999c36f-86d4-4e17-9c9d-b22f3b7fac4e None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:06:26.393279 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-0999c36f-86d4-4e17-9c9d-b22f3b7fac4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:06:26.463901 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bbd868-099f-4862-a6d9-2d09c52562b9 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:26.467965 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 214/433] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:06:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:06:26.467965 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0999c36f-86d4-4e17-9c9d-b22f3b7fac4e None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:26.504452 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e065ce29-c59f-481f-ad62-bd910bee3cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:26.505048 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065ce29-c59f-481f-ad62-bd910bee3cf7 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:26.505330 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065ce29-c59f-481f-ad62-bd910bee3cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:26.505601 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065ce29-c59f-481f-ad62-bd910bee3cf7 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:26.506339 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e065ce29-c59f-481f-ad62-bd910bee3cf7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:26.506640 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e065ce29-c59f-481f-ad62-bd910bee3cf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:26.508031 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e065ce29-c59f-481f-ad62-bd910bee3cf7 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:26.516396 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 220/434] 10.222.0.24 () {56 vars in 1101 bytes} [Thu Apr 7 06:06:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:06:26.521395 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e065ce29-c59f-481f-ad62-bd910bee3cf7 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:26.569024 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0999c36f-86d4-4e17-9c9d-b22f3b7fac4e None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:26.601982 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8993cc8f-9adc-41e8-bc5a-46d361535c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:26.602977 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8993cc8f-9adc-41e8-bc5a-46d361535c22 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:26.603314 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8993cc8f-9adc-41e8-bc5a-46d361535c22 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:26.603656 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8993cc8f-9adc-41e8-bc5a-46d361535c22 None admin] PATH_INFO: `/v3/projects/f2feaca3faed4ec0a547bb377a6f494e` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:26.604885 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8993cc8f-9adc-41e8-bc5a-46d361535c22 None admin] RBAC: Authorizing `identity:get_project(project_id=f2feaca3faed4ec0a547bb377a6f494e)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:26.606324 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8993cc8f-9adc-41e8-bc5a-46d361535c22 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:26.608222 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 215/435] 10.222.0.24 () {56 vars in 1186 bytes} [Thu Apr 7 06:06:26 2022] GET /identity/v3/projects/f2feaca3faed4ec0a547bb377a6f494e => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:26.608790 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8993cc8f-9adc-41e8-bc5a-46d361535c22 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:26.627700 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e065ce29-c59f-481f-ad62-bd910bee3cf7 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:26.659932 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee627bd-09ac-49f4-94da-ff3b2daf576c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:26.660742 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee627bd-09ac-49f4-94da-ff3b2daf576c None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:26.661027 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee627bd-09ac-49f4-94da-ff3b2daf576c None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:26.661305 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee627bd-09ac-49f4-94da-ff3b2daf576c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:26.671654 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee627bd-09ac-49f4-94da-ff3b2daf576c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:06:26.678909 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-9ee627bd-09ac-49f4-94da-ff3b2daf576c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 07 06:06:26.680133 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 221/436] 10.222.0.24 () {56 vars in 1114 bytes} [Thu Apr 7 06:06:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:26.680928 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee627bd-09ac-49f4-94da-ff3b2daf576c None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:26.703306 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8993cc8f-9adc-41e8-bc5a-46d361535c22 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:26.735380 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf777bbc-c7a4-4fbe-a284-97aa1b4a07cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:26.743446 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf777bbc-c7a4-4fbe-a284-97aa1b4a07cc None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:26.743446 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf777bbc-c7a4-4fbe-a284-97aa1b4a07cc None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:26.743446 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf777bbc-c7a4-4fbe-a284-97aa1b4a07cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:26.782819 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee627bd-09ac-49f4-94da-ff3b2daf576c None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:26.806946 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf777bbc-c7a4-4fbe-a284-97aa1b4a07cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:26.808447 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf777bbc-c7a4-4fbe-a284-97aa1b4a07cc None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:26.814670 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6334fee-2ac3-49e3-a333-43404563bd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:26.815526 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6334fee-2ac3-49e3-a333-43404563bd52 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:26.815842 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6334fee-2ac3-49e3-a333-43404563bd52 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:26.816121 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6334fee-2ac3-49e3-a333-43404563bd52 None admin] PATH_INFO: `/v3/groups/5e9d968f4dfa4f6ba105ccc5c511298a` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:26.817293 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6334fee-2ac3-49e3-a333-43404563bd52 None admin] RBAC: Authorizing `identity:get_group(group_id=5e9d968f4dfa4f6ba105ccc5c511298a)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:26.818711 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6334fee-2ac3-49e3-a333-43404563bd52 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:26.820348 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 222/437] 10.222.0.24 () {56 vars in 1180 bytes} [Thu Apr 7 06:06:26 2022] GET /identity/v3/groups/5e9d968f4dfa4f6ba105ccc5c511298a => generated 226 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:26.822148 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6b231-4f8f-4e99-a5c3-2a436fdf5054 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:26.822437 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6b231-4f8f-4e99-a5c3-2a436fdf5054 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:26.822719 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6b231-4f8f-4e99-a5c3-2a436fdf5054 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:26.827160 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 223/438] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:06:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:06:26.827160 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df6b231-4f8f-4e99-a5c3-2a436fdf5054 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:26.901697 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 216/439] 10.222.0.24 () {58 vars in 1282 bytes} [Thu Apr 7 06:06:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 07 06:06:26.902538 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf777bbc-c7a4-4fbe-a284-97aa1b4a07cc None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:26.921684 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df6b231-4f8f-4e99-a5c3-2a436fdf5054 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:26.953004 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ecdb2c-c5c8-4bd8-b9c2-a91afa042f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:26.953665 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ecdb2c-c5c8-4bd8-b9c2-a91afa042f8d None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:26.953947 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ecdb2c-c5c8-4bd8-b9c2-a91afa042f8d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:26.954222 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ecdb2c-c5c8-4bd8-b9c2-a91afa042f8d None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:26.954953 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ecdb2c-c5c8-4bd8-b9c2-a91afa042f8d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:26.955254 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ecdb2c-c5c8-4bd8-b9c2-a91afa042f8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:26.956621 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ecdb2c-c5c8-4bd8-b9c2-a91afa042f8d None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:26.964562 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 224/440] 10.222.0.24 () {56 vars in 1111 bytes} [Thu Apr 7 06:06:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:26.965712 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef76af-bd37-4c50-8448-8c2580e72986 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:26.965998 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef76af-bd37-4c50-8448-8c2580e72986 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:26.966274 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef76af-bd37-4c50-8448-8c2580e72986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:26.981393 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-70ef76af-bd37-4c50-8448-8c2580e72986 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:06:26.982550 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-70ef76af-bd37-4c50-8448-8c2580e72986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:06:26.994894 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf777bbc-c7a4-4fbe-a284-97aa1b4a07cc None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:27.027248 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc52bfb4-841e-41d9-ac7b-429ba1a7970b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:27.027859 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52bfb4-841e-41d9-ac7b-429ba1a7970b None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:27.028145 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52bfb4-841e-41d9-ac7b-429ba1a7970b None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:27.028420 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52bfb4-841e-41d9-ac7b-429ba1a7970b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:27.029244 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc52bfb4-841e-41d9-ac7b-429ba1a7970b None admin] RBAC: Adding query filter params (group.id=5e9d968f4dfa4f6ba105ccc5c511298a, role.id=7abd6a5977df4ff4a5476c2d95a1934b, scope.project.id=f2feaca3faed4ec0a547bb377a6f494e) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:27.029555 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc52bfb4-841e-41d9-ac7b-429ba1a7970b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:27.030981 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc52bfb4-841e-41d9-ac7b-429ba1a7970b None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:27.036536 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 217/441] 10.222.0.24 () {56 vars in 1376 bytes} [Thu Apr 7 06:06:26 2022] GET /identity/v3/role_assignments?group.id=5e9d968f4dfa4f6ba105ccc5c511298a&scope.project.id=f2feaca3faed4ec0a547bb377a6f494e&role.id=7abd6a5977df4ff4a5476c2d95a1934b => generated 611 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:27.037300 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc52bfb4-841e-41d9-ac7b-429ba1a7970b None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:27.045347 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 225/442] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:06:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:06:27.046240 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef76af-bd37-4c50-8448-8c2580e72986 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:27.152311 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc52bfb4-841e-41d9-ac7b-429ba1a7970b None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:27.152556 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef76af-bd37-4c50-8448-8c2580e72986 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:27.187248 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad86fcc-8b11-4e32-8ab1-b1dd58e6ec42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:27.187611 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008949a4-1239-4607-8cd0-a8e8d9ada725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:27.188147 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad86fcc-8b11-4e32-8ab1-b1dd58e6ec42 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:27.188364 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008949a4-1239-4607-8cd0-a8e8d9ada725 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:27.188464 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad86fcc-8b11-4e32-8ab1-b1dd58e6ec42 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:27.188655 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008949a4-1239-4607-8cd0-a8e8d9ada725 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:27.188751 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad86fcc-8b11-4e32-8ab1-b1dd58e6ec42 None admin] PATH_INFO: `/v3/projects/fc392bd6c8534b789823b148310d9370` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:27.188931 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008949a4-1239-4607-8cd0-a8e8d9ada725 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:27.189889 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad86fcc-8b11-4e32-8ab1-b1dd58e6ec42 None admin] RBAC: Authorizing `identity:get_project(project_id=fc392bd6c8534b789823b148310d9370)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:27.191357 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad86fcc-8b11-4e32-8ab1-b1dd58e6ec42 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:27.193160 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 218/443] 10.222.0.24 () {56 vars in 1186 bytes} [Thu Apr 7 06:06:27 2022] GET /identity/v3/projects/fc392bd6c8534b789823b148310d9370 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:27.193944 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad86fcc-8b11-4e32-8ab1-b1dd58e6ec42 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:27.262533 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008949a4-1239-4607-8cd0-a8e8d9ada725 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:27.264014 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008949a4-1239-4607-8cd0-a8e8d9ada725 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:27.301210 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad86fcc-8b11-4e32-8ab1-b1dd58e6ec42 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:27.337871 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de39ac8f-8840-425f-81df-d346340994f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:27.338788 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39ac8f-8840-425f-81df-d346340994f3 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:27.339979 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39ac8f-8840-425f-81df-d346340994f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:27.340461 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39ac8f-8840-425f-81df-d346340994f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:27.351082 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de39ac8f-8840-425f-81df-d346340994f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:06:27.358242 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-de39ac8f-8840-425f-81df-d346340994f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 07 06:06:27.360009 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 219/444] 10.222.0.24 () {56 vars in 1096 bytes} [Thu Apr 7 06:06:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:27.361040 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de39ac8f-8840-425f-81df-d346340994f3 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:27.381714 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 226/445] 10.222.0.24 () {58 vars in 1282 bytes} [Thu Apr 7 06:06:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 07 06:06:27.382572 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008949a4-1239-4607-8cd0-a8e8d9ada725 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:27.474178 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de39ac8f-8840-425f-81df-d346340994f3 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:27.493862 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008949a4-1239-4607-8cd0-a8e8d9ada725 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:27.513200 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d3201-6d23-4ee2-8c91-e9a19e912a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:27.514064 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d3201-6d23-4ee2-8c91-e9a19e912a10 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:27.514349 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d3201-6d23-4ee2-8c91-e9a19e912a10 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:27.514624 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d3201-6d23-4ee2-8c91-e9a19e912a10 None admin] PATH_INFO: `/v3/groups/5e9d968f4dfa4f6ba105ccc5c511298a` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:27.515828 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05d3201-6d23-4ee2-8c91-e9a19e912a10 None admin] RBAC: Authorizing `identity:get_group(group_id=5e9d968f4dfa4f6ba105ccc5c511298a)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:27.517270 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05d3201-6d23-4ee2-8c91-e9a19e912a10 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:27.518925 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 220/446] 10.222.0.24 () {56 vars in 1180 bytes} [Thu Apr 7 06:06:27 2022] GET /identity/v3/groups/5e9d968f4dfa4f6ba105ccc5c511298a => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:27.519787 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d3201-6d23-4ee2-8c91-e9a19e912a10 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:27.538236 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e5373-8807-4808-8b2c-83b94adb75b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:27.538921 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e5373-8807-4808-8b2c-83b94adb75b1 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:27.539219 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e5373-8807-4808-8b2c-83b94adb75b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:27.539493 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e5373-8807-4808-8b2c-83b94adb75b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:27.540390 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8e5373-8807-4808-8b2c-83b94adb75b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:27.540705 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8e5373-8807-4808-8b2c-83b94adb75b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:27.542070 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8e5373-8807-4808-8b2c-83b94adb75b1 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:27.551448 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 227/447] 10.222.0.24 () {56 vars in 1099 bytes} [Thu Apr 7 06:06:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:27.552250 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e5373-8807-4808-8b2c-83b94adb75b1 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:27.620126 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d3201-6d23-4ee2-8c91-e9a19e912a10 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:27.646602 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e5373-8807-4808-8b2c-83b94adb75b1 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:27.650528 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b425e-b82e-4ebe-91f2-015539201630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:27.651378 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b425e-b82e-4ebe-91f2-015539201630 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:27.651661 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b425e-b82e-4ebe-91f2-015539201630 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:27.651956 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b425e-b82e-4ebe-91f2-015539201630 None admin] PATH_INFO: `/v3/projects/fc392bd6c8534b789823b148310d9370` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:27.653113 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8b425e-b82e-4ebe-91f2-015539201630 None admin] RBAC: Authorizing `identity:get_project(project_id=fc392bd6c8534b789823b148310d9370)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:27.654537 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8b425e-b82e-4ebe-91f2-015539201630 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:27.656261 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 221/448] 10.222.0.24 () {56 vars in 1186 bytes} [Thu Apr 7 06:06:27 2022] GET /identity/v3/projects/fc392bd6c8534b789823b148310d9370 => generated 302 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:27.657014 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b425e-b82e-4ebe-91f2-015539201630 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:27.678660 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701c9b0-fe53-46f8-b328-0a32a0557f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:27.679323 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701c9b0-fe53-46f8-b328-0a32a0557f0a None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:27.679611 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701c9b0-fe53-46f8-b328-0a32a0557f0a None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:27.679923 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701c9b0-fe53-46f8-b328-0a32a0557f0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:27.680804 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7701c9b0-fe53-46f8-b328-0a32a0557f0a None admin] RBAC: Adding query filter params (group.id=5e9d968f4dfa4f6ba105ccc5c511298a, role.id=7abd6a5977df4ff4a5476c2d95a1934b, scope.project.id=fc392bd6c8534b789823b148310d9370) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:27.681117 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7701c9b0-fe53-46f8-b328-0a32a0557f0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:27.682535 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7701c9b0-fe53-46f8-b328-0a32a0557f0a None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:27.688072 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 228/449] 10.222.0.24 () {56 vars in 1376 bytes} [Thu Apr 7 06:06:27 2022] GET /identity/v3/role_assignments?group.id=5e9d968f4dfa4f6ba105ccc5c511298a&scope.project.id=fc392bd6c8534b789823b148310d9370&role.id=7abd6a5977df4ff4a5476c2d95a1934b => generated 611 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:27.688844 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701c9b0-fe53-46f8-b328-0a32a0557f0a None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:27.760224 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b425e-b82e-4ebe-91f2-015539201630 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:27.797017 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bffe742-bf87-41f0-8eea-7126cfc17390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:27.797677 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffe742-bf87-41f0-8eea-7126cfc17390 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:27.797998 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffe742-bf87-41f0-8eea-7126cfc17390 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:27.798397 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffe742-bf87-41f0-8eea-7126cfc17390 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:27.805502 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701c9b0-fe53-46f8-b328-0a32a0557f0a None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:27.841251 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9983cf6-8134-461e-9f67-dff457dea7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:27.842142 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9983cf6-8134-461e-9f67-dff457dea7b3 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:27.842427 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9983cf6-8134-461e-9f67-dff457dea7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:27.842702 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9983cf6-8134-461e-9f67-dff457dea7b3 None admin] PATH_INFO: `/v3/groups/5e9d968f4dfa4f6ba105ccc5c511298a` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:27.843974 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9983cf6-8134-461e-9f67-dff457dea7b3 None admin] RBAC: Authorizing `identity:get_group(group_id=5e9d968f4dfa4f6ba105ccc5c511298a)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:27.845435 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9983cf6-8134-461e-9f67-dff457dea7b3 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:27.852156 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 229/450] 10.222.0.24 () {56 vars in 1180 bytes} [Thu Apr 7 06:06:27 2022] GET /identity/v3/groups/5e9d968f4dfa4f6ba105ccc5c511298a => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:27.853354 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9983cf6-8134-461e-9f67-dff457dea7b3 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:27.873514 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bffe742-bf87-41f0-8eea-7126cfc17390 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:27.874993 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bffe742-bf87-41f0-8eea-7126cfc17390 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:27.964626 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9983cf6-8134-461e-9f67-dff457dea7b3 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:27.981400 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 222/451] 10.222.0.24 () {58 vars in 1282 bytes} [Thu Apr 7 06:06:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 07 06:06:27.986115 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bffe742-bf87-41f0-8eea-7126cfc17390 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:28.003198 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f9fa8-c32c-4d3f-9eb8-27981824989b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:28.003992 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f9fa8-c32c-4d3f-9eb8-27981824989b None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:28.004274 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f9fa8-c32c-4d3f-9eb8-27981824989b None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:28.004548 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f9fa8-c32c-4d3f-9eb8-27981824989b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:28.005375 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f9fa8-c32c-4d3f-9eb8-27981824989b None admin] RBAC: Adding query filter params (group.id=5e9d968f4dfa4f6ba105ccc5c511298a, role.id=7ad9776ea3b0430cb02c4599d037c8be, scope.project.id=fc392bd6c8534b789823b148310d9370) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:28.005683 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f9fa8-c32c-4d3f-9eb8-27981824989b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:28.007143 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f9fa8-c32c-4d3f-9eb8-27981824989b None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:28.013884 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 230/452] 10.222.0.24 () {56 vars in 1376 bytes} [Thu Apr 7 06:06:27 2022] GET /identity/v3/role_assignments?group.id=5e9d968f4dfa4f6ba105ccc5c511298a&scope.project.id=fc392bd6c8534b789823b148310d9370&role.id=7ad9776ea3b0430cb02c4599d037c8be => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:28.107567 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bffe742-bf87-41f0-8eea-7126cfc17390 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:28.142174 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027690d3-21dc-4c3e-a39e-7208c678d7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:28.143044 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027690d3-21dc-4c3e-a39e-7208c678d7f8 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:28.143321 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027690d3-21dc-4c3e-a39e-7208c678d7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:28.143592 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027690d3-21dc-4c3e-a39e-7208c678d7f8 None admin] PATH_INFO: `/v3/projects/166c17adce104ad88442ca1e7dd22799` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:28.144836 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027690d3-21dc-4c3e-a39e-7208c678d7f8 None admin] RBAC: Authorizing `identity:get_project(project_id=166c17adce104ad88442ca1e7dd22799)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:28.146294 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027690d3-21dc-4c3e-a39e-7208c678d7f8 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:28.148096 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 223/453] 10.222.0.24 () {56 vars in 1186 bytes} [Thu Apr 7 06:06:27 2022] GET /identity/v3/projects/166c17adce104ad88442ca1e7dd22799 => generated 344 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:06:28.153830 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f9fa8-c32c-4d3f-9eb8-27981824989b None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:28.261254 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f9fa8-c32c-4d3f-9eb8-27981824989b None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:28.295482 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f816f-8d99-4725-a175-6011b7c46565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:28.296367 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f816f-8d99-4725-a175-6011b7c46565 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:28.296643 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f816f-8d99-4725-a175-6011b7c46565 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:28.296914 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f816f-8d99-4725-a175-6011b7c46565 None admin] PATH_INFO: `/v3/groups/b81b86431d7c470490318289a50b99df` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:28.298075 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7f816f-8d99-4725-a175-6011b7c46565 None admin] RBAC: Authorizing `identity:get_group(group_id=b81b86431d7c470490318289a50b99df)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:28.299488 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7f816f-8d99-4725-a175-6011b7c46565 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:28.301109 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 231/454] 10.222.0.24 () {56 vars in 1180 bytes} [Thu Apr 7 06:06:28 2022] GET /identity/v3/groups/b81b86431d7c470490318289a50b99df => generated 229 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:28.306905 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027690d3-21dc-4c3e-a39e-7208c678d7f8 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:28.403301 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027690d3-21dc-4c3e-a39e-7208c678d7f8 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:28.434271 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b7911-0b43-4983-9190-23b8b21add04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:28.434922 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b7911-0b43-4983-9190-23b8b21add04 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:28.435209 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b7911-0b43-4983-9190-23b8b21add04 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:28.435487 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b7911-0b43-4983-9190-23b8b21add04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:28.436344 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b7911-0b43-4983-9190-23b8b21add04 None admin] RBAC: Adding query filter params (group.id=b81b86431d7c470490318289a50b99df, role.id=0fab680bc76f4a73826e9beb59e8129b, scope.project.id=166c17adce104ad88442ca1e7dd22799) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:28.436656 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b7911-0b43-4983-9190-23b8b21add04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:28.438079 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b7911-0b43-4983-9190-23b8b21add04 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:28.443512 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 224/455] 10.222.0.24 () {56 vars in 1376 bytes} [Thu Apr 7 06:06:28 2022] GET /identity/v3/role_assignments?group.id=b81b86431d7c470490318289a50b99df&scope.project.id=166c17adce104ad88442ca1e7dd22799&role.id=0fab680bc76f4a73826e9beb59e8129b => generated 611 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:31.179947 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02f334-11c4-4a20-a370-bcafbee6e77b None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:31.181033 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02f334-11c4-4a20-a370-bcafbee6e77b None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:31.181033 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02f334-11c4-4a20-a370-bcafbee6e77b None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:31.182749 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 232/456] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:06:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:06:31.197388 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9527d6-4c60-4e7e-90fc-e8edec9ec72c None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:31.197896 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9527d6-4c60-4e7e-90fc-e8edec9ec72c None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:31.198000 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9527d6-4c60-4e7e-90fc-e8edec9ec72c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:31.219686 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-3c9527d6-4c60-4e7e-90fc-e8edec9ec72c None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:06:31.220897 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-3c9527d6-4c60-4e7e-90fc-e8edec9ec72c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:06:31.261557 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b756240-9af3-465b-a05b-e545ea0cf03d None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:31.262176 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b756240-9af3-465b-a05b-e545ea0cf03d None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:31.262679 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b756240-9af3-465b-a05b-e545ea0cf03d None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:31.264644 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 233/457] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:06:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 07 06:06:31.270017 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad18976-9397-433e-bff4-3ee75ac7d03c None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:31.270309 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad18976-9397-433e-bff4-3ee75ac7d03c None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:31.270591 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad18976-9397-433e-bff4-3ee75ac7d03c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:31.297267 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-bad18976-9397-433e-bff4-3ee75ac7d03c None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:06:31.298449 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-bad18976-9397-433e-bff4-3ee75ac7d03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:06:31.301521 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 225/458] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:06:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:06:31.339564 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9527d6-4c60-4e7e-90fc-e8edec9ec72c None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:31.371768 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 234/459] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:06:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:06:31.397639 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad18976-9397-433e-bff4-3ee75ac7d03c None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:31.510249 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9527d6-4c60-4e7e-90fc-e8edec9ec72c None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:31.549211 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad18976-9397-433e-bff4-3ee75ac7d03c None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:31.575350 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9443cdc-fc95-4a21-8044-ddd5b2583647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:31.576189 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9443cdc-fc95-4a21-8044-ddd5b2583647 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:31.576473 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9443cdc-fc95-4a21-8044-ddd5b2583647 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:31.576748 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9443cdc-fc95-4a21-8044-ddd5b2583647 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:31.591132 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9443cdc-fc95-4a21-8044-ddd5b2583647 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:31.592842 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9443cdc-fc95-4a21-8044-ddd5b2583647 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:31.593388 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44526db-6fa5-4e6a-8297-0426c4ff34d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:31.603876 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44526db-6fa5-4e6a-8297-0426c4ff34d1 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:31.603876 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44526db-6fa5-4e6a-8297-0426c4ff34d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:31.603876 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44526db-6fa5-4e6a-8297-0426c4ff34d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:31.606032 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44526db-6fa5-4e6a-8297-0426c4ff34d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:31.607566 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44526db-6fa5-4e6a-8297-0426c4ff34d1 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:31.610938 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-b9443cdc-fc95-4a21-8044-ddd5b2583647 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:06:31.612450 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 226/460] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:06:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 07 06:06:31.613669 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d59049-b1bb-48dd-bc06-9c41cf91f758 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:31.613953 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d59049-b1bb-48dd-bc06-9c41cf91f758 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:31.614230 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d59049-b1bb-48dd-bc06-9c41cf91f758 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:31.616002 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 227/461] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:06:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:06:31.619497 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d59049-b1bb-48dd-bc06-9c41cf91f758 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:31.635986 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-a44526db-6fa5-4e6a-8297-0426c4ff34d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:06:31.637484 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 235/462] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:06:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 07 06:06:31.638693 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca1950-d639-4eda-b850-8c6c1959f068 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:31.638980 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca1950-d639-4eda-b850-8c6c1959f068 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:31.639259 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca1950-d639-4eda-b850-8c6c1959f068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:31.662263 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-8aca1950-d639-4eda-b850-8c6c1959f068 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:06:31.664111 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-8aca1950-d639-4eda-b850-8c6c1959f068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:06:31.740774 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d59049-b1bb-48dd-bc06-9c41cf91f758 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:31.747344 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 236/463] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:06:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:06:31.748624 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca1950-d639-4eda-b850-8c6c1959f068 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:31.784551 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e2b694-5289-4d00-a8db-0d11efe5eccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:31.785319 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2b694-5289-4d00-a8db-0d11efe5eccf None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:31.785694 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2b694-5289-4d00-a8db-0d11efe5eccf None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:31.786087 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2b694-5289-4d00-a8db-0d11efe5eccf None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:31.787305 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e2b694-5289-4d00-a8db-0d11efe5eccf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:31.788029 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e2b694-5289-4d00-a8db-0d11efe5eccf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:31.789784 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e2b694-5289-4d00-a8db-0d11efe5eccf None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:31.812773 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 228/464] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:06:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:31.814342 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e2b694-5289-4d00-a8db-0d11efe5eccf None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:31.876612 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca1950-d639-4eda-b850-8c6c1959f068 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:31.910583 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f0956-42c9-43d0-b4c0-7ae593239e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:31.911546 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f0956-42c9-43d0-b4c0-7ae593239e46 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:31.912158 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f0956-42c9-43d0-b4c0-7ae593239e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:31.912631 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f0956-42c9-43d0-b4c0-7ae593239e46 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:31.913520 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968f0956-42c9-43d0-b4c0-7ae593239e46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:31.913993 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968f0956-42c9-43d0-b4c0-7ae593239e46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:31.915587 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968f0956-42c9-43d0-b4c0-7ae593239e46 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:31.923478 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e2b694-5289-4d00-a8db-0d11efe5eccf None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:31.931785 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 237/465] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:06:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:31.933233 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f0956-42c9-43d0-b4c0-7ae593239e46 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:31.964927 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02c91ef-0784-4266-8f8c-5163d7ff03a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:31.965967 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c91ef-0784-4266-8f8c-5163d7ff03a6 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:31.966392 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c91ef-0784-4266-8f8c-5163d7ff03a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:31.966835 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c91ef-0784-4266-8f8c-5163d7ff03a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:31.978315 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02c91ef-0784-4266-8f8c-5163d7ff03a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:31.980011 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02c91ef-0784-4266-8f8c-5163d7ff03a6 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:31.997550 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-e02c91ef-0784-4266-8f8c-5163d7ff03a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:06:31.999261 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 229/466] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:06:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:32.000217 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02c91ef-0784-4266-8f8c-5163d7ff03a6 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:32.058791 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f0956-42c9-43d0-b4c0-7ae593239e46 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:32.102918 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02c91ef-0784-4266-8f8c-5163d7ff03a6 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:32.103788 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2a94e5-24cd-490d-800b-7966fd446c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:32.104811 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a94e5-24cd-490d-800b-7966fd446c0e None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:32.106029 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a94e5-24cd-490d-800b-7966fd446c0e None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:32.106471 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a94e5-24cd-490d-800b-7966fd446c0e None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:32.107324 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2a94e5-24cd-490d-800b-7966fd446c0e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:32.108940 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2a94e5-24cd-490d-800b-7966fd446c0e None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:32.142283 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90245124-a801-4b86-9a2a-da639b4d7aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:32.142960 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90245124-a801-4b86-9a2a-da639b4d7aab None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:32.143247 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90245124-a801-4b86-9a2a-da639b4d7aab None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:32.143526 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90245124-a801-4b86-9a2a-da639b4d7aab None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:32.144323 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90245124-a801-4b86-9a2a-da639b4d7aab None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:32.145772 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90245124-a801-4b86-9a2a-da639b4d7aab None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:32.217129 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 238/467] 10.222.0.24 () {60 vars in 1132 bytes} [Thu Apr 7 06:06:31 2022] POST /identity/v3/users => generated 246 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:06:32.224322 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2a94e5-24cd-490d-800b-7966fd446c0e None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:32.240009 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 230/468] 10.222.0.24 () {60 vars in 1132 bytes} [Thu Apr 7 06:06:31 2022] POST /identity/v3/users => generated 248 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:06:32.241388 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f06a1-5ff2-428e-b181-505b910ea371 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:32.241681 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f06a1-5ff2-428e-b181-505b910ea371 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:32.241965 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f06a1-5ff2-428e-b181-505b910ea371 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:32.243362 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 231/469] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:06:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:06:32.262134 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fca2ff-77b8-4d73-8397-c67599aeaff7 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:32.262447 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fca2ff-77b8-4d73-8397-c67599aeaff7 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:32.262715 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fca2ff-77b8-4d73-8397-c67599aeaff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:32.300958 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-27fca2ff-77b8-4d73-8397-c67599aeaff7 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:06:32.302189 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-27fca2ff-77b8-4d73-8397-c67599aeaff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:06:32.344089 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2a94e5-24cd-490d-800b-7966fd446c0e None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:32.388363 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19162cfa-add0-4784-bbdd-1b5ab0ab486f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:32.389059 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19162cfa-add0-4784-bbdd-1b5ab0ab486f None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:32.389344 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19162cfa-add0-4784-bbdd-1b5ab0ab486f None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:32.389621 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19162cfa-add0-4784-bbdd-1b5ab0ab486f None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:32.390373 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19162cfa-add0-4784-bbdd-1b5ab0ab486f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:32.390680 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19162cfa-add0-4784-bbdd-1b5ab0ab486f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:32.393190 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19162cfa-add0-4784-bbdd-1b5ab0ab486f None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:32.418780 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 239/470] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:06:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:32.424488 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19162cfa-add0-4784-bbdd-1b5ab0ab486f None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:32.467189 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 232/471] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:06:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 07 06:06:32.502821 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fca2ff-77b8-4d73-8397-c67599aeaff7 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:32.560118 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19162cfa-add0-4784-bbdd-1b5ab0ab486f None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:32.602029 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcde4dd6-5b9d-4e1f-a365-715ccc77b02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:32.603083 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde4dd6-5b9d-4e1f-a365-715ccc77b02f None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:32.603571 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde4dd6-5b9d-4e1f-a365-715ccc77b02f None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:32.604072 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde4dd6-5b9d-4e1f-a365-715ccc77b02f None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:32.604983 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcde4dd6-5b9d-4e1f-a365-715ccc77b02f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:32.606646 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcde4dd6-5b9d-4e1f-a365-715ccc77b02f None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:32.630431 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fca2ff-77b8-4d73-8397-c67599aeaff7 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:32.666905 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a37c09-2799-4d32-95bc-b49ff402e332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:32.667806 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a37c09-2799-4d32-95bc-b49ff402e332 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:32.668097 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a37c09-2799-4d32-95bc-b49ff402e332 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:32.668453 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a37c09-2799-4d32-95bc-b49ff402e332 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:32.679622 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a37c09-2799-4d32-95bc-b49ff402e332 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:32.681140 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a37c09-2799-4d32-95bc-b49ff402e332 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:32.698451 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-38a37c09-2799-4d32-95bc-b49ff402e332 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:06:32.700037 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 233/472] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:06:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 07 06:06:32.707084 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a37c09-2799-4d32-95bc-b49ff402e332 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:32.719088 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 240/473] 10.222.0.24 () {60 vars in 1132 bytes} [Thu Apr 7 06:06:32 2022] POST /identity/v3/users => generated 248 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:06:32.754767 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b126762-75f5-48c5-89e7-7ba290d57150 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:32.755229 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b126762-75f5-48c5-89e7-7ba290d57150 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:32.755735 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b126762-75f5-48c5-89e7-7ba290d57150 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:32.757386 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 241/474] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:06:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 07 06:06:32.763576 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c49128-bc8c-4041-a87c-935c93fbc717 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:32.767892 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c49128-bc8c-4041-a87c-935c93fbc717 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:32.767892 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c49128-bc8c-4041-a87c-935c93fbc717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:32.808461 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-64c49128-bc8c-4041-a87c-935c93fbc717 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:06:32.809679 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-64c49128-bc8c-4041-a87c-935c93fbc717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:06:32.838021 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a37c09-2799-4d32-95bc-b49ff402e332 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:32.881065 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc15fa-e935-4527-9877-6a45a6ba596f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:32.882846 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc15fa-e935-4527-9877-6a45a6ba596f None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:32.884435 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc15fa-e935-4527-9877-6a45a6ba596f None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:32.886382 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc15fa-e935-4527-9877-6a45a6ba596f None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:32.887389 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fc15fa-e935-4527-9877-6a45a6ba596f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:32.889085 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fc15fa-e935-4527-9877-6a45a6ba596f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:32.890737 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fc15fa-e935-4527-9877-6a45a6ba596f None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:32.910032 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 234/475] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:06:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:06:32.916932 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc15fa-e935-4527-9877-6a45a6ba596f None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:32.979928 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 242/476] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:06:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 07 06:06:33.001487 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c49128-bc8c-4041-a87c-935c93fbc717 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:33.032837 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc15fa-e935-4527-9877-6a45a6ba596f None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:33.066806 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415430c6-3990-4a4b-8b96-7ec935c3f652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:33.067840 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415430c6-3990-4a4b-8b96-7ec935c3f652 None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:33.068329 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415430c6-3990-4a4b-8b96-7ec935c3f652 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:33.068801 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415430c6-3990-4a4b-8b96-7ec935c3f652 None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:33.069754 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415430c6-3990-4a4b-8b96-7ec935c3f652 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:33.071968 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415430c6-3990-4a4b-8b96-7ec935c3f652 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:33.114859 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c49128-bc8c-4041-a87c-935c93fbc717 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:33.147655 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 235/477] 10.222.0.24 () {60 vars in 1132 bytes} [Thu Apr 7 06:06:32 2022] POST /identity/v3/users => generated 249 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:06:33.158654 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c93c592-c73b-4e54-9d61-e318e21bac43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:33.159345 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c93c592-c73b-4e54-9d61-e318e21bac43 None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:33.159627 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c93c592-c73b-4e54-9d61-e318e21bac43 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:33.159937 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c93c592-c73b-4e54-9d61-e318e21bac43 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:33.160712 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c93c592-c73b-4e54-9d61-e318e21bac43 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:33.162207 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c93c592-c73b-4e54-9d61-e318e21bac43 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:33.205337 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.sql.core [None req-5c93c592-c73b-4e54-9d61-e318e21bac43 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Apr 07 06:06:33.205337 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Apr 07 06:06:33.205337 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [parameters: {'id': '93f3143d7f5b4f50a29f1c8cfe89c776', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Apr 07 06:06:33.205337 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80167) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 07 06:06:33.220076 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-5c93c592-c73b-4e54-9d61-e318e21bac43 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Apr 07 06:06:33.223025 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 243/478] 10.222.0.24 () {60 vars in 1131 bytes} [Thu Apr 7 06:06:33 2022] POST /identity/v3/roles => generated 144 bytes in 221 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:33.228681 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415430c6-3990-4a4b-8b96-7ec935c3f652 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:33.339331 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415430c6-3990-4a4b-8b96-7ec935c3f652 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:33.373848 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d661cccf-120e-4e21-bd08-98e203b62558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:33.374662 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661cccf-120e-4e21-bd08-98e203b62558 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:33.374945 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661cccf-120e-4e21-bd08-98e203b62558 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:33.375214 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661cccf-120e-4e21-bd08-98e203b62558 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:33.385717 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d661cccf-120e-4e21-bd08-98e203b62558 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:06:33.392946 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-d661cccf-120e-4e21-bd08-98e203b62558 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 07 06:06:33.399413 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 236/479] 10.222.0.24 () {56 vars in 1114 bytes} [Thu Apr 7 06:06:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:33.400710 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c93c592-c73b-4e54-9d61-e318e21bac43 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:33.501122 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c93c592-c73b-4e54-9d61-e318e21bac43 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:33.534564 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b045c47c-373b-4c64-bfc1-52384359d2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:33.535236 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045c47c-373b-4c64-bfc1-52384359d2e0 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:33.535521 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045c47c-373b-4c64-bfc1-52384359d2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:33.535891 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045c47c-373b-4c64-bfc1-52384359d2e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:33.536645 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b045c47c-373b-4c64-bfc1-52384359d2e0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:33.536950 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b045c47c-373b-4c64-bfc1-52384359d2e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:33.538316 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b045c47c-373b-4c64-bfc1-52384359d2e0 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:33.551957 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 244/480] 10.222.0.24 () {56 vars in 1111 bytes} [Thu Apr 7 06:06:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:35.049100 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63075c55-e918-4ecb-87bc-343aa8991d4d None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:35.049677 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63075c55-e918-4ecb-87bc-343aa8991d4d None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:35.049677 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63075c55-e918-4ecb-87bc-343aa8991d4d None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:35.051239 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 237/481] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:06:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:06:35.057080 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc1eda1-6188-42b4-a0bd-83cd51840709 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:35.057503 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc1eda1-6188-42b4-a0bd-83cd51840709 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:35.057685 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc1eda1-6188-42b4-a0bd-83cd51840709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:35.074715 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-bfc1eda1-6188-42b4-a0bd-83cd51840709 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:06:35.076097 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-bfc1eda1-6188-42b4-a0bd-83cd51840709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:06:35.170607 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 245/482] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:06:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 07 06:06:35.206864 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63075c55-e918-4ecb-87bc-343aa8991d4d None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:35.215563 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42210eb6-3d66-49da-a8ca-e00562c5f69b None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:35.215888 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42210eb6-3d66-49da-a8ca-e00562c5f69b None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:35.216170 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42210eb6-3d66-49da-a8ca-e00562c5f69b None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:35.217790 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 246/483] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:06:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:06:35.222414 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27945bf-276c-46fc-9ac4-79676796d1a8 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:35.222707 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27945bf-276c-46fc-9ac4-79676796d1a8 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:35.222989 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27945bf-276c-46fc-9ac4-79676796d1a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:35.248157 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-f27945bf-276c-46fc-9ac4-79676796d1a8 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:06:35.249361 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f27945bf-276c-46fc-9ac4-79676796d1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:06:35.348642 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 247/484] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:06:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 07 06:06:35.349645 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63075c55-e918-4ecb-87bc-343aa8991d4d None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:35.383560 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b3228-1c1c-4e61-95f3-d4acc952de26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:35.384498 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b3228-1c1c-4e61-95f3-d4acc952de26 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:35.384859 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b3228-1c1c-4e61-95f3-d4acc952de26 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:35.385205 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b3228-1c1c-4e61-95f3-d4acc952de26 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:35.392712 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27945bf-276c-46fc-9ac4-79676796d1a8 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:35.417001 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978b3228-1c1c-4e61-95f3-d4acc952de26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:06:35.437196 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-978b3228-1c1c-4e61-95f3-d4acc952de26 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 07 06:06:35.439932 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 238/485] 10.222.0.24 () {56 vars in 1102 bytes} [Thu Apr 7 06:06:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:35.444247 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b3228-1c1c-4e61-95f3-d4acc952de26 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:35.524192 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27945bf-276c-46fc-9ac4-79676796d1a8 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:35.569066 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c604eb05-6588-42fe-acf0-90556bdc8b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:35.570282 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c604eb05-6588-42fe-acf0-90556bdc8b61 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:35.571332 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c604eb05-6588-42fe-acf0-90556bdc8b61 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:35.571843 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c604eb05-6588-42fe-acf0-90556bdc8b61 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:35.603729 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b3228-1c1c-4e61-95f3-d4acc952de26 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:35.604919 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c604eb05-6588-42fe-acf0-90556bdc8b61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:06:35.617133 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-c604eb05-6588-42fe-acf0-90556bdc8b61 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 07 06:06:35.622541 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 248/486] 10.222.0.24 () {56 vars in 1102 bytes} [Thu Apr 7 06:06:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 07 06:06:35.623393 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c604eb05-6588-42fe-acf0-90556bdc8b61 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:35.637987 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a54a79-f183-442b-a27c-49a99d4e0f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:35.638655 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a54a79-f183-442b-a27c-49a99d4e0f83 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:35.638935 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a54a79-f183-442b-a27c-49a99d4e0f83 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:35.639213 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a54a79-f183-442b-a27c-49a99d4e0f83 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:35.639989 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a54a79-f183-442b-a27c-49a99d4e0f83 None admin] RBAC: Adding query filter params (name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:35.640296 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a54a79-f183-442b-a27c-49a99d4e0f83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:35.641661 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a54a79-f183-442b-a27c-49a99d4e0f83 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:35.649636 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 239/487] 10.222.0.24 () {56 vars in 1103 bytes} [Thu Apr 7 06:06:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:06:35.656904 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a54a79-f183-442b-a27c-49a99d4e0f83 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:35.748656 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c604eb05-6588-42fe-acf0-90556bdc8b61 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:35.792476 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e5e99e-aad1-4e6c-8f56-56487adbfc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:35.793471 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e5e99e-aad1-4e6c-8f56-56487adbfc48 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:35.793975 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e5e99e-aad1-4e6c-8f56-56487adbfc48 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:35.794480 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e5e99e-aad1-4e6c-8f56-56487adbfc48 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:35.799950 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e5e99e-aad1-4e6c-8f56-56487adbfc48 None admin] RBAC: Adding query filter params (name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:35.800360 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e5e99e-aad1-4e6c-8f56-56487adbfc48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:35.802340 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e5e99e-aad1-4e6c-8f56-56487adbfc48 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:35.819946 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 249/488] 10.222.0.24 () {56 vars in 1103 bytes} [Thu Apr 7 06:06:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:06:35.826551 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e5e99e-aad1-4e6c-8f56-56487adbfc48 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:35.846947 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a54a79-f183-442b-a27c-49a99d4e0f83 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:35.903080 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af72a091-43ba-4618-9036-28a3bd1d0380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:35.903888 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72a091-43ba-4618-9036-28a3bd1d0380 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:35.904176 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72a091-43ba-4618-9036-28a3bd1d0380 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:35.904462 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72a091-43ba-4618-9036-28a3bd1d0380 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:35.919133 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af72a091-43ba-4618-9036-28a3bd1d0380 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:35.920810 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af72a091-43ba-4618-9036-28a3bd1d0380 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:35.939528 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e5e99e-aad1-4e6c-8f56-56487adbfc48 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:35.941195 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-af72a091-43ba-4618-9036-28a3bd1d0380 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:06:35.944868 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 240/489] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:06:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:35.944868 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa36830-fa4f-4347-bace-cb161052d825 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:35.944868 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa36830-fa4f-4347-bace-cb161052d825 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:35.944868 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa36830-fa4f-4347-bace-cb161052d825 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:35.947731 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 241/490] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:06:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:06:35.948510 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa36830-fa4f-4347-bace-cb161052d825 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:35.980377 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1af6e-0749-4897-9932-8879d2ebacb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:35.981502 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1af6e-0749-4897-9932-8879d2ebacb8 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:35.981803 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1af6e-0749-4897-9932-8879d2ebacb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:35.982213 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1af6e-0749-4897-9932-8879d2ebacb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:35.996719 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb1af6e-0749-4897-9932-8879d2ebacb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:35.998387 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb1af6e-0749-4897-9932-8879d2ebacb8 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:36.018187 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-1bb1af6e-0749-4897-9932-8879d2ebacb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:06:36.019904 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 250/491] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:06:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 07 06:06:36.021304 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0334de4-e877-4bb1-91b5-d5b9f050b6b3 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:36.021659 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0334de4-e877-4bb1-91b5-d5b9f050b6b3 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:36.022001 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0334de4-e877-4bb1-91b5-d5b9f050b6b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:36.040055 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-f0334de4-e877-4bb1-91b5-d5b9f050b6b3 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:06:36.041340 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f0334de4-e877-4bb1-91b5-d5b9f050b6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:06:36.063556 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa36830-fa4f-4347-bace-cb161052d825 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:36.105509 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7dab49-e661-456f-88a7-dfba2d6014ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:36.106193 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7dab49-e661-456f-88a7-dfba2d6014ef None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:36.106477 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7dab49-e661-456f-88a7-dfba2d6014ef None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:36.106761 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7dab49-e661-456f-88a7-dfba2d6014ef None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:36.107524 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7dab49-e661-456f-88a7-dfba2d6014ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:36.107883 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7dab49-e661-456f-88a7-dfba2d6014ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:36.109643 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7dab49-e661-456f-88a7-dfba2d6014ef None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:36.125170 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 242/492] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:06:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:36.126139 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7dab49-e661-456f-88a7-dfba2d6014ef None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:36.147069 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 251/493] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:06:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:06:36.149311 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0334de4-e877-4bb1-91b5-d5b9f050b6b3 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:36.229942 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7dab49-e661-456f-88a7-dfba2d6014ef None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:36.250842 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0334de4-e877-4bb1-91b5-d5b9f050b6b3 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:36.268749 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6846cde5-9c1a-4f02-8175-441eadb145ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:36.269419 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846cde5-9c1a-4f02-8175-441eadb145ec None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:36.269702 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846cde5-9c1a-4f02-8175-441eadb145ec None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:36.269972 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846cde5-9c1a-4f02-8175-441eadb145ec None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:36.271107 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6846cde5-9c1a-4f02-8175-441eadb145ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:36.271416 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6846cde5-9c1a-4f02-8175-441eadb145ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:36.273238 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6846cde5-9c1a-4f02-8175-441eadb145ec None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:36.285453 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f50b5-1902-473c-99e2-1e6374eb7d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:36.286262 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f50b5-1902-473c-99e2-1e6374eb7d2b None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:36.286550 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f50b5-1902-473c-99e2-1e6374eb7d2b None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:36.286826 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f50b5-1902-473c-99e2-1e6374eb7d2b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:36.293501 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 243/494] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:06:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:36.293501 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6846cde5-9c1a-4f02-8175-441eadb145ec None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:36.298696 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9f50b5-1902-473c-99e2-1e6374eb7d2b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:36.300224 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9f50b5-1902-473c-99e2-1e6374eb7d2b None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:36.314146 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-6f9f50b5-1902-473c-99e2-1e6374eb7d2b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 07 06:06:36.315336 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 252/495] 10.222.0.24 () {56 vars in 1093 bytes} [Thu Apr 7 06:06:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:36.316649 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d7f13-b460-47ce-b7cd-3d000183f099 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:36.316937 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d7f13-b460-47ce-b7cd-3d000183f099 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:36.317216 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d7f13-b460-47ce-b7cd-3d000183f099 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:36.321547 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 253/496] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:06:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:06:36.321547 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2d7f13-b460-47ce-b7cd-3d000183f099 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:36.396708 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6846cde5-9c1a-4f02-8175-441eadb145ec None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:36.423704 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2d7f13-b460-47ce-b7cd-3d000183f099 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:36.429696 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666cd568-43f6-4598-9a80-3b53b5a37788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:36.430519 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666cd568-43f6-4598-9a80-3b53b5a37788 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:36.430802 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666cd568-43f6-4598-9a80-3b53b5a37788 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:36.431074 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666cd568-43f6-4598-9a80-3b53b5a37788 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:36.440885 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666cd568-43f6-4598-9a80-3b53b5a37788 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:06:36.447930 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-666cd568-43f6-4598-9a80-3b53b5a37788 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 07 06:06:36.449309 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 244/497] 10.222.0.24 () {56 vars in 1102 bytes} [Thu Apr 7 06:06:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:36.449903 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666cd568-43f6-4598-9a80-3b53b5a37788 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:36.461610 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90538d92-f2fa-4ebc-bcb7-00000d1387ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:36.462418 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90538d92-f2fa-4ebc-bcb7-00000d1387ac None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:36.462703 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90538d92-f2fa-4ebc-bcb7-00000d1387ac None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:36.462979 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90538d92-f2fa-4ebc-bcb7-00000d1387ac None admin] PATH_INFO: `/v3/users/glance` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:36.470017 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90538d92-f2fa-4ebc-bcb7-00000d1387ac None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:36.471464 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90538d92-f2fa-4ebc-bcb7-00000d1387ac None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:36.485566 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-90538d92-f2fa-4ebc-bcb7-00000d1387ac None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 07 06:06:36.491238 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 254/498] 10.222.0.24 () {56 vars in 1099 bytes} [Thu Apr 7 06:06:36 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:36.491238 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986f218-7763-4167-83c8-36bef6bc079b None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:36.491238 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986f218-7763-4167-83c8-36bef6bc079b None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:36.491238 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986f218-7763-4167-83c8-36bef6bc079b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:36.506342 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-0986f218-7763-4167-83c8-36bef6bc079b None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:06:36.507517 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-0986f218-7763-4167-83c8-36bef6bc079b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:06:36.550789 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666cd568-43f6-4598-9a80-3b53b5a37788 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:36.569942 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 255/499] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:06:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:06:36.570792 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0986f218-7763-4167-83c8-36bef6bc079b None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:36.593381 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e661e9-f72d-4a95-abd3-3130e6bb2f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:36.594340 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e661e9-f72d-4a95-abd3-3130e6bb2f6b None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:36.594656 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e661e9-f72d-4a95-abd3-3130e6bb2f6b None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:36.594939 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e661e9-f72d-4a95-abd3-3130e6bb2f6b None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:36.595810 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e661e9-f72d-4a95-abd3-3130e6bb2f6b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:36.596129 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e661e9-f72d-4a95-abd3-3130e6bb2f6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:36.597578 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e661e9-f72d-4a95-abd3-3130e6bb2f6b None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:36.633999 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 245/500] 10.222.0.24 () {56 vars in 1133 bytes} [Thu Apr 7 06:06:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:36.634825 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e661e9-f72d-4a95-abd3-3130e6bb2f6b None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:36.662563 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0986f218-7763-4167-83c8-36bef6bc079b None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:36.694094 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd61b22-fbea-4e48-86ba-8e225d1fd6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:36.694761 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd61b22-fbea-4e48-86ba-8e225d1fd6ff None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:36.695047 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd61b22-fbea-4e48-86ba-8e225d1fd6ff None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:36.695321 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd61b22-fbea-4e48-86ba-8e225d1fd6ff None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:36.696613 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd61b22-fbea-4e48-86ba-8e225d1fd6ff None admin] RBAC: Adding query filter params (name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:36.696918 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd61b22-fbea-4e48-86ba-8e225d1fd6ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:36.698275 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd61b22-fbea-4e48-86ba-8e225d1fd6ff None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:36.705696 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 256/501] 10.222.0.24 () {56 vars in 1103 bytes} [Thu Apr 7 06:06:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:36.706895 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f482ad-ce3f-443b-bce6-86b7847b09bb None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:36.707184 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f482ad-ce3f-443b-bce6-86b7847b09bb None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:36.707463 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f482ad-ce3f-443b-bce6-86b7847b09bb None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:36.708977 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 257/502] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:06:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:06:36.709687 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f482ad-ce3f-443b-bce6-86b7847b09bb None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:36.730157 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e661e9-f72d-4a95-abd3-3130e6bb2f6b None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:36.762734 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9be02-45dd-4660-b3e0-9424a0a5fa50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:36.763336 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9be02-45dd-4660-b3e0-9424a0a5fa50 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:36.763616 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9be02-45dd-4660-b3e0-9424a0a5fa50 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:36.763929 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9be02-45dd-4660-b3e0-9424a0a5fa50 None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:36.764764 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d9be02-45dd-4660-b3e0-9424a0a5fa50 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:36.765070 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d9be02-45dd-4660-b3e0-9424a0a5fa50 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:36.766512 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d9be02-45dd-4660-b3e0-9424a0a5fa50 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:36.784311 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 246/503] 10.222.0.24 () {56 vars in 1137 bytes} [Thu Apr 7 06:06:36 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:36.789007 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9be02-45dd-4660-b3e0-9424a0a5fa50 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:36.807610 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f482ad-ce3f-443b-bce6-86b7847b09bb None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:36.839181 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e07257-420e-4267-904c-7349b6beca49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:36.840000 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e07257-420e-4267-904c-7349b6beca49 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:36.840279 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e07257-420e-4267-904c-7349b6beca49 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:36.840548 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e07257-420e-4267-904c-7349b6beca49 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:36.849981 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e07257-420e-4267-904c-7349b6beca49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:06:36.856761 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-a1e07257-420e-4267-904c-7349b6beca49 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 07 06:06:36.858097 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 258/504] 10.222.0.24 () {56 vars in 1102 bytes} [Thu Apr 7 06:06:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:36.858676 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e07257-420e-4267-904c-7349b6beca49 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:36.878995 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9be02-45dd-4660-b3e0-9424a0a5fa50 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:36.911112 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26039f91-5f4f-4f34-8bd4-aded818e7230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:36.911776 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26039f91-5f4f-4f34-8bd4-aded818e7230 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:36.912066 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26039f91-5f4f-4f34-8bd4-aded818e7230 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:36.912343 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26039f91-5f4f-4f34-8bd4-aded818e7230 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:36.953449 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e07257-420e-4267-904c-7349b6beca49 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:36.975030 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26039f91-5f4f-4f34-8bd4-aded818e7230 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:36.976520 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26039f91-5f4f-4f34-8bd4-aded818e7230 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:36.984744 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e133f0cb-4b38-434b-a988-859ba8b87744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:36.985522 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133f0cb-4b38-434b-a988-859ba8b87744 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:36.985806 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133f0cb-4b38-434b-a988-859ba8b87744 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:36.986074 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133f0cb-4b38-434b-a988-859ba8b87744 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:36.996804 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e133f0cb-4b38-434b-a988-859ba8b87744 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:36.998219 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e133f0cb-4b38-434b-a988-859ba8b87744 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:37.014219 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-e133f0cb-4b38-434b-a988-859ba8b87744 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:06:37.015319 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 259/505] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:06:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:37.020126 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830ae3e-d901-4b7b-8c6b-6e600228f974 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:37.020126 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830ae3e-d901-4b7b-8c6b-6e600228f974 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:37.020126 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830ae3e-d901-4b7b-8c6b-6e600228f974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:37.033822 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-a830ae3e-d901-4b7b-8c6b-6e600228f974 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:06:37.034970 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a830ae3e-d901-4b7b-8c6b-6e600228f974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:06:37.069173 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 247/506] 10.222.0.24 () {58 vars in 1282 bytes} [Thu Apr 7 06:06:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 07 06:06:37.070017 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26039f91-5f4f-4f34-8bd4-aded818e7230 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:37.097800 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 260/507] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:06:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:06:37.098503 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a830ae3e-d901-4b7b-8c6b-6e600228f974 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:37.179165 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26039f91-5f4f-4f34-8bd4-aded818e7230 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:37.195392 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a830ae3e-d901-4b7b-8c6b-6e600228f974 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:37.211693 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9cb23e-3de9-4b8c-96a2-3ffb142468b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:37.212390 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9cb23e-3de9-4b8c-96a2-3ffb142468b7 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:37.212677 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9cb23e-3de9-4b8c-96a2-3ffb142468b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:37.212956 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9cb23e-3de9-4b8c-96a2-3ffb142468b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:37.229004 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e97ab87-a0a1-4928-8d70-7d279a9af12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:37.229691 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97ab87-a0a1-4928-8d70-7d279a9af12a None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:37.229972 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97ab87-a0a1-4928-8d70-7d279a9af12a None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:37.230247 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97ab87-a0a1-4928-8d70-7d279a9af12a None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:37.230977 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e97ab87-a0a1-4928-8d70-7d279a9af12a None admin] RBAC: Adding query filter params (name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:37.231277 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e97ab87-a0a1-4928-8d70-7d279a9af12a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:37.232672 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e97ab87-a0a1-4928-8d70-7d279a9af12a None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:37.240522 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 261/508] 10.222.0.24 () {56 vars in 1103 bytes} [Thu Apr 7 06:06:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:37.241085 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e97ab87-a0a1-4928-8d70-7d279a9af12a None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:37.277017 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9cb23e-3de9-4b8c-96a2-3ffb142468b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:37.278413 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9cb23e-3de9-4b8c-96a2-3ffb142468b7 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:37.331440 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e97ab87-a0a1-4928-8d70-7d279a9af12a None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:37.362229 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b5348-c129-4803-ac25-8a1984e6a503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:37.362867 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b5348-c129-4803-ac25-8a1984e6a503 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:37.363147 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b5348-c129-4803-ac25-8a1984e6a503 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:37.363421 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b5348-c129-4803-ac25-8a1984e6a503 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:37.364148 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5b5348-c129-4803-ac25-8a1984e6a503 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:37.364449 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5b5348-c129-4803-ac25-8a1984e6a503 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:37.366041 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5b5348-c129-4803-ac25-8a1984e6a503 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:37.368867 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 248/509] 10.222.0.24 () {58 vars in 1282 bytes} [Thu Apr 7 06:06:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 07 06:06:37.369684 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9cb23e-3de9-4b8c-96a2-3ffb142468b7 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:37.381316 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 262/510] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:06:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:37.381316 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b5348-c129-4803-ac25-8a1984e6a503 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:37.463228 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9cb23e-3de9-4b8c-96a2-3ffb142468b7 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:37.469090 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b5348-c129-4803-ac25-8a1984e6a503 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:37.494964 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdfd774-cc72-4bed-8d5e-a5e249931c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:37.495789 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdfd774-cc72-4bed-8d5e-a5e249931c9d None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:37.496074 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdfd774-cc72-4bed-8d5e-a5e249931c9d None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:37.496344 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdfd774-cc72-4bed-8d5e-a5e249931c9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:37.500474 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c054994-f4d6-40ac-9519-d9aebd0f5404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:37.501253 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c054994-f4d6-40ac-9519-d9aebd0f5404 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:37.501537 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c054994-f4d6-40ac-9519-d9aebd0f5404 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:37.501812 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c054994-f4d6-40ac-9519-d9aebd0f5404 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:37.505790 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdfd774-cc72-4bed-8d5e-a5e249931c9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:37.507234 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdfd774-cc72-4bed-8d5e-a5e249931c9d None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:37.511726 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c054994-f4d6-40ac-9519-d9aebd0f5404 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:37.513170 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c054994-f4d6-40ac-9519-d9aebd0f5404 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:37.524201 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-ebdfd774-cc72-4bed-8d5e-a5e249931c9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:06:37.525368 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 249/511] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:06:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:37.526128 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdfd774-cc72-4bed-8d5e-a5e249931c9d None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:37.529613 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-9c054994-f4d6-40ac-9519-d9aebd0f5404 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:06:37.535168 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 263/512] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:06:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:37.535168 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c054994-f4d6-40ac-9519-d9aebd0f5404 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:37.617306 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdfd774-cc72-4bed-8d5e-a5e249931c9d None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:37.621927 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c054994-f4d6-40ac-9519-d9aebd0f5404 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:37.648552 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7567529-4039-48ff-868f-0e6b1508d19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:37.649371 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7567529-4039-48ff-868f-0e6b1508d19e None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:37.649653 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7567529-4039-48ff-868f-0e6b1508d19e None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:37.649954 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7567529-4039-48ff-868f-0e6b1508d19e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:37.653280 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70757340-0b56-43f9-8c54-5c180ec1d53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:37.654068 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70757340-0b56-43f9-8c54-5c180ec1d53d None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:37.654350 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70757340-0b56-43f9-8c54-5c180ec1d53d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:37.654619 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70757340-0b56-43f9-8c54-5c180ec1d53d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:37.659388 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7567529-4039-48ff-868f-0e6b1508d19e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:37.660845 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7567529-4039-48ff-868f-0e6b1508d19e None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:37.663945 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70757340-0b56-43f9-8c54-5c180ec1d53d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:37.665901 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70757340-0b56-43f9-8c54-5c180ec1d53d None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:37.677261 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-d7567529-4039-48ff-868f-0e6b1508d19e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:06:37.678421 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 250/513] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:06:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:37.679182 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7567529-4039-48ff-868f-0e6b1508d19e None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:37.682264 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-70757340-0b56-43f9-8c54-5c180ec1d53d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:06:37.683770 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 264/514] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:06:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:37.684390 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70757340-0b56-43f9-8c54-5c180ec1d53d None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:37.770504 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7567529-4039-48ff-868f-0e6b1508d19e None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:37.778086 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70757340-0b56-43f9-8c54-5c180ec1d53d None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:37.802313 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae75f6db-e455-4abc-9288-e2d6bf4b6210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:37.803036 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75f6db-e455-4abc-9288-e2d6bf4b6210 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:37.803316 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75f6db-e455-4abc-9288-e2d6bf4b6210 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:37.803590 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75f6db-e455-4abc-9288-e2d6bf4b6210 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:37.809973 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc6fc1-c80f-47ed-9628-cb9c1bb62546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:37.810631 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc6fc1-c80f-47ed-9628-cb9c1bb62546 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:37.810807 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae75f6db-e455-4abc-9288-e2d6bf4b6210 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:37.810909 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc6fc1-c80f-47ed-9628-cb9c1bb62546 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:37.811175 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc6fc1-c80f-47ed-9628-cb9c1bb62546 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:37.811921 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fc6fc1-c80f-47ed-9628-cb9c1bb62546 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:37.812228 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fc6fc1-c80f-47ed-9628-cb9c1bb62546 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:37.812315 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae75f6db-e455-4abc-9288-e2d6bf4b6210 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:37.813573 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fc6fc1-c80f-47ed-9628-cb9c1bb62546 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:37.824227 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 265/515] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:06:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:37.825040 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc6fc1-c80f-47ed-9628-cb9c1bb62546 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:37.825792 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-ae75f6db-e455-4abc-9288-e2d6bf4b6210 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 07 06:06:37.831662 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 251/516] 10.222.0.24 () {56 vars in 1099 bytes} [Thu Apr 7 06:06:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:37.831662 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae75f6db-e455-4abc-9288-e2d6bf4b6210 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:37.918093 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc6fc1-c80f-47ed-9628-cb9c1bb62546 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:37.920299 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae75f6db-e455-4abc-9288-e2d6bf4b6210 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:37.948475 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce284d2-7c93-4c6f-bacc-1734d34b2836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:37.949135 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce284d2-7c93-4c6f-bacc-1734d34b2836 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:37.949421 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce284d2-7c93-4c6f-bacc-1734d34b2836 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:37.949700 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce284d2-7c93-4c6f-bacc-1734d34b2836 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:37.950415 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce284d2-7c93-4c6f-bacc-1734d34b2836 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:37.950724 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce284d2-7c93-4c6f-bacc-1734d34b2836 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:37.952055 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0649eac-36d0-493e-b193-058ab399cabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:37.952172 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce284d2-7c93-4c6f-bacc-1734d34b2836 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:37.952705 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0649eac-36d0-493e-b193-058ab399cabf None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:37.952994 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0649eac-36d0-493e-b193-058ab399cabf None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:37.953273 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0649eac-36d0-493e-b193-058ab399cabf None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:37.953994 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0649eac-36d0-493e-b193-058ab399cabf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:37.954306 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0649eac-36d0-493e-b193-058ab399cabf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:37.955704 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0649eac-36d0-493e-b193-058ab399cabf None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:37.964214 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 266/517] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:06:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:37.964644 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce284d2-7c93-4c6f-bacc-1734d34b2836 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:37.967039 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 252/518] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:06:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:37.967858 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0649eac-36d0-493e-b193-058ab399cabf None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:38.059375 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0649eac-36d0-493e-b193-058ab399cabf None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:38.059539 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce284d2-7c93-4c6f-bacc-1734d34b2836 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:38.090405 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44194484-3fed-43d7-a696-432a907ae257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:38.091178 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44194484-3fed-43d7-a696-432a907ae257 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:38.091460 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44194484-3fed-43d7-a696-432a907ae257 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:38.091551 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6cf8de-0488-4825-a7d5-2e95e8928af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:38.091733 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44194484-3fed-43d7-a696-432a907ae257 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:38.092227 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6cf8de-0488-4825-a7d5-2e95e8928af4 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:38.092517 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6cf8de-0488-4825-a7d5-2e95e8928af4 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:38.092792 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6cf8de-0488-4825-a7d5-2e95e8928af4 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:38.093513 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6cf8de-0488-4825-a7d5-2e95e8928af4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:38.093820 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6cf8de-0488-4825-a7d5-2e95e8928af4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:38.095177 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6cf8de-0488-4825-a7d5-2e95e8928af4 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:38.098389 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44194484-3fed-43d7-a696-432a907ae257 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:38.099847 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44194484-3fed-43d7-a696-432a907ae257 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:38.106402 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 267/519] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:06:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:38.106402 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6cf8de-0488-4825-a7d5-2e95e8928af4 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:38.114350 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-44194484-3fed-43d7-a696-432a907ae257 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 07 06:06:38.115816 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 253/520] 10.222.0.24 () {56 vars in 1111 bytes} [Thu Apr 7 06:06:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:38.116552 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44194484-3fed-43d7-a696-432a907ae257 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:38.199956 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6cf8de-0488-4825-a7d5-2e95e8928af4 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:38.208575 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44194484-3fed-43d7-a696-432a907ae257 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:38.231626 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99284b55-ca1d-41da-a6a1-dc78598330bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:38.232324 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99284b55-ca1d-41da-a6a1-dc78598330bc None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:38.232609 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99284b55-ca1d-41da-a6a1-dc78598330bc None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:38.232887 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99284b55-ca1d-41da-a6a1-dc78598330bc None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:38.233726 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99284b55-ca1d-41da-a6a1-dc78598330bc None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:38.234035 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99284b55-ca1d-41da-a6a1-dc78598330bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:38.235459 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99284b55-ca1d-41da-a6a1-dc78598330bc None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:38.244525 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed225fdc-d093-4afe-962f-bb52160bae16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:38.245193 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed225fdc-d093-4afe-962f-bb52160bae16 None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:38.245482 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed225fdc-d093-4afe-962f-bb52160bae16 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:38.245763 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed225fdc-d093-4afe-962f-bb52160bae16 None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:38.246469 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed225fdc-d093-4afe-962f-bb52160bae16 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:38.247955 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed225fdc-d093-4afe-962f-bb52160bae16 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:38.272067 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 268/521] 10.222.0.24 () {56 vars in 1137 bytes} [Thu Apr 7 06:06:38 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:38.272886 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99284b55-ca1d-41da-a6a1-dc78598330bc None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:38.335503 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 254/522] 10.222.0.24 () {60 vars in 1132 bytes} [Thu Apr 7 06:06:38 2022] POST /identity/v3/users => generated 247 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:06:38.336346 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed225fdc-d093-4afe-962f-bb52160bae16 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:38.375584 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99284b55-ca1d-41da-a6a1-dc78598330bc None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:38.411760 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4a7b29-b1bb-4a48-91f0-2aa1e407b5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:38.412590 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a7b29-b1bb-4a48-91f0-2aa1e407b5b9 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:38.412871 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a7b29-b1bb-4a48-91f0-2aa1e407b5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:38.413140 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a7b29-b1bb-4a48-91f0-2aa1e407b5b9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:38.422595 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4a7b29-b1bb-4a48-91f0-2aa1e407b5b9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:38.424221 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4a7b29-b1bb-4a48-91f0-2aa1e407b5b9 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:38.439295 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-ba4a7b29-b1bb-4a48-91f0-2aa1e407b5b9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 07 06:06:38.440583 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 269/523] 10.222.0.24 () {56 vars in 1102 bytes} [Thu Apr 7 06:06:38 2022] GET /identity/v3/users/neutron => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:38.441372 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4a7b29-b1bb-4a48-91f0-2aa1e407b5b9 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:38.458718 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed225fdc-d093-4afe-962f-bb52160bae16 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:38.502773 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59667fd-5e20-43f3-81fb-b5cb505af9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:38.503585 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59667fd-5e20-43f3-81fb-b5cb505af9a9 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:38.503896 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59667fd-5e20-43f3-81fb-b5cb505af9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:38.504170 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59667fd-5e20-43f3-81fb-b5cb505af9a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:38.511527 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59667fd-5e20-43f3-81fb-b5cb505af9a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:38.513023 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59667fd-5e20-43f3-81fb-b5cb505af9a9 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:38.527610 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-f59667fd-5e20-43f3-81fb-b5cb505af9a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 07 06:06:38.529280 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 255/524] 10.222.0.24 () {56 vars in 1111 bytes} [Thu Apr 7 06:06:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:38.529681 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59667fd-5e20-43f3-81fb-b5cb505af9a9 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:38.550809 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4a7b29-b1bb-4a48-91f0-2aa1e407b5b9 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:38.590075 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1833d522-d900-4472-b5ea-bc7a942ba3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:38.590668 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833d522-d900-4472-b5ea-bc7a942ba3d4 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:38.590972 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833d522-d900-4472-b5ea-bc7a942ba3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:38.591232 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833d522-d900-4472-b5ea-bc7a942ba3d4 None admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:38.592116 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1833d522-d900-4472-b5ea-bc7a942ba3d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:38.592431 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1833d522-d900-4472-b5ea-bc7a942ba3d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:38.593848 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1833d522-d900-4472-b5ea-bc7a942ba3d4 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:38.611363 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 270/525] 10.222.0.24 () {56 vars in 1148 bytes} [Thu Apr 7 06:06:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:38.612250 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1833d522-d900-4472-b5ea-bc7a942ba3d4 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:38.632807 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59667fd-5e20-43f3-81fb-b5cb505af9a9 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:38.667036 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fec328-9e69-4ff2-8c03-20e56eca82b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:38.667723 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fec328-9e69-4ff2-8c03-20e56eca82b7 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:38.668030 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fec328-9e69-4ff2-8c03-20e56eca82b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:38.668312 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fec328-9e69-4ff2-8c03-20e56eca82b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:38.719674 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1833d522-d900-4472-b5ea-bc7a942ba3d4 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:38.736219 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fec328-9e69-4ff2-8c03-20e56eca82b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:38.738027 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fec328-9e69-4ff2-8c03-20e56eca82b7 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:38.753346 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af1aa5-fccc-474f-9bb2-e4bcd84ebb62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:38.754023 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af1aa5-fccc-474f-9bb2-e4bcd84ebb62 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:38.754309 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af1aa5-fccc-474f-9bb2-e4bcd84ebb62 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:38.754584 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af1aa5-fccc-474f-9bb2-e4bcd84ebb62 None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:38.755419 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65af1aa5-fccc-474f-9bb2-e4bcd84ebb62 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:38.755725 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65af1aa5-fccc-474f-9bb2-e4bcd84ebb62 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:38.757212 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65af1aa5-fccc-474f-9bb2-e4bcd84ebb62 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:38.780808 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 271/526] 10.222.0.24 () {56 vars in 1139 bytes} [Thu Apr 7 06:06:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:38.780808 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af1aa5-fccc-474f-9bb2-e4bcd84ebb62 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:38.846944 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 256/527] 10.222.0.24 () {58 vars in 1282 bytes} [Thu Apr 7 06:06:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 07 06:06:38.847719 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fec328-9e69-4ff2-8c03-20e56eca82b7 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:38.883614 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af1aa5-fccc-474f-9bb2-e4bcd84ebb62 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:38.916215 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7d820-29ae-4be7-9cb1-94695cbd4070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:38.916882 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7d820-29ae-4be7-9cb1-94695cbd4070 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:38.917169 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7d820-29ae-4be7-9cb1-94695cbd4070 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:38.917451 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7d820-29ae-4be7-9cb1-94695cbd4070 None admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:38.918229 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c7d820-29ae-4be7-9cb1-94695cbd4070 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:38.918536 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c7d820-29ae-4be7-9cb1-94695cbd4070 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:38.920013 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c7d820-29ae-4be7-9cb1-94695cbd4070 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:38.931401 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 272/528] 10.222.0.24 () {56 vars in 1148 bytes} [Thu Apr 7 06:06:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:38.932768 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7d820-29ae-4be7-9cb1-94695cbd4070 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:38.949860 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fec328-9e69-4ff2-8c03-20e56eca82b7 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:38.983337 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4691f39b-1cac-4d4a-a447-9314129a18d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:38.984022 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691f39b-1cac-4d4a-a447-9314129a18d5 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:38.984311 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691f39b-1cac-4d4a-a447-9314129a18d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:38.984590 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691f39b-1cac-4d4a-a447-9314129a18d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:38.985422 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4691f39b-1cac-4d4a-a447-9314129a18d5 None admin] RBAC: Adding query filter params (role.id=64a6094c7a2942afb375bfb185843fd6, scope.project.id=de88f2c333ae49cfa7fff7fa1ed0022c, user.id=02cd81f6620f410db450871fb29961f6) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:38.985740 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4691f39b-1cac-4d4a-a447-9314129a18d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:38.987174 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4691f39b-1cac-4d4a-a447-9314129a18d5 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:38.993238 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 257/529] 10.222.0.24 () {56 vars in 1374 bytes} [Thu Apr 7 06:06:38 2022] GET /identity/v3/role_assignments?user.id=02cd81f6620f410db450871fb29961f6&scope.project.id=de88f2c333ae49cfa7fff7fa1ed0022c&role.id=64a6094c7a2942afb375bfb185843fd6 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:38.994007 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4691f39b-1cac-4d4a-a447-9314129a18d5 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:39.062023 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7d820-29ae-4be7-9cb1-94695cbd4070 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:39.098729 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b96a6b-3989-4e1d-8845-1244ac4b0040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:39.099324 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b96a6b-3989-4e1d-8845-1244ac4b0040 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:39.099610 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b96a6b-3989-4e1d-8845-1244ac4b0040 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:39.099940 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b96a6b-3989-4e1d-8845-1244ac4b0040 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:39.105198 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4691f39b-1cac-4d4a-a447-9314129a18d5 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:39.142747 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea4a369-13cc-4c44-b1c9-43f9cad6c18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:39.143897 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4a369-13cc-4c44-b1c9-43f9cad6c18e None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:39.144329 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4a369-13cc-4c44-b1c9-43f9cad6c18e None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:39.144748 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4a369-13cc-4c44-b1c9-43f9cad6c18e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:39.156699 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea4a369-13cc-4c44-b1c9-43f9cad6c18e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:39.158436 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea4a369-13cc-4c44-b1c9-43f9cad6c18e None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:39.176715 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-6ea4a369-13cc-4c44-b1c9-43f9cad6c18e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:06:39.182514 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b96a6b-3989-4e1d-8845-1244ac4b0040 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:39.182514 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b96a6b-3989-4e1d-8845-1244ac4b0040 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:39.183100 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 258/530] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:06:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:39.184230 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea4a369-13cc-4c44-b1c9-43f9cad6c18e None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:39.285179 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea4a369-13cc-4c44-b1c9-43f9cad6c18e None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:39.287368 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 273/531] 10.222.0.24 () {58 vars in 1282 bytes} [Thu Apr 7 06:06:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 07 06:06:39.288343 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b96a6b-3989-4e1d-8845-1244ac4b0040 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:39.319720 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3a2d43-0920-46ed-b05b-23c35e944f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:39.320527 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a2d43-0920-46ed-b05b-23c35e944f5b None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:39.320809 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a2d43-0920-46ed-b05b-23c35e944f5b None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:39.321087 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a2d43-0920-46ed-b05b-23c35e944f5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:39.321915 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3a2d43-0920-46ed-b05b-23c35e944f5b None admin] RBAC: Adding query filter params (role.id=64a6094c7a2942afb375bfb185843fd6, scope.project.id=de88f2c333ae49cfa7fff7fa1ed0022c, user.id=0ca88debdfcc4a9d918e3b0138a9add1) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:39.322224 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3a2d43-0920-46ed-b05b-23c35e944f5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:39.323656 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3a2d43-0920-46ed-b05b-23c35e944f5b None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:39.329495 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 259/532] 10.222.0.24 () {56 vars in 1374 bytes} [Thu Apr 7 06:06:39 2022] GET /identity/v3/role_assignments?user.id=0ca88debdfcc4a9d918e3b0138a9add1&scope.project.id=de88f2c333ae49cfa7fff7fa1ed0022c&role.id=64a6094c7a2942afb375bfb185843fd6 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:39.330336 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3a2d43-0920-46ed-b05b-23c35e944f5b None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:39.390363 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b96a6b-3989-4e1d-8845-1244ac4b0040 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:39.442255 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f817982-28f1-449e-bcb2-0770095a3f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:39.442947 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f817982-28f1-449e-bcb2-0770095a3f59 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:39.443234 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f817982-28f1-449e-bcb2-0770095a3f59 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:39.443517 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f817982-28f1-449e-bcb2-0770095a3f59 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:39.444314 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f817982-28f1-449e-bcb2-0770095a3f59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:39.444626 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f817982-28f1-449e-bcb2-0770095a3f59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:39.446176 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f817982-28f1-449e-bcb2-0770095a3f59 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:39.460487 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 274/533] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:06:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:39.467809 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f817982-28f1-449e-bcb2-0770095a3f59 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:39.484003 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3a2d43-0920-46ed-b05b-23c35e944f5b None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:39.568199 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95c9487-78ca-4438-96d3-2f970bc02e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:39.569004 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c9487-78ca-4438-96d3-2f970bc02e8d None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:39.569290 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c9487-78ca-4438-96d3-2f970bc02e8d None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:39.570418 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c9487-78ca-4438-96d3-2f970bc02e8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:39.587813 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95c9487-78ca-4438-96d3-2f970bc02e8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:39.589852 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95c9487-78ca-4438-96d3-2f970bc02e8d None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:39.590308 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f817982-28f1-449e-bcb2-0770095a3f59 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:39.615738 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-c95c9487-78ca-4438-96d3-2f970bc02e8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:06:39.618117 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 260/534] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:06:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:39.624781 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95c9487-78ca-4438-96d3-2f970bc02e8d None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:39.646637 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55faf85f-89fe-493d-9949-ffda3bce3ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:39.647371 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55faf85f-89fe-493d-9949-ffda3bce3ac6 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:39.647659 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55faf85f-89fe-493d-9949-ffda3bce3ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:39.647974 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55faf85f-89fe-493d-9949-ffda3bce3ac6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:39.660494 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55faf85f-89fe-493d-9949-ffda3bce3ac6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:39.661943 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55faf85f-89fe-493d-9949-ffda3bce3ac6 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:39.690970 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-55faf85f-89fe-493d-9949-ffda3bce3ac6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 07 06:06:39.695838 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 275/535] 10.222.0.24 () {56 vars in 1111 bytes} [Thu Apr 7 06:06:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:39.700643 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55faf85f-89fe-493d-9949-ffda3bce3ac6 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:39.756655 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95c9487-78ca-4438-96d3-2f970bc02e8d None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:39.792421 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7879a9-9d08-48e6-a971-d019d30a6024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:39.793099 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7879a9-9d08-48e6-a971-d019d30a6024 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:39.793460 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7879a9-9d08-48e6-a971-d019d30a6024 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:39.793745 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7879a9-9d08-48e6-a971-d019d30a6024 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:39.794487 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7879a9-9d08-48e6-a971-d019d30a6024 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:39.794799 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7879a9-9d08-48e6-a971-d019d30a6024 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:39.796281 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7879a9-9d08-48e6-a971-d019d30a6024 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:39.807989 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 261/536] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:06:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:39.819932 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7879a9-9d08-48e6-a971-d019d30a6024 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:39.923600 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7879a9-9d08-48e6-a971-d019d30a6024 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:39.951359 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55faf85f-89fe-493d-9949-ffda3bce3ac6 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:39.957203 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb12087-4631-4073-98ac-faa7eb0e7ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:39.957987 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb12087-4631-4073-98ac-faa7eb0e7ecf None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:39.958275 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb12087-4631-4073-98ac-faa7eb0e7ecf None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:39.958552 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb12087-4631-4073-98ac-faa7eb0e7ecf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:39.965536 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb12087-4631-4073-98ac-faa7eb0e7ecf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:39.967048 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb12087-4631-4073-98ac-faa7eb0e7ecf None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:39.981406 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-0cb12087-4631-4073-98ac-faa7eb0e7ecf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 07 06:06:39.982950 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 262/537] 10.222.0.24 () {56 vars in 1111 bytes} [Thu Apr 7 06:06:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:39.989076 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb12087-4631-4073-98ac-faa7eb0e7ecf None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:40.021596 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa048c00-0d1a-4974-a7dd-93601bfe524c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:40.022263 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa048c00-0d1a-4974-a7dd-93601bfe524c None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:40.022546 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa048c00-0d1a-4974-a7dd-93601bfe524c None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:40.022821 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa048c00-0d1a-4974-a7dd-93601bfe524c None admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:40.024169 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa048c00-0d1a-4974-a7dd-93601bfe524c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:40.024481 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa048c00-0d1a-4974-a7dd-93601bfe524c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:40.025932 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa048c00-0d1a-4974-a7dd-93601bfe524c None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:40.054496 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 276/538] 10.222.0.24 () {56 vars in 1148 bytes} [Thu Apr 7 06:06:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:06:40.056018 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa048c00-0d1a-4974-a7dd-93601bfe524c None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:40.116467 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb12087-4631-4073-98ac-faa7eb0e7ecf None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:40.165032 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5878b630-22b9-461c-8bdb-bf2131414a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:40.165708 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878b630-22b9-461c-8bdb-bf2131414a43 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:40.165994 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878b630-22b9-461c-8bdb-bf2131414a43 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:40.166266 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878b630-22b9-461c-8bdb-bf2131414a43 None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:40.167063 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5878b630-22b9-461c-8bdb-bf2131414a43 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:40.167369 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5878b630-22b9-461c-8bdb-bf2131414a43 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:40.168851 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5878b630-22b9-461c-8bdb-bf2131414a43 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:40.195381 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa048c00-0d1a-4974-a7dd-93601bfe524c None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:40.203147 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 263/539] 10.222.0.24 () {56 vars in 1148 bytes} [Thu Apr 7 06:06:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:40.209153 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5878b630-22b9-461c-8bdb-bf2131414a43 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:40.234892 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9bf8ae-83d8-4b06-aa4f-0967b41cb1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:40.235591 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9bf8ae-83d8-4b06-aa4f-0967b41cb1b7 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:40.235866 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9bf8ae-83d8-4b06-aa4f-0967b41cb1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:40.236145 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9bf8ae-83d8-4b06-aa4f-0967b41cb1b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:40.236979 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9bf8ae-83d8-4b06-aa4f-0967b41cb1b7 None admin] RBAC: Adding query filter params (role.id=64a6094c7a2942afb375bfb185843fd6, scope.project.id=de88f2c333ae49cfa7fff7fa1ed0022c, user.id=0fc81e8151cc4dd2a79d3c6c9d9ceaeb) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:40.237289 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9bf8ae-83d8-4b06-aa4f-0967b41cb1b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:40.238745 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9bf8ae-83d8-4b06-aa4f-0967b41cb1b7 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:40.245909 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 277/540] 10.222.0.24 () {56 vars in 1374 bytes} [Thu Apr 7 06:06:40 2022] GET /identity/v3/role_assignments?user.id=0fc81e8151cc4dd2a79d3c6c9d9ceaeb&scope.project.id=de88f2c333ae49cfa7fff7fa1ed0022c&role.id=64a6094c7a2942afb375bfb185843fd6 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:40.362736 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5878b630-22b9-461c-8bdb-bf2131414a43 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:40.401105 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06269804-b90b-430a-9d08-86a472f208b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:40.402175 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06269804-b90b-430a-9d08-86a472f208b0 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:40.402660 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06269804-b90b-430a-9d08-86a472f208b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:40.403142 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06269804-b90b-430a-9d08-86a472f208b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:40.404234 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06269804-b90b-430a-9d08-86a472f208b0 None admin] RBAC: Adding query filter params (role.id=64a6094c7a2942afb375bfb185843fd6, scope.project.id=de88f2c333ae49cfa7fff7fa1ed0022c, user.id=bb7f549fd26e4642828d4f476aef0239) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:40.404770 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06269804-b90b-430a-9d08-86a472f208b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:40.406469 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06269804-b90b-430a-9d08-86a472f208b0 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:40.413515 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 264/541] 10.222.0.24 () {56 vars in 1374 bytes} [Thu Apr 7 06:06:40 2022] GET /identity/v3/role_assignments?user.id=bb7f549fd26e4642828d4f476aef0239&scope.project.id=de88f2c333ae49cfa7fff7fa1ed0022c&role.id=64a6094c7a2942afb375bfb185843fd6 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:06:41.007007 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731143a2-93c9-410b-8118-b5f4a8994a11 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:41.007511 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731143a2-93c9-410b-8118-b5f4a8994a11 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:41.007617 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731143a2-93c9-410b-8118-b5f4a8994a11 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:41.009257 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 278/542] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:06:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:06:41.024688 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77943a-b359-4006-977f-2a7293628022 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:41.024912 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77943a-b359-4006-977f-2a7293628022 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:41.025189 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77943a-b359-4006-977f-2a7293628022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:41.041762 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-7e77943a-b359-4006-977f-2a7293628022 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:06:41.042938 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-7e77943a-b359-4006-977f-2a7293628022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:06:41.113598 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 265/543] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:06:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:06:41.149943 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731143a2-93c9-410b-8118-b5f4a8994a11 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:41.274243 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731143a2-93c9-410b-8118-b5f4a8994a11 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:41.323301 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a736f8f-cd25-4726-91e3-e063a1b623d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:41.324527 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a736f8f-cd25-4726-91e3-e063a1b623d5 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:41.325016 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a736f8f-cd25-4726-91e3-e063a1b623d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:41.325487 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a736f8f-cd25-4726-91e3-e063a1b623d5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:41.341129 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a736f8f-cd25-4726-91e3-e063a1b623d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:06:41.348487 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-7a736f8f-cd25-4726-91e3-e063a1b623d5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 07 06:06:41.350259 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 279/544] 10.222.0.24 () {56 vars in 1102 bytes} [Thu Apr 7 06:06:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:41.356858 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e77943a-b359-4006-977f-2a7293628022 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:41.499863 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e77943a-b359-4006-977f-2a7293628022 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:41.541225 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab4db8-4626-4eda-9b25-9c6017a5b837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:41.541902 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab4db8-4626-4eda-9b25-9c6017a5b837 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:41.542189 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab4db8-4626-4eda-9b25-9c6017a5b837 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:41.542469 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab4db8-4626-4eda-9b25-9c6017a5b837 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:41.543220 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ab4db8-4626-4eda-9b25-9c6017a5b837 None admin] RBAC: Adding query filter params (name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:41.543531 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ab4db8-4626-4eda-9b25-9c6017a5b837 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:41.544952 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ab4db8-4626-4eda-9b25-9c6017a5b837 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:41.559406 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 266/545] 10.222.0.24 () {56 vars in 1103 bytes} [Thu Apr 7 06:06:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:41.564965 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a736f8f-cd25-4726-91e3-e063a1b623d5 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:41.666570 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1865d-13ae-40d0-9f77-c947314fab4e None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:41.666864 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1865d-13ae-40d0-9f77-c947314fab4e None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:41.667050 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1865d-13ae-40d0-9f77-c947314fab4e None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:41.668720 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 267/546] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:06:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 07 06:06:41.673631 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03778931-df28-44e0-ab10-2c4fd380d9d6 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:41.673863 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03778931-df28-44e0-ab10-2c4fd380d9d6 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:41.674146 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03778931-df28-44e0-ab10-2c4fd380d9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:41.689704 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a736f8f-cd25-4726-91e3-e063a1b623d5 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:41.701223 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-03778931-df28-44e0-ab10-2c4fd380d9d6 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:06:41.702404 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-03778931-df28-44e0-ab10-2c4fd380d9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:06:41.729690 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75175ac2-a709-48e4-9e8b-23e2865b3f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:41.731017 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75175ac2-a709-48e4-9e8b-23e2865b3f63 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:41.732642 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75175ac2-a709-48e4-9e8b-23e2865b3f63 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:41.733881 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75175ac2-a709-48e4-9e8b-23e2865b3f63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:41.753912 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75175ac2-a709-48e4-9e8b-23e2865b3f63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:41.757316 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75175ac2-a709-48e4-9e8b-23e2865b3f63 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:41.780755 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-75175ac2-a709-48e4-9e8b-23e2865b3f63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:06:41.782640 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 280/547] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:06:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:41.788629 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75175ac2-a709-48e4-9e8b-23e2865b3f63 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:41.862035 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 268/548] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:06:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 07 06:06:41.896400 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03778931-df28-44e0-ab10-2c4fd380d9d6 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:41.906208 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75175ac2-a709-48e4-9e8b-23e2865b3f63 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:41.944539 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1427e87-4bad-4a35-b1af-55ee179f67f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:41.946019 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1427e87-4bad-4a35-b1af-55ee179f67f8 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:41.946483 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1427e87-4bad-4a35-b1af-55ee179f67f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:41.947997 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1427e87-4bad-4a35-b1af-55ee179f67f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:41.948899 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1427e87-4bad-4a35-b1af-55ee179f67f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:41.950063 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1427e87-4bad-4a35-b1af-55ee179f67f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:41.951603 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1427e87-4bad-4a35-b1af-55ee179f67f8 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:41.972182 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 281/549] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:06:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:41.978959 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1427e87-4bad-4a35-b1af-55ee179f67f8 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:42.092441 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1427e87-4bad-4a35-b1af-55ee179f67f8 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:42.109177 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03778931-df28-44e0-ab10-2c4fd380d9d6 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:42.126991 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bef93e5-6403-4451-a46d-5ee0282cae4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:42.128057 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef93e5-6403-4451-a46d-5ee0282cae4b None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:42.128504 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef93e5-6403-4451-a46d-5ee0282cae4b None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:42.128921 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef93e5-6403-4451-a46d-5ee0282cae4b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:42.136367 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bef93e5-6403-4451-a46d-5ee0282cae4b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:42.137964 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bef93e5-6403-4451-a46d-5ee0282cae4b None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:42.148253 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f8b467-3e32-4727-941a-cc7e066ae635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:42.148253 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8b467-3e32-4727-941a-cc7e066ae635 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:42.148253 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8b467-3e32-4727-941a-cc7e066ae635 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:42.148253 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8b467-3e32-4727-941a-cc7e066ae635 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:42.160033 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-5bef93e5-6403-4451-a46d-5ee0282cae4b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 07 06:06:42.161241 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 282/550] 10.222.0.24 () {56 vars in 1096 bytes} [Thu Apr 7 06:06:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:42.167297 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bef93e5-6403-4451-a46d-5ee0282cae4b None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:42.169910 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f8b467-3e32-4727-941a-cc7e066ae635 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:06:42.182351 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-67f8b467-3e32-4727-941a-cc7e066ae635 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 07 06:06:42.183567 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 269/551] 10.222.0.24 () {56 vars in 1102 bytes} [Thu Apr 7 06:06:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:42.192629 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f8b467-3e32-4727-941a-cc7e066ae635 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:42.284001 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bef93e5-6403-4451-a46d-5ee0282cae4b None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:42.319721 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfef5ad-9f88-44fc-9806-0b27da021f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:42.320941 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfef5ad-9f88-44fc-9806-0b27da021f87 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:42.321427 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfef5ad-9f88-44fc-9806-0b27da021f87 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:42.321943 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfef5ad-9f88-44fc-9806-0b27da021f87 None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:42.322384 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f8b467-3e32-4727-941a-cc7e066ae635 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:42.323209 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfef5ad-9f88-44fc-9806-0b27da021f87 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:42.323730 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfef5ad-9f88-44fc-9806-0b27da021f87 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:42.325394 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfef5ad-9f88-44fc-9806-0b27da021f87 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:42.343534 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 283/552] 10.222.0.24 () {56 vars in 1135 bytes} [Thu Apr 7 06:06:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:06:42.345467 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721dc4c6-518f-4872-b7bd-67cb25c66c97 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:42.345959 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721dc4c6-518f-4872-b7bd-67cb25c66c97 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:42.346447 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721dc4c6-518f-4872-b7bd-67cb25c66c97 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:42.348178 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 284/553] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:06:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:06:42.349093 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721dc4c6-518f-4872-b7bd-67cb25c66c97 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:42.365829 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1876287-3097-48ac-a548-d5a39254f422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:42.368099 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1876287-3097-48ac-a548-d5a39254f422 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:42.368909 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1876287-3097-48ac-a548-d5a39254f422 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:42.369446 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1876287-3097-48ac-a548-d5a39254f422 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:42.375954 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1876287-3097-48ac-a548-d5a39254f422 None admin] RBAC: Adding query filter params (name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:42.376528 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1876287-3097-48ac-a548-d5a39254f422 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:42.378179 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1876287-3097-48ac-a548-d5a39254f422 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:42.395698 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 270/554] 10.222.0.24 () {56 vars in 1103 bytes} [Thu Apr 7 06:06:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:42.395698 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ad458-33a1-4a91-911e-f85517e67ce4 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:42.395698 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ad458-33a1-4a91-911e-f85517e67ce4 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:42.395698 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ad458-33a1-4a91-911e-f85517e67ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:42.419769 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-ce5ad458-33a1-4a91-911e-f85517e67ce4 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:06:42.419769 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-ce5ad458-33a1-4a91-911e-f85517e67ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:06:42.467297 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721dc4c6-518f-4872-b7bd-67cb25c66c97 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:42.499973 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 271/555] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:06:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:06:42.500834 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5ad458-33a1-4a91-911e-f85517e67ce4 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:42.514440 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f287f3-99d6-4268-b546-1c9983bd546d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:42.515150 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f287f3-99d6-4268-b546-1c9983bd546d None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:42.515438 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f287f3-99d6-4268-b546-1c9983bd546d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:42.515782 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f287f3-99d6-4268-b546-1c9983bd546d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:42.584702 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f287f3-99d6-4268-b546-1c9983bd546d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:42.586623 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f287f3-99d6-4268-b546-1c9983bd546d None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:42.633122 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5ad458-33a1-4a91-911e-f85517e67ce4 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:42.676483 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a0177e-ee56-4a41-bf97-ab14a82ab0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:42.677314 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0177e-ee56-4a41-bf97-ab14a82ab0f4 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:42.677601 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0177e-ee56-4a41-bf97-ab14a82ab0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:42.677876 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0177e-ee56-4a41-bf97-ab14a82ab0f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:42.689114 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a0177e-ee56-4a41-bf97-ab14a82ab0f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:42.690589 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a0177e-ee56-4a41-bf97-ab14a82ab0f4 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:42.691581 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 285/556] 10.222.0.24 () {58 vars in 1282 bytes} [Thu Apr 7 06:06:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 07 06:06:42.692640 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f287f3-99d6-4268-b546-1c9983bd546d None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:42.710141 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-e8a0177e-ee56-4a41-bf97-ab14a82ab0f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:06:42.711912 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 272/557] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:06:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:42.712779 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a0177e-ee56-4a41-bf97-ab14a82ab0f4 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:42.807180 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f287f3-99d6-4268-b546-1c9983bd546d None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:42.844131 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a0177e-ee56-4a41-bf97-ab14a82ab0f4 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:42.854907 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f482be99-4ffb-4077-802a-08b2c8856000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:42.855780 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482be99-4ffb-4077-802a-08b2c8856000 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:42.856462 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482be99-4ffb-4077-802a-08b2c8856000 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:42.856746 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482be99-4ffb-4077-802a-08b2c8856000 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:42.869827 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f482be99-4ffb-4077-802a-08b2c8856000 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:06:42.879676 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-f482be99-4ffb-4077-802a-08b2c8856000 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 07 06:06:42.886251 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 286/558] 10.222.0.24 () {56 vars in 1102 bytes} [Thu Apr 7 06:06:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:42.886251 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f482be99-4ffb-4077-802a-08b2c8856000 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:42.889644 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4caeee0-e978-46e6-affc-a7ce66d58d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:42.890640 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4caeee0-e978-46e6-affc-a7ce66d58d4f None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:42.891087 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4caeee0-e978-46e6-affc-a7ce66d58d4f None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:42.891507 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4caeee0-e978-46e6-affc-a7ce66d58d4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:42.904787 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4caeee0-e978-46e6-affc-a7ce66d58d4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:42.906729 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4caeee0-e978-46e6-affc-a7ce66d58d4f None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:42.930265 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-a4caeee0-e978-46e6-affc-a7ce66d58d4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:06:42.932613 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 273/559] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:06:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:42.934191 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4caeee0-e978-46e6-affc-a7ce66d58d4f None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:42.996013 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f482be99-4ffb-4077-802a-08b2c8856000 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:43.035987 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad50b1-23c5-4e4d-9e37-0ef9f08a2a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:43.036660 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad50b1-23c5-4e4d-9e37-0ef9f08a2a7d None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:43.036944 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad50b1-23c5-4e4d-9e37-0ef9f08a2a7d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:43.037220 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad50b1-23c5-4e4d-9e37-0ef9f08a2a7d None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:43.037943 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ad50b1-23c5-4e4d-9e37-0ef9f08a2a7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:43.038248 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ad50b1-23c5-4e4d-9e37-0ef9f08a2a7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:43.040170 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ad50b1-23c5-4e4d-9e37-0ef9f08a2a7d None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:43.052658 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4caeee0-e978-46e6-affc-a7ce66d58d4f None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:43.055230 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 287/560] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:06:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:43.056870 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad50b1-23c5-4e4d-9e37-0ef9f08a2a7d None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:43.087921 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab297a5-a3f6-44dc-bc81-7e262741bd53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:43.088643 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab297a5-a3f6-44dc-bc81-7e262741bd53 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:43.088938 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab297a5-a3f6-44dc-bc81-7e262741bd53 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:43.089218 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab297a5-a3f6-44dc-bc81-7e262741bd53 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:43.089971 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab297a5-a3f6-44dc-bc81-7e262741bd53 None admin] RBAC: Adding query filter params (name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:43.090290 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab297a5-a3f6-44dc-bc81-7e262741bd53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:43.091673 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab297a5-a3f6-44dc-bc81-7e262741bd53 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:43.099686 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 274/561] 10.222.0.24 () {56 vars in 1103 bytes} [Thu Apr 7 06:06:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:43.105210 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2cfbc8-03ee-45f1-aa48-689178b3f0c6 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:43.105691 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2cfbc8-03ee-45f1-aa48-689178b3f0c6 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:43.105983 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2cfbc8-03ee-45f1-aa48-689178b3f0c6 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:43.107274 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 275/562] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:06:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:06:43.108011 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2cfbc8-03ee-45f1-aa48-689178b3f0c6 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:43.163203 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad50b1-23c5-4e4d-9e37-0ef9f08a2a7d None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:43.197644 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b392e-db52-45b0-bf7f-6ccdfa7e5134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:43.198316 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b392e-db52-45b0-bf7f-6ccdfa7e5134 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:43.198601 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b392e-db52-45b0-bf7f-6ccdfa7e5134 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:43.198870 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b392e-db52-45b0-bf7f-6ccdfa7e5134 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:43.199590 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b392e-db52-45b0-bf7f-6ccdfa7e5134 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:43.200002 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b392e-db52-45b0-bf7f-6ccdfa7e5134 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:43.201387 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b392e-db52-45b0-bf7f-6ccdfa7e5134 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:43.212388 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 288/563] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:06:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:43.212839 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2cfbc8-03ee-45f1-aa48-689178b3f0c6 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:43.213329 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b392e-db52-45b0-bf7f-6ccdfa7e5134 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:43.244665 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b9f637-9f3e-4109-9798-c1054359bb61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:43.245444 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9f637-9f3e-4109-9798-c1054359bb61 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:43.245731 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9f637-9f3e-4109-9798-c1054359bb61 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:43.246004 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9f637-9f3e-4109-9798-c1054359bb61 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:43.253064 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b9f637-9f3e-4109-9798-c1054359bb61 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:43.254487 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b9f637-9f3e-4109-9798-c1054359bb61 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:43.267764 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-f7b9f637-9f3e-4109-9798-c1054359bb61 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 07 06:06:43.268905 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 276/564] 10.222.0.24 () {56 vars in 1093 bytes} [Thu Apr 7 06:06:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:43.270029 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce22de-547b-4bbd-aa39-62c04d735d7c None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:43.270312 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce22de-547b-4bbd-aa39-62c04d735d7c None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:43.270585 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce22de-547b-4bbd-aa39-62c04d735d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:43.285823 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-4bce22de-547b-4bbd-aa39-62c04d735d7c None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:06:43.286994 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-4bce22de-547b-4bbd-aa39-62c04d735d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:06:43.311974 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b392e-db52-45b0-bf7f-6ccdfa7e5134 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:43.343144 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700dc64-b670-4a0c-b02b-0724ecdab9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:43.343981 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700dc64-b670-4a0c-b02b-0724ecdab9b1 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:43.344263 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700dc64-b670-4a0c-b02b-0724ecdab9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:43.344558 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700dc64-b670-4a0c-b02b-0724ecdab9b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:43.348900 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 277/565] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:06:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:06:43.350271 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548139e-444b-42e0-8d24-06933b967fbe None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:43.350514 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548139e-444b-42e0-8d24-06933b967fbe None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:43.350795 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548139e-444b-42e0-8d24-06933b967fbe None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:43.352156 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 278/566] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:06:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:06:43.352860 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9548139e-444b-42e0-8d24-06933b967fbe None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:43.364015 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3700dc64-b670-4a0c-b02b-0724ecdab9b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:43.365707 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3700dc64-b670-4a0c-b02b-0724ecdab9b1 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:43.382079 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-3700dc64-b670-4a0c-b02b-0724ecdab9b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:06:43.383822 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 289/567] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:06:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:43.384568 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700dc64-b670-4a0c-b02b-0724ecdab9b1 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:43.448436 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9548139e-444b-42e0-8d24-06933b967fbe None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:43.479032 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700dc64-b670-4a0c-b02b-0724ecdab9b1 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:43.479913 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192516cc-0bea-4458-b337-221ed78f06e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:43.480702 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192516cc-0bea-4458-b337-221ed78f06e9 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:43.480983 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192516cc-0bea-4458-b337-221ed78f06e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:43.481272 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192516cc-0bea-4458-b337-221ed78f06e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:43.491252 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192516cc-0bea-4458-b337-221ed78f06e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:43.492762 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192516cc-0bea-4458-b337-221ed78f06e9 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:43.505416 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-192516cc-0bea-4458-b337-221ed78f06e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 07 06:06:43.506584 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 279/568] 10.222.0.24 () {56 vars in 1111 bytes} [Thu Apr 7 06:06:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:43.508275 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5a4b6-4c74-48bc-98bd-02fd601a8c24 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:43.508560 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5a4b6-4c74-48bc-98bd-02fd601a8c24 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:43.508831 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5a4b6-4c74-48bc-98bd-02fd601a8c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:43.513454 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc35db-26a4-4094-8e7b-dc83583745d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:43.514130 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc35db-26a4-4094-8e7b-dc83583745d3 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:43.514414 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc35db-26a4-4094-8e7b-dc83583745d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:43.514689 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc35db-26a4-4094-8e7b-dc83583745d3 None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:43.515520 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befc35db-26a4-4094-8e7b-dc83583745d3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:43.515862 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befc35db-26a4-4094-8e7b-dc83583745d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:43.517277 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befc35db-26a4-4094-8e7b-dc83583745d3 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:43.525305 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-75c5a4b6-4c74-48bc-98bd-02fd601a8c24 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:06:43.526485 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-75c5a4b6-4c74-48bc-98bd-02fd601a8c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:06:43.534254 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 290/569] 10.222.0.24 () {56 vars in 1133 bytes} [Thu Apr 7 06:06:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:43.535198 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc35db-26a4-4094-8e7b-dc83583745d3 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:43.588529 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 280/570] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:06:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:06:43.589585 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c5a4b6-4c74-48bc-98bd-02fd601a8c24 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:43.628576 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc35db-26a4-4094-8e7b-dc83583745d3 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:43.660638 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e429116-7c55-45f0-87f2-b3c4f1f274a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:43.661421 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e429116-7c55-45f0-87f2-b3c4f1f274a1 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:43.661699 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e429116-7c55-45f0-87f2-b3c4f1f274a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:43.661967 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e429116-7c55-45f0-87f2-b3c4f1f274a1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:43.671442 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e429116-7c55-45f0-87f2-b3c4f1f274a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:06:43.678250 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-1e429116-7c55-45f0-87f2-b3c4f1f274a1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 07 06:06:43.679424 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 291/571] 10.222.0.24 () {56 vars in 1102 bytes} [Thu Apr 7 06:06:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:43.680190 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e429116-7c55-45f0-87f2-b3c4f1f274a1 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:43.681834 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c5a4b6-4c74-48bc-98bd-02fd601a8c24 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:43.714391 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae3f7e4-d32e-41a6-8f41-f797fce2f84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:43.715051 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae3f7e4-d32e-41a6-8f41-f797fce2f84b None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:43.715334 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae3f7e4-d32e-41a6-8f41-f797fce2f84b None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:43.715609 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae3f7e4-d32e-41a6-8f41-f797fce2f84b None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:43.716369 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae3f7e4-d32e-41a6-8f41-f797fce2f84b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:43.716676 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae3f7e4-d32e-41a6-8f41-f797fce2f84b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:43.718051 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae3f7e4-d32e-41a6-8f41-f797fce2f84b None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:43.729318 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 281/572] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:06:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:43.730101 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae3f7e4-d32e-41a6-8f41-f797fce2f84b None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:43.772779 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e429116-7c55-45f0-87f2-b3c4f1f274a1 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:43.805639 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff37d12-4793-4200-9e5e-d3d73a59c93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:43.806302 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff37d12-4793-4200-9e5e-d3d73a59c93c None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:43.806588 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff37d12-4793-4200-9e5e-d3d73a59c93c None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:43.806881 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff37d12-4793-4200-9e5e-d3d73a59c93c None admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:43.807642 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff37d12-4793-4200-9e5e-d3d73a59c93c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:43.807981 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff37d12-4793-4200-9e5e-d3d73a59c93c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:43.809411 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff37d12-4793-4200-9e5e-d3d73a59c93c None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:43.822099 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 292/573] 10.222.0.24 () {56 vars in 1148 bytes} [Thu Apr 7 06:06:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:43.822880 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff37d12-4793-4200-9e5e-d3d73a59c93c None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:43.836005 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae3f7e4-d32e-41a6-8f41-f797fce2f84b None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:43.867652 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a449ac0-8b7f-41f0-a1a5-c3792a54c7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:43.868467 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a449ac0-8b7f-41f0-a1a5-c3792a54c7ff None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:43.868748 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a449ac0-8b7f-41f0-a1a5-c3792a54c7ff None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:43.869019 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a449ac0-8b7f-41f0-a1a5-c3792a54c7ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:43.879083 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a449ac0-8b7f-41f0-a1a5-c3792a54c7ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:43.880480 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a449ac0-8b7f-41f0-a1a5-c3792a54c7ff None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:43.896713 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-8a449ac0-8b7f-41f0-a1a5-c3792a54c7ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:06:43.897879 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 282/574] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:06:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:43.898676 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a449ac0-8b7f-41f0-a1a5-c3792a54c7ff None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:43.913726 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff37d12-4793-4200-9e5e-d3d73a59c93c None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:43.944824 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacfd33c-22c8-41f9-8d51-f7c9d4bf2c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:43.945664 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacfd33c-22c8-41f9-8d51-f7c9d4bf2c23 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:43.945948 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacfd33c-22c8-41f9-8d51-f7c9d4bf2c23 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:43.946220 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacfd33c-22c8-41f9-8d51-f7c9d4bf2c23 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:43.955680 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacfd33c-22c8-41f9-8d51-f7c9d4bf2c23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:06:43.963366 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-eacfd33c-22c8-41f9-8d51-f7c9d4bf2c23 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 07 06:06:43.964542 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 293/575] 10.222.0.24 () {56 vars in 1102 bytes} [Thu Apr 7 06:06:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:43.965315 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacfd33c-22c8-41f9-8d51-f7c9d4bf2c23 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:43.993352 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a449ac0-8b7f-41f0-a1a5-c3792a54c7ff None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:44.024621 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881e4a50-9954-4d8b-bb5f-a36f7f2963f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:44.025281 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e4a50-9954-4d8b-bb5f-a36f7f2963f9 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:44.025565 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e4a50-9954-4d8b-bb5f-a36f7f2963f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:44.025841 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e4a50-9954-4d8b-bb5f-a36f7f2963f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:44.026583 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881e4a50-9954-4d8b-bb5f-a36f7f2963f9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:44.026890 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881e4a50-9954-4d8b-bb5f-a36f7f2963f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:44.028289 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881e4a50-9954-4d8b-bb5f-a36f7f2963f9 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:44.035792 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 283/576] 10.222.0.24 () {56 vars in 1103 bytes} [Thu Apr 7 06:06:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:44.036536 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881e4a50-9954-4d8b-bb5f-a36f7f2963f9 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:44.057322 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacfd33c-22c8-41f9-8d51-f7c9d4bf2c23 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:44.088433 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eafb9c-1d43-4b6f-ac33-1719554066c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:44.089219 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eafb9c-1d43-4b6f-ac33-1719554066c4 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:44.089499 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eafb9c-1d43-4b6f-ac33-1719554066c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:44.089772 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eafb9c-1d43-4b6f-ac33-1719554066c4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:44.096745 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eafb9c-1d43-4b6f-ac33-1719554066c4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:44.098185 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eafb9c-1d43-4b6f-ac33-1719554066c4 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:44.111518 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-09eafb9c-1d43-4b6f-ac33-1719554066c4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 07 06:06:44.112695 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 294/577] 10.222.0.24 () {56 vars in 1099 bytes} [Thu Apr 7 06:06:43 2022] GET /identity/v3/users/glance => generated 84 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:44.113445 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eafb9c-1d43-4b6f-ac33-1719554066c4 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:44.129693 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881e4a50-9954-4d8b-bb5f-a36f7f2963f9 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:44.160794 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be9598-3334-44d2-a830-d30291c5f5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:44.161457 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be9598-3334-44d2-a830-d30291c5f5ff None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:44.161746 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be9598-3334-44d2-a830-d30291c5f5ff None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:44.162026 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be9598-3334-44d2-a830-d30291c5f5ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:44.162857 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55be9598-3334-44d2-a830-d30291c5f5ff None admin] RBAC: Adding query filter params (role.id=64a6094c7a2942afb375bfb185843fd6, scope.project.id=de88f2c333ae49cfa7fff7fa1ed0022c, user.id=8b4abbb8c5324b7babd69e3b4473b3e2) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:44.163176 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55be9598-3334-44d2-a830-d30291c5f5ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:44.165146 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55be9598-3334-44d2-a830-d30291c5f5ff None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:44.170421 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 284/578] 10.222.0.24 () {56 vars in 1374 bytes} [Thu Apr 7 06:06:44 2022] GET /identity/v3/role_assignments?user.id=8b4abbb8c5324b7babd69e3b4473b3e2&scope.project.id=de88f2c333ae49cfa7fff7fa1ed0022c&role.id=64a6094c7a2942afb375bfb185843fd6 => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:44.171190 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be9598-3334-44d2-a830-d30291c5f5ff None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:44.213394 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eafb9c-1d43-4b6f-ac33-1719554066c4 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:44.249607 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e477418-30d9-4dbf-845e-8d755d6175a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:44.250325 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e477418-30d9-4dbf-845e-8d755d6175a1 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:44.250612 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e477418-30d9-4dbf-845e-8d755d6175a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:44.250893 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e477418-30d9-4dbf-845e-8d755d6175a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:44.251641 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e477418-30d9-4dbf-845e-8d755d6175a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:44.251977 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e477418-30d9-4dbf-845e-8d755d6175a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:44.253376 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e477418-30d9-4dbf-845e-8d755d6175a1 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:44.266044 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 295/579] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:06:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:44.267279 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e477418-30d9-4dbf-845e-8d755d6175a1 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:44.283887 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be9598-3334-44d2-a830-d30291c5f5ff None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:44.319139 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b9558-2842-4d0e-861f-51eb080cae49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:44.319925 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b9558-2842-4d0e-861f-51eb080cae49 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:44.320253 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b9558-2842-4d0e-861f-51eb080cae49 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:44.320531 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b9558-2842-4d0e-861f-51eb080cae49 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:44.321428 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02b9558-2842-4d0e-861f-51eb080cae49 None admin] RBAC: Adding query filter params (name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:44.321746 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02b9558-2842-4d0e-861f-51eb080cae49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:44.323175 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02b9558-2842-4d0e-861f-51eb080cae49 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:44.331797 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 285/580] 10.222.0.24 () {56 vars in 1103 bytes} [Thu Apr 7 06:06:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:44.332682 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b9558-2842-4d0e-861f-51eb080cae49 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:44.372330 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e477418-30d9-4dbf-845e-8d755d6175a1 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:44.411710 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596772c0-2d68-417a-8ff7-8a1238668beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:44.412469 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596772c0-2d68-417a-8ff7-8a1238668beb None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:44.412754 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596772c0-2d68-417a-8ff7-8a1238668beb None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:44.413030 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596772c0-2d68-417a-8ff7-8a1238668beb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:44.423403 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596772c0-2d68-417a-8ff7-8a1238668beb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:44.424868 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596772c0-2d68-417a-8ff7-8a1238668beb None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:44.441597 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-596772c0-2d68-417a-8ff7-8a1238668beb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:06:44.443165 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 296/581] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:06:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:44.444039 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596772c0-2d68-417a-8ff7-8a1238668beb None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:44.451358 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b9558-2842-4d0e-861f-51eb080cae49 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:44.492766 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e1b41d-c660-495e-b13f-f4205e11a529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:44.493439 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1b41d-c660-495e-b13f-f4205e11a529 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:44.493723 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1b41d-c660-495e-b13f-f4205e11a529 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:44.493990 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1b41d-c660-495e-b13f-f4205e11a529 None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:44.494820 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e1b41d-c660-495e-b13f-f4205e11a529 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:44.495123 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e1b41d-c660-495e-b13f-f4205e11a529 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:44.496571 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e1b41d-c660-495e-b13f-f4205e11a529 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:44.517572 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 286/582] 10.222.0.24 () {56 vars in 1137 bytes} [Thu Apr 7 06:06:44 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:44.517572 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e1b41d-c660-495e-b13f-f4205e11a529 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:44.551755 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596772c0-2d68-417a-8ff7-8a1238668beb None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:44.584455 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950ac201-e1a0-4c04-87df-27beff46fb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:44.585323 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ac201-e1a0-4c04-87df-27beff46fb21 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:44.586126 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ac201-e1a0-4c04-87df-27beff46fb21 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:44.586407 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ac201-e1a0-4c04-87df-27beff46fb21 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:44.592868 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950ac201-e1a0-4c04-87df-27beff46fb21 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:44.594316 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950ac201-e1a0-4c04-87df-27beff46fb21 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:44.607509 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-950ac201-e1a0-4c04-87df-27beff46fb21 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 07 06:06:44.612065 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 297/583] 10.222.0.24 () {56 vars in 1111 bytes} [Thu Apr 7 06:06:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:44.612957 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950ac201-e1a0-4c04-87df-27beff46fb21 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:44.615841 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e1b41d-c660-495e-b13f-f4205e11a529 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:44.649197 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd51d34-6bd9-40d0-8d9d-599ff7b0a052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:44.649988 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd51d34-6bd9-40d0-8d9d-599ff7b0a052 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:44.650265 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd51d34-6bd9-40d0-8d9d-599ff7b0a052 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:44.650533 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd51d34-6bd9-40d0-8d9d-599ff7b0a052 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:44.660152 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd51d34-6bd9-40d0-8d9d-599ff7b0a052 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:44.661703 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd51d34-6bd9-40d0-8d9d-599ff7b0a052 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:44.678161 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-6cd51d34-6bd9-40d0-8d9d-599ff7b0a052 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:06:44.680009 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 287/584] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:06:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:44.680656 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd51d34-6bd9-40d0-8d9d-599ff7b0a052 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:44.712133 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950ac201-e1a0-4c04-87df-27beff46fb21 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:44.744428 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a344f77-bb4e-425d-b987-9d8b76f24c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:44.745096 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a344f77-bb4e-425d-b987-9d8b76f24c17 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:44.745383 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a344f77-bb4e-425d-b987-9d8b76f24c17 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:44.745657 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a344f77-bb4e-425d-b987-9d8b76f24c17 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:44.746380 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a344f77-bb4e-425d-b987-9d8b76f24c17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:44.746685 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a344f77-bb4e-425d-b987-9d8b76f24c17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:44.748071 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a344f77-bb4e-425d-b987-9d8b76f24c17 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:44.766017 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 298/585] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:06:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:44.766861 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a344f77-bb4e-425d-b987-9d8b76f24c17 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:44.788772 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd51d34-6bd9-40d0-8d9d-599ff7b0a052 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:44.822166 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0978c57c-96d1-4710-862d-9862d8f0d548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:44.822955 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978c57c-96d1-4710-862d-9862d8f0d548 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:44.823238 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978c57c-96d1-4710-862d-9862d8f0d548 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:44.823509 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978c57c-96d1-4710-862d-9862d8f0d548 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:44.833335 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0978c57c-96d1-4710-862d-9862d8f0d548 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:44.834771 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0978c57c-96d1-4710-862d-9862d8f0d548 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:44.852189 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-0978c57c-96d1-4710-862d-9862d8f0d548 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:06:44.853368 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 288/586] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:06:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:44.857904 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0978c57c-96d1-4710-862d-9862d8f0d548 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:44.867215 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a344f77-bb4e-425d-b987-9d8b76f24c17 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:44.901835 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c843d-2b64-4207-afd9-86b525d12e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:44.902594 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c843d-2b64-4207-afd9-86b525d12e68 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:44.902962 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c843d-2b64-4207-afd9-86b525d12e68 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:44.903387 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c843d-2b64-4207-afd9-86b525d12e68 None admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:44.904225 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0c843d-2b64-4207-afd9-86b525d12e68 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:44.904563 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0c843d-2b64-4207-afd9-86b525d12e68 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:44.905990 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0c843d-2b64-4207-afd9-86b525d12e68 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:44.917620 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 299/587] 10.222.0.24 () {56 vars in 1148 bytes} [Thu Apr 7 06:06:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:44.918266 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c843d-2b64-4207-afd9-86b525d12e68 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:44.956707 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0978c57c-96d1-4710-862d-9862d8f0d548 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:44.990858 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c11d4-a38c-40d5-b98b-0be1176e916b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:44.991536 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c11d4-a38c-40d5-b98b-0be1176e916b None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:44.991850 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c11d4-a38c-40d5-b98b-0be1176e916b None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:44.992208 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c11d4-a38c-40d5-b98b-0be1176e916b None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:44.992938 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c11d4-a38c-40d5-b98b-0be1176e916b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:44.993249 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c11d4-a38c-40d5-b98b-0be1176e916b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:44.994627 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c11d4-a38c-40d5-b98b-0be1176e916b None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:45.005600 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 289/588] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:06:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:45.006398 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c11d4-a38c-40d5-b98b-0be1176e916b None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:45.021522 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c843d-2b64-4207-afd9-86b525d12e68 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:45.053868 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3066e9a-d54e-4c97-bb9d-567d8df2f718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:45.054676 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3066e9a-d54e-4c97-bb9d-567d8df2f718 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:45.054962 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3066e9a-d54e-4c97-bb9d-567d8df2f718 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:45.055236 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3066e9a-d54e-4c97-bb9d-567d8df2f718 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:45.062811 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3066e9a-d54e-4c97-bb9d-567d8df2f718 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:45.064281 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3066e9a-d54e-4c97-bb9d-567d8df2f718 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:45.078708 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-e3066e9a-d54e-4c97-bb9d-567d8df2f718 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 07 06:06:45.084100 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 300/589] 10.222.0.24 () {56 vars in 1102 bytes} [Thu Apr 7 06:06:44 2022] GET /identity/v3/users/neutron => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:45.085245 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3066e9a-d54e-4c97-bb9d-567d8df2f718 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:45.102488 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c11d4-a38c-40d5-b98b-0be1176e916b None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:45.137289 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd2ada-8f79-45c9-8065-b015660017d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:45.138340 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd2ada-8f79-45c9-8065-b015660017d4 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:45.138829 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd2ada-8f79-45c9-8065-b015660017d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:45.139307 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd2ada-8f79-45c9-8065-b015660017d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:45.140267 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bd2ada-8f79-45c9-8065-b015660017d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:45.140774 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bd2ada-8f79-45c9-8065-b015660017d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:45.142366 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bd2ada-8f79-45c9-8065-b015660017d4 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:45.156677 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 290/590] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:06:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:45.157842 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd2ada-8f79-45c9-8065-b015660017d4 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:45.185196 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3066e9a-d54e-4c97-bb9d-567d8df2f718 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:45.218715 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827645c-6e59-4db7-9401-8dba5923f214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:45.219526 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827645c-6e59-4db7-9401-8dba5923f214 None admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:45.219846 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827645c-6e59-4db7-9401-8dba5923f214 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:45.220120 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827645c-6e59-4db7-9401-8dba5923f214 None admin] PATH_INFO: `/v3/projects/de88f2c333ae49cfa7fff7fa1ed0022c/users/02cd81f6620f410db450871fb29961f6/roles/64a6094c7a2942afb375bfb185843fd6` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:45.234658 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9827645c-6e59-4db7-9401-8dba5923f214 None admin] RBAC: Authorizing `identity:create_grant(project_id=de88f2c333ae49cfa7fff7fa1ed0022c, user_id=02cd81f6620f410db450871fb29961f6, role_id=64a6094c7a2942afb375bfb185843fd6)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:45.236123 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9827645c-6e59-4db7-9401-8dba5923f214 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:45.254762 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd2ada-8f79-45c9-8065-b015660017d4 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:45.288420 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed28e56-2fed-4133-8130-ac762fe92504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:45.289402 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed28e56-2fed-4133-8130-ac762fe92504 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:45.289691 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed28e56-2fed-4133-8130-ac762fe92504 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:45.289972 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed28e56-2fed-4133-8130-ac762fe92504 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:45.297061 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed28e56-2fed-4133-8130-ac762fe92504 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:45.298510 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed28e56-2fed-4133-8130-ac762fe92504 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:45.311446 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 301/591] 10.222.0.24 () {58 vars in 1439 bytes} [Thu Apr 7 06:06:45 2022] PUT /identity/v3/projects/de88f2c333ae49cfa7fff7fa1ed0022c/users/02cd81f6620f410db450871fb29961f6/roles/64a6094c7a2942afb375bfb185843fd6 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:06:45.312401 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-3ed28e56-2fed-4133-8130-ac762fe92504 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 07 06:06:45.312682 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827645c-6e59-4db7-9401-8dba5923f214 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:45.317957 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 291/592] 10.222.0.24 () {56 vars in 1099 bytes} [Thu Apr 7 06:06:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:45.317957 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed28e56-2fed-4133-8130-ac762fe92504 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:45.426008 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827645c-6e59-4db7-9401-8dba5923f214 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:45.429068 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed28e56-2fed-4133-8130-ac762fe92504 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:45.463098 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f32fce-43db-4f84-99b0-189c6557577d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:45.463820 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f32fce-43db-4f84-99b0-189c6557577d None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:45.464108 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f32fce-43db-4f84-99b0-189c6557577d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:45.464386 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f32fce-43db-4f84-99b0-189c6557577d None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:45.465240 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f32fce-43db-4f84-99b0-189c6557577d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:45.465562 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f32fce-43db-4f84-99b0-189c6557577d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:45.467001 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f32fce-43db-4f84-99b0-189c6557577d None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:45.467450 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be92ceb9-1c8d-4656-8eaa-40fc6d8512c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:45.468937 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92ceb9-1c8d-4656-8eaa-40fc6d8512c8 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:45.469422 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92ceb9-1c8d-4656-8eaa-40fc6d8512c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:45.469887 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92ceb9-1c8d-4656-8eaa-40fc6d8512c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:45.477718 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be92ceb9-1c8d-4656-8eaa-40fc6d8512c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:45.479556 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be92ceb9-1c8d-4656-8eaa-40fc6d8512c8 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:45.493100 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 302/593] 10.222.0.24 () {56 vars in 1139 bytes} [Thu Apr 7 06:06:45 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:45.493100 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f32fce-43db-4f84-99b0-189c6557577d None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:45.500002 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-be92ceb9-1c8d-4656-8eaa-40fc6d8512c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 07 06:06:45.501704 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 292/594] 10.222.0.24 () {56 vars in 1111 bytes} [Thu Apr 7 06:06:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:45.502578 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be92ceb9-1c8d-4656-8eaa-40fc6d8512c8 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:45.606420 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f32fce-43db-4f84-99b0-189c6557577d None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:45.614198 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be92ceb9-1c8d-4656-8eaa-40fc6d8512c8 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:45.649499 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b7b26-c692-4d33-9f29-197fc037b6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:45.650396 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b7b26-c692-4d33-9f29-197fc037b6a5 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:45.650767 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b7b26-c692-4d33-9f29-197fc037b6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:45.651112 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b7b26-c692-4d33-9f29-197fc037b6a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:45.652833 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff12a5f5-696c-40c1-b2c0-026c10073dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:45.654102 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff12a5f5-696c-40c1-b2c0-026c10073dea None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:45.654531 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff12a5f5-696c-40c1-b2c0-026c10073dea None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:45.654943 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff12a5f5-696c-40c1-b2c0-026c10073dea None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:45.655941 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff12a5f5-696c-40c1-b2c0-026c10073dea None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:45.656384 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff12a5f5-696c-40c1-b2c0-026c10073dea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:45.657950 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff12a5f5-696c-40c1-b2c0-026c10073dea None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:45.662883 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b7b26-c692-4d33-9f29-197fc037b6a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:45.664971 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b7b26-c692-4d33-9f29-197fc037b6a5 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:45.678979 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 303/595] 10.222.0.24 () {56 vars in 1137 bytes} [Thu Apr 7 06:06:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:45.680106 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff12a5f5-696c-40c1-b2c0-026c10073dea None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:45.686465 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-f02b7b26-c692-4d33-9f29-197fc037b6a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:06:45.688084 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 293/596] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:06:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:45.692760 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b7b26-c692-4d33-9f29-197fc037b6a5 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:45.799952 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b7b26-c692-4d33-9f29-197fc037b6a5 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:45.806042 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff12a5f5-696c-40c1-b2c0-026c10073dea None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:45.833032 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c05d90c-373e-4d63-b80f-bc33326d0aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:45.833852 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05d90c-373e-4d63-b80f-bc33326d0aed None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:45.834149 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05d90c-373e-4d63-b80f-bc33326d0aed None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:45.834405 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05d90c-373e-4d63-b80f-bc33326d0aed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:45.845278 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c05d90c-373e-4d63-b80f-bc33326d0aed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:45.846792 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c05d90c-373e-4d63-b80f-bc33326d0aed None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:45.849800 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9203920-5f7f-453e-b9ea-a67fa5e15782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:45.850701 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9203920-5f7f-453e-b9ea-a67fa5e15782 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:45.851204 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9203920-5f7f-453e-b9ea-a67fa5e15782 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:45.851672 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9203920-5f7f-453e-b9ea-a67fa5e15782 None admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:45.852685 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9203920-5f7f-453e-b9ea-a67fa5e15782 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:45.853559 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9203920-5f7f-453e-b9ea-a67fa5e15782 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:45.855688 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9203920-5f7f-453e-b9ea-a67fa5e15782 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:45.863113 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-1c05d90c-373e-4d63-b80f-bc33326d0aed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:06:45.868178 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 304/597] 10.222.0.24 () {56 vars in 1148 bytes} [Thu Apr 7 06:06:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:45.869295 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9203920-5f7f-453e-b9ea-a67fa5e15782 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:45.869409 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 294/598] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:06:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:45.870331 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c05d90c-373e-4d63-b80f-bc33326d0aed None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:45.973209 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9203920-5f7f-453e-b9ea-a67fa5e15782 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:45.993621 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c05d90c-373e-4d63-b80f-bc33326d0aed None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:46.006932 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816187c-f2ae-42cb-b7a2-6b53ac82002b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:46.007812 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816187c-f2ae-42cb-b7a2-6b53ac82002b None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:46.008214 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816187c-f2ae-42cb-b7a2-6b53ac82002b None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:46.008580 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816187c-f2ae-42cb-b7a2-6b53ac82002b None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:46.009474 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2816187c-f2ae-42cb-b7a2-6b53ac82002b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:46.009896 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2816187c-f2ae-42cb-b7a2-6b53ac82002b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:46.011344 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2816187c-f2ae-42cb-b7a2-6b53ac82002b None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:46.027804 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 305/599] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:06:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:46.027804 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816187c-f2ae-42cb-b7a2-6b53ac82002b None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:46.040112 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f88d5-141e-4019-bd2c-62d4e90c0ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:46.041269 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f88d5-141e-4019-bd2c-62d4e90c0ffe None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:46.041693 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f88d5-141e-4019-bd2c-62d4e90c0ffe None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:46.042105 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f88d5-141e-4019-bd2c-62d4e90c0ffe None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:46.043120 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11f88d5-141e-4019-bd2c-62d4e90c0ffe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:46.043955 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11f88d5-141e-4019-bd2c-62d4e90c0ffe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:46.045722 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11f88d5-141e-4019-bd2c-62d4e90c0ffe None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:46.066596 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 295/600] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:06:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:46.067650 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f88d5-141e-4019-bd2c-62d4e90c0ffe None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:46.135684 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816187c-f2ae-42cb-b7a2-6b53ac82002b None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:46.171338 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ab0750-9f23-4434-ba63-420935ab84b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:46.172496 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab0750-9f23-4434-ba63-420935ab84b4 None admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:46.172829 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab0750-9f23-4434-ba63-420935ab84b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:46.173215 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab0750-9f23-4434-ba63-420935ab84b4 None admin] PATH_INFO: `/v3/projects/de88f2c333ae49cfa7fff7fa1ed0022c/users/0ca88debdfcc4a9d918e3b0138a9add1/roles/64a6094c7a2942afb375bfb185843fd6` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:46.187812 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ab0750-9f23-4434-ba63-420935ab84b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=de88f2c333ae49cfa7fff7fa1ed0022c, user_id=0ca88debdfcc4a9d918e3b0138a9add1, role_id=64a6094c7a2942afb375bfb185843fd6)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:46.189388 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ab0750-9f23-4434-ba63-420935ab84b4 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:46.193992 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f88d5-141e-4019-bd2c-62d4e90c0ffe None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:46.229127 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cab33c-00c6-4b36-86bf-add64b28cabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:46.229924 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cab33c-00c6-4b36-86bf-add64b28cabd None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:46.230244 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cab33c-00c6-4b36-86bf-add64b28cabd None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:46.230526 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cab33c-00c6-4b36-86bf-add64b28cabd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:46.237084 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cab33c-00c6-4b36-86bf-add64b28cabd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:46.238569 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cab33c-00c6-4b36-86bf-add64b28cabd None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:46.251827 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-22cab33c-00c6-4b36-86bf-add64b28cabd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 07 06:06:46.253033 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 296/601] 10.222.0.24 () {56 vars in 1111 bytes} [Thu Apr 7 06:06:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:46.253887 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cab33c-00c6-4b36-86bf-add64b28cabd None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:46.274495 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 306/602] 10.222.0.24 () {58 vars in 1439 bytes} [Thu Apr 7 06:06:46 2022] PUT /identity/v3/projects/de88f2c333ae49cfa7fff7fa1ed0022c/users/0ca88debdfcc4a9d918e3b0138a9add1/roles/64a6094c7a2942afb375bfb185843fd6 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:06:46.276111 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ab0750-9f23-4434-ba63-420935ab84b4 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:46.437659 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cab33c-00c6-4b36-86bf-add64b28cabd None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:46.460722 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ab0750-9f23-4434-ba63-420935ab84b4 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:46.488499 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee70484-e2d3-4eca-97ad-79297a9079ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:46.490106 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee70484-e2d3-4eca-97ad-79297a9079ce None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:46.490554 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee70484-e2d3-4eca-97ad-79297a9079ce None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:46.490844 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee70484-e2d3-4eca-97ad-79297a9079ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:46.499521 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee70484-e2d3-4eca-97ad-79297a9079ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:46.501041 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee70484-e2d3-4eca-97ad-79297a9079ce None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:46.511594 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa0bfb0-203f-4251-8418-cbd6f53fab63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:46.512551 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa0bfb0-203f-4251-8418-cbd6f53fab63 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:46.512551 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa0bfb0-203f-4251-8418-cbd6f53fab63 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:46.512845 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa0bfb0-203f-4251-8418-cbd6f53fab63 None admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:46.513640 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa0bfb0-203f-4251-8418-cbd6f53fab63 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:46.513949 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa0bfb0-203f-4251-8418-cbd6f53fab63 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:46.515375 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa0bfb0-203f-4251-8418-cbd6f53fab63 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:46.517275 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-2ee70484-e2d3-4eca-97ad-79297a9079ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 07 06:06:46.519054 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 297/603] 10.222.0.24 () {56 vars in 1111 bytes} [Thu Apr 7 06:06:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:46.521557 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01dd008-5d80-482a-b1c8-16c61a90ccc0 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:46.521557 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01dd008-5d80-482a-b1c8-16c61a90ccc0 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:46.521557 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01dd008-5d80-482a-b1c8-16c61a90ccc0 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:46.523643 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 298/604] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:06:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:06:46.524854 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01dd008-5d80-482a-b1c8-16c61a90ccc0 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:46.533178 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 307/605] 10.222.0.24 () {56 vars in 1148 bytes} [Thu Apr 7 06:06:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:46.534412 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4f596-df14-4e55-a19d-2edbf1c904bb None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:46.534657 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4f596-df14-4e55-a19d-2edbf1c904bb None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:46.534983 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4f596-df14-4e55-a19d-2edbf1c904bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:46.553657 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-4bc4f596-df14-4e55-a19d-2edbf1c904bb None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:06:46.555439 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-4bc4f596-df14-4e55-a19d-2edbf1c904bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:06:46.626568 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 308/606] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:06:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:06:46.626568 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc4f596-df14-4e55-a19d-2edbf1c904bb None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:46.671054 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01dd008-5d80-482a-b1c8-16c61a90ccc0 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:46.706507 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c6843b-247f-452e-a5ec-810d55705499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:46.707518 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6843b-247f-452e-a5ec-810d55705499 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:46.708032 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6843b-247f-452e-a5ec-810d55705499 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:46.708522 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6843b-247f-452e-a5ec-810d55705499 None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:46.709524 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c6843b-247f-452e-a5ec-810d55705499 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:46.710036 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c6843b-247f-452e-a5ec-810d55705499 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:46.712358 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c6843b-247f-452e-a5ec-810d55705499 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:46.724763 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 299/607] 10.222.0.24 () {56 vars in 1148 bytes} [Thu Apr 7 06:06:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:46.725846 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c6843b-247f-452e-a5ec-810d55705499 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:46.730657 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc4f596-df14-4e55-a19d-2edbf1c904bb None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:46.769128 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924386af-5c6f-4cda-8ca8-3780f64f8c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:46.770097 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924386af-5c6f-4cda-8ca8-3780f64f8c26 None admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:46.770431 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924386af-5c6f-4cda-8ca8-3780f64f8c26 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:46.770708 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924386af-5c6f-4cda-8ca8-3780f64f8c26 None admin] PATH_INFO: `/v3/projects/de88f2c333ae49cfa7fff7fa1ed0022c/users/bb7f549fd26e4642828d4f476aef0239/roles/64a6094c7a2942afb375bfb185843fd6` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:46.785560 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924386af-5c6f-4cda-8ca8-3780f64f8c26 None admin] RBAC: Authorizing `identity:create_grant(project_id=de88f2c333ae49cfa7fff7fa1ed0022c, user_id=bb7f549fd26e4642828d4f476aef0239, role_id=64a6094c7a2942afb375bfb185843fd6)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:46.787006 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924386af-5c6f-4cda-8ca8-3780f64f8c26 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:46.830653 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c6843b-247f-452e-a5ec-810d55705499 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:46.863595 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1265eb6f-65a8-4fa8-a0ce-0454a1060eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:46.864450 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265eb6f-65a8-4fa8-a0ce-0454a1060eee None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:46.864989 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265eb6f-65a8-4fa8-a0ce-0454a1060eee None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:46.865267 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265eb6f-65a8-4fa8-a0ce-0454a1060eee None admin] PATH_INFO: `/v3/roles/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:46.874994 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1265eb6f-65a8-4fa8-a0ce-0454a1060eee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:06:46.882162 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-1265eb6f-65a8-4fa8-a0ce-0454a1060eee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 07 06:06:46.888358 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 300/608] 10.222.0.24 () {56 vars in 1102 bytes} [Thu Apr 7 06:06:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:46.889176 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1265eb6f-65a8-4fa8-a0ce-0454a1060eee None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:46.890134 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 309/609] 10.222.0.24 () {58 vars in 1439 bytes} [Thu Apr 7 06:06:46 2022] PUT /identity/v3/projects/de88f2c333ae49cfa7fff7fa1ed0022c/users/bb7f549fd26e4642828d4f476aef0239/roles/64a6094c7a2942afb375bfb185843fd6 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:06:46.898758 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924386af-5c6f-4cda-8ca8-3780f64f8c26 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:47.089756 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1265eb6f-65a8-4fa8-a0ce-0454a1060eee None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:47.093313 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924386af-5c6f-4cda-8ca8-3780f64f8c26 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:47.153744 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c90c608-a09c-4b4b-a29d-ae5c99cc77f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:47.154640 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c90c608-a09c-4b4b-a29d-ae5c99cc77f2 None admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:47.154923 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c90c608-a09c-4b4b-a29d-ae5c99cc77f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:47.155195 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c90c608-a09c-4b4b-a29d-ae5c99cc77f2 None admin] PATH_INFO: `/v3/projects/de88f2c333ae49cfa7fff7fa1ed0022c/users/0fc81e8151cc4dd2a79d3c6c9d9ceaeb/roles/64a6094c7a2942afb375bfb185843fd6` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:47.158780 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f8e89-b6e1-4957-a711-edfc3fd00308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:47.159951 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f8e89-b6e1-4957-a711-edfc3fd00308 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:47.159951 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f8e89-b6e1-4957-a711-edfc3fd00308 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:47.160138 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f8e89-b6e1-4957-a711-edfc3fd00308 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:47.160796 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f8e89-b6e1-4957-a711-edfc3fd00308 None admin] RBAC: Adding query filter params (name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:47.161101 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f8e89-b6e1-4957-a711-edfc3fd00308 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:47.162480 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f8e89-b6e1-4957-a711-edfc3fd00308 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:47.172749 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 310/610] 10.222.0.24 () {56 vars in 1103 bytes} [Thu Apr 7 06:06:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:47.174365 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c90c608-a09c-4b4b-a29d-ae5c99cc77f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=de88f2c333ae49cfa7fff7fa1ed0022c, user_id=0fc81e8151cc4dd2a79d3c6c9d9ceaeb, role_id=64a6094c7a2942afb375bfb185843fd6)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:47.175882 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c90c608-a09c-4b4b-a29d-ae5c99cc77f2 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:47.184135 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f8e89-b6e1-4957-a711-edfc3fd00308 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:47.271774 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 301/611] 10.222.0.24 () {58 vars in 1439 bytes} [Thu Apr 7 06:06:46 2022] PUT /identity/v3/projects/de88f2c333ae49cfa7fff7fa1ed0022c/users/0fc81e8151cc4dd2a79d3c6c9d9ceaeb/roles/64a6094c7a2942afb375bfb185843fd6 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:06:47.302872 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f8e89-b6e1-4957-a711-edfc3fd00308 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:47.353479 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc87bec4-c343-48a3-a645-2ce17072e0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:47.354623 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc87bec4-c343-48a3-a645-2ce17072e0a5 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:47.355106 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc87bec4-c343-48a3-a645-2ce17072e0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:47.355601 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc87bec4-c343-48a3-a645-2ce17072e0a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:47.376576 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc87bec4-c343-48a3-a645-2ce17072e0a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:47.378406 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc87bec4-c343-48a3-a645-2ce17072e0a5 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:47.401237 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-cc87bec4-c343-48a3-a645-2ce17072e0a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:06:47.402863 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 311/612] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:06:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 07 06:06:47.408918 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c90c608-a09c-4b4b-a29d-ae5c99cc77f2 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:47.553830 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c90c608-a09c-4b4b-a29d-ae5c99cc77f2 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:47.597163 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dff8fe2-fd81-4be9-8725-3fcb6ee269a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:47.597830 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff8fe2-fd81-4be9-8725-3fcb6ee269a3 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:47.598118 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff8fe2-fd81-4be9-8725-3fcb6ee269a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:47.598391 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff8fe2-fd81-4be9-8725-3fcb6ee269a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:47.599112 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dff8fe2-fd81-4be9-8725-3fcb6ee269a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:47.599415 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dff8fe2-fd81-4be9-8725-3fcb6ee269a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:47.600840 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dff8fe2-fd81-4be9-8725-3fcb6ee269a3 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:47.613710 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 302/613] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:06:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:47.619529 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc87bec4-c343-48a3-a645-2ce17072e0a5 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:47.757270 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc87bec4-c343-48a3-a645-2ce17072e0a5 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:47.791391 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3e4a1a-b4c5-4d59-9e0d-194281ccd024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:47.792235 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e4a1a-b4c5-4d59-9e0d-194281ccd024 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:47.792519 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e4a1a-b4c5-4d59-9e0d-194281ccd024 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:47.792796 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e4a1a-b4c5-4d59-9e0d-194281ccd024 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:47.800488 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3e4a1a-b4c5-4d59-9e0d-194281ccd024 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:47.801908 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3e4a1a-b4c5-4d59-9e0d-194281ccd024 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:47.815735 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-ad3e4a1a-b4c5-4d59-9e0d-194281ccd024 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 07 06:06:47.817288 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 312/614] 10.222.0.24 () {56 vars in 1096 bytes} [Thu Apr 7 06:06:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:47.824832 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dff8fe2-fd81-4be9-8725-3fcb6ee269a3 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:47.950182 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dff8fe2-fd81-4be9-8725-3fcb6ee269a3 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:47.971263 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c1d19-f8e9-45c7-8c4c-cb5fc2cd056c None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:47.971938 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c1d19-f8e9-45c7-8c4c-cb5fc2cd056c None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:47.972411 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c1d19-f8e9-45c7-8c4c-cb5fc2cd056c None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:47.974207 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 313/615] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:06:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:06:47.979986 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af0eb0-a835-4780-a6c1-9207c4c84acf None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:47.980500 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af0eb0-a835-4780-a6c1-9207c4c84acf None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:47.980969 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af0eb0-a835-4780-a6c1-9207c4c84acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:47.985189 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140983a7-09d2-4fca-a0ab-68beb37f379f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:47.985859 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140983a7-09d2-4fca-a0ab-68beb37f379f None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:47.986147 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140983a7-09d2-4fca-a0ab-68beb37f379f None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:47.986423 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140983a7-09d2-4fca-a0ab-68beb37f379f None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:47.987267 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140983a7-09d2-4fca-a0ab-68beb37f379f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:47.987578 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140983a7-09d2-4fca-a0ab-68beb37f379f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:47.989059 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140983a7-09d2-4fca-a0ab-68beb37f379f None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:47.999947 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-57af0eb0-a835-4780-a6c1-9207c4c84acf None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:06:48.001522 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-57af0eb0-a835-4780-a6c1-9207c4c84acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:06:48.011516 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 303/616] 10.222.0.24 () {56 vars in 1135 bytes} [Thu Apr 7 06:06:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:48.012771 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140983a7-09d2-4fca-a0ab-68beb37f379f None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:48.118456 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 314/617] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:06:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:06:48.140127 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140983a7-09d2-4fca-a0ab-68beb37f379f None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:48.153613 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af0eb0-a835-4780-a6c1-9207c4c84acf None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:48.180880 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b90507b-c0e8-4429-932c-fff16bb42e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:48.181736 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b90507b-c0e8-4429-932c-fff16bb42e20 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:48.182083 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b90507b-c0e8-4429-932c-fff16bb42e20 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:48.182362 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b90507b-c0e8-4429-932c-fff16bb42e20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:48.198485 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b90507b-c0e8-4429-932c-fff16bb42e20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:48.208237 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b90507b-c0e8-4429-932c-fff16bb42e20 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:48.233697 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-3b90507b-c0e8-4429-932c-fff16bb42e20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:06:48.236236 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 304/618] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:06:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:48.240879 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b90507b-c0e8-4429-932c-fff16bb42e20 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:48.256452 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af0eb0-a835-4780-a6c1-9207c4c84acf None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:48.306064 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb9748-f6cb-43df-9b44-0d24223346e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:48.306935 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb9748-f6cb-43df-9b44-0d24223346e9 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:48.307225 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb9748-f6cb-43df-9b44-0d24223346e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:48.307500 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb9748-f6cb-43df-9b44-0d24223346e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:48.328777 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eb9748-f6cb-43df-9b44-0d24223346e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:06:48.344351 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-93eb9748-f6cb-43df-9b44-0d24223346e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 07 06:06:48.345970 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 315/619] 10.222.0.24 () {56 vars in 1102 bytes} [Thu Apr 7 06:06:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 07 06:06:48.351510 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb9748-f6cb-43df-9b44-0d24223346e9 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:48.358031 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b90507b-c0e8-4429-932c-fff16bb42e20 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:48.402407 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f9b21f-82ee-4dd2-ad75-18361695522d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:48.403092 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9b21f-82ee-4dd2-ad75-18361695522d None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:48.403379 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9b21f-82ee-4dd2-ad75-18361695522d None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:48.403657 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9b21f-82ee-4dd2-ad75-18361695522d None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:48.404423 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f9b21f-82ee-4dd2-ad75-18361695522d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:48.404732 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f9b21f-82ee-4dd2-ad75-18361695522d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:48.406134 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f9b21f-82ee-4dd2-ad75-18361695522d None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:48.423144 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 305/620] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:06:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:06:48.424463 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f9b21f-82ee-4dd2-ad75-18361695522d None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:48.472308 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb9748-f6cb-43df-9b44-0d24223346e9 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:48.508309 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad4e0cc-933f-4671-bdfd-d34a23bfce21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:48.508989 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4e0cc-933f-4671-bdfd-d34a23bfce21 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:48.509338 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4e0cc-933f-4671-bdfd-d34a23bfce21 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:48.509617 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4e0cc-933f-4671-bdfd-d34a23bfce21 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:48.510431 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad4e0cc-933f-4671-bdfd-d34a23bfce21 None admin] RBAC: Adding query filter params (name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:48.510746 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad4e0cc-933f-4671-bdfd-d34a23bfce21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:48.512260 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad4e0cc-933f-4671-bdfd-d34a23bfce21 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:48.521404 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 316/621] 10.222.0.24 () {56 vars in 1103 bytes} [Thu Apr 7 06:06:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:06:48.527259 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad4e0cc-933f-4671-bdfd-d34a23bfce21 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:48.529466 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f9b21f-82ee-4dd2-ad75-18361695522d None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:48.564567 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c85a989-159c-4586-8c8c-319bac90f837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:48.565370 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85a989-159c-4586-8c8c-319bac90f837 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:48.565664 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85a989-159c-4586-8c8c-319bac90f837 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:48.565945 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85a989-159c-4586-8c8c-319bac90f837 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:48.572846 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c85a989-159c-4586-8c8c-319bac90f837 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:48.574300 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c85a989-159c-4586-8c8c-319bac90f837 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:48.588316 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-2c85a989-159c-4586-8c8c-319bac90f837 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 07 06:06:48.594169 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 306/622] 10.222.0.24 () {56 vars in 1111 bytes} [Thu Apr 7 06:06:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:48.595378 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c85a989-159c-4586-8c8c-319bac90f837 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:48.630757 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad4e0cc-933f-4671-bdfd-d34a23bfce21 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:48.664861 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7561b6aa-054d-43b8-bda7-3b2015db4160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:48.665663 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561b6aa-054d-43b8-bda7-3b2015db4160 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:48.665945 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561b6aa-054d-43b8-bda7-3b2015db4160 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:48.666216 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561b6aa-054d-43b8-bda7-3b2015db4160 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:48.676619 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7561b6aa-054d-43b8-bda7-3b2015db4160 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:48.678197 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7561b6aa-054d-43b8-bda7-3b2015db4160 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:48.694281 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-7561b6aa-054d-43b8-bda7-3b2015db4160 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:06:48.695358 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c85a989-159c-4586-8c8c-319bac90f837 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:48.696331 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 317/623] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:06:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 07 06:06:48.701567 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7561b6aa-054d-43b8-bda7-3b2015db4160 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:48.730315 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca3cbd-a30f-46e4-912d-143651f7197f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:48.730913 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca3cbd-a30f-46e4-912d-143651f7197f None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:48.731203 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca3cbd-a30f-46e4-912d-143651f7197f None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:48.731482 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca3cbd-a30f-46e4-912d-143651f7197f None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:48.732347 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca3cbd-a30f-46e4-912d-143651f7197f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:48.732613 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca3cbd-a30f-46e4-912d-143651f7197f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:48.734084 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca3cbd-a30f-46e4-912d-143651f7197f None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:48.746298 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 307/624] 10.222.0.24 () {56 vars in 1148 bytes} [Thu Apr 7 06:06:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:48.752685 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca3cbd-a30f-46e4-912d-143651f7197f None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:48.809699 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7561b6aa-054d-43b8-bda7-3b2015db4160 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:48.844394 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc47aa-3e3d-491b-b870-6b5c10d81b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:48.845065 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc47aa-3e3d-491b-b870-6b5c10d81b2c None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:48.845349 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc47aa-3e3d-491b-b870-6b5c10d81b2c None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:48.845624 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc47aa-3e3d-491b-b870-6b5c10d81b2c None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:48.846346 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dc47aa-3e3d-491b-b870-6b5c10d81b2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:48.846651 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dc47aa-3e3d-491b-b870-6b5c10d81b2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:48.848040 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dc47aa-3e3d-491b-b870-6b5c10d81b2c None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:48.864001 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 318/625] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:06:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:06:48.871775 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc47aa-3e3d-491b-b870-6b5c10d81b2c None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:48.886552 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca3cbd-a30f-46e4-912d-143651f7197f None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:48.961519 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04037b9-2094-483f-84fb-5bee32bcd23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:48.962818 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04037b9-2094-483f-84fb-5bee32bcd23b None admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:48.963298 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04037b9-2094-483f-84fb-5bee32bcd23b None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:48.963783 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04037b9-2094-483f-84fb-5bee32bcd23b None admin] PATH_INFO: `/v3/projects/de88f2c333ae49cfa7fff7fa1ed0022c/users/8b4abbb8c5324b7babd69e3b4473b3e2/roles/64a6094c7a2942afb375bfb185843fd6` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:48.978009 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc47aa-3e3d-491b-b870-6b5c10d81b2c None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:49.003651 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04037b9-2094-483f-84fb-5bee32bcd23b None admin] RBAC: Authorizing `identity:create_grant(project_id=de88f2c333ae49cfa7fff7fa1ed0022c, user_id=8b4abbb8c5324b7babd69e3b4473b3e2, role_id=64a6094c7a2942afb375bfb185843fd6)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:49.005673 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04037b9-2094-483f-84fb-5bee32bcd23b None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:49.014487 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21baf2cd-a203-4d23-8432-b5cc91ea42d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:49.015349 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21baf2cd-a203-4d23-8432-b5cc91ea42d7 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:49.015642 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21baf2cd-a203-4d23-8432-b5cc91ea42d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:49.015942 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21baf2cd-a203-4d23-8432-b5cc91ea42d7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:49.024456 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21baf2cd-a203-4d23-8432-b5cc91ea42d7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:49.025893 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21baf2cd-a203-4d23-8432-b5cc91ea42d7 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:49.040326 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-21baf2cd-a203-4d23-8432-b5cc91ea42d7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 07 06:06:49.041940 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 319/626] 10.222.0.24 () {56 vars in 1093 bytes} [Thu Apr 7 06:06:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:49.047612 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21baf2cd-a203-4d23-8432-b5cc91ea42d7 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:49.103895 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 308/627] 10.222.0.24 () {58 vars in 1439 bytes} [Thu Apr 7 06:06:48 2022] PUT /identity/v3/projects/de88f2c333ae49cfa7fff7fa1ed0022c/users/8b4abbb8c5324b7babd69e3b4473b3e2/roles/64a6094c7a2942afb375bfb185843fd6 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:06:49.105619 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9d323-0b5d-4741-baf0-53668e237763 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:49.105964 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9d323-0b5d-4741-baf0-53668e237763 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:49.106252 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9d323-0b5d-4741-baf0-53668e237763 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:49.109110 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 309/628] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:06:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:06:49.118812 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634c462-9107-457d-a71f-623ad80cf1d7 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:49.119419 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634c462-9107-457d-a71f-623ad80cf1d7 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:49.119836 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634c462-9107-457d-a71f-623ad80cf1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:49.152820 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-6634c462-9107-457d-a71f-623ad80cf1d7 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:06:49.154537 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-6634c462-9107-457d-a71f-623ad80cf1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:06:49.222384 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21baf2cd-a203-4d23-8432-b5cc91ea42d7 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:49.241528 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 310/629] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:06:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:06:49.279139 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6634c462-9107-457d-a71f-623ad80cf1d7 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:49.300852 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f231d-daf7-47c3-9015-1283499fd679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:49.301821 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f231d-daf7-47c3-9015-1283499fd679 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:49.302283 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f231d-daf7-47c3-9015-1283499fd679 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:49.302702 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f231d-daf7-47c3-9015-1283499fd679 None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:49.303988 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f231d-daf7-47c3-9015-1283499fd679 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:49.306142 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f231d-daf7-47c3-9015-1283499fd679 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:49.308394 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f231d-daf7-47c3-9015-1283499fd679 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:49.352228 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 320/630] 10.222.0.24 () {56 vars in 1133 bytes} [Thu Apr 7 06:06:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:06:49.357907 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f231d-daf7-47c3-9015-1283499fd679 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:49.421284 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6634c462-9107-457d-a71f-623ad80cf1d7 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:49.475148 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0936f4d-9a35-467a-af0c-4ace5ed365e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:49.475971 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0936f4d-9a35-467a-af0c-4ace5ed365e5 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:49.476791 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0936f4d-9a35-467a-af0c-4ace5ed365e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:49.477064 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0936f4d-9a35-467a-af0c-4ace5ed365e5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:49.497255 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0936f4d-9a35-467a-af0c-4ace5ed365e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:06:49.504185 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-d0936f4d-9a35-467a-af0c-4ace5ed365e5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 07 06:06:49.505404 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 311/631] 10.222.0.24 () {56 vars in 1102 bytes} [Thu Apr 7 06:06:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 07 06:06:49.516718 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0936f4d-9a35-467a-af0c-4ace5ed365e5 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:49.518166 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f231d-daf7-47c3-9015-1283499fd679 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:49.580015 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794f44c-beba-4e46-b68f-b9f548137457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:49.580599 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794f44c-beba-4e46-b68f-b9f548137457 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:49.580879 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794f44c-beba-4e46-b68f-b9f548137457 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:49.581148 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794f44c-beba-4e46-b68f-b9f548137457 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:49.651764 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0936f4d-9a35-467a-af0c-4ace5ed365e5 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:49.679939 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9794f44c-beba-4e46-b68f-b9f548137457 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:49.681884 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9794f44c-beba-4e46-b68f-b9f548137457 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:49.708928 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c077e-4f11-475a-aabc-e4546cca769b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:49.710228 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c077e-4f11-475a-aabc-e4546cca769b None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:49.711422 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c077e-4f11-475a-aabc-e4546cca769b None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:49.712222 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c077e-4f11-475a-aabc-e4546cca769b None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:49.713426 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015c077e-4f11-475a-aabc-e4546cca769b None admin] RBAC: Adding query filter params (name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:49.713950 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015c077e-4f11-475a-aabc-e4546cca769b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:49.716509 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015c077e-4f11-475a-aabc-e4546cca769b None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:49.726446 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 312/632] 10.222.0.24 () {56 vars in 1103 bytes} [Thu Apr 7 06:06:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:49.728298 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712d644-33cf-4eab-9d36-f5093801cfeb None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:49.728911 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712d644-33cf-4eab-9d36-f5093801cfeb None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:49.729700 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712d644-33cf-4eab-9d36-f5093801cfeb None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:49.735617 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 313/633] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:06:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:06:49.736902 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712d644-33cf-4eab-9d36-f5093801cfeb None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:49.792919 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 321/634] 10.222.0.24 () {58 vars in 1282 bytes} [Thu Apr 7 06:06:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 07 06:06:49.794304 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb931b-13c9-46c4-ae42-939be1ea38de None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:49.794688 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb931b-13c9-46c4-ae42-939be1ea38de None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:49.795067 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb931b-13c9-46c4-ae42-939be1ea38de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:49.812391 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-3adb931b-13c9-46c4-ae42-939be1ea38de None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:06:49.813706 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-3adb931b-13c9-46c4-ae42-939be1ea38de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:06:49.861601 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712d644-33cf-4eab-9d36-f5093801cfeb None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:49.889367 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 322/635] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:06:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:06:49.889367 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb931b-13c9-46c4-ae42-939be1ea38de None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:49.921061 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8bac81-7d1e-4c7e-989e-e53a4e0a8837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:49.921879 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8bac81-7d1e-4c7e-989e-e53a4e0a8837 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:49.922179 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8bac81-7d1e-4c7e-989e-e53a4e0a8837 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:49.922441 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8bac81-7d1e-4c7e-989e-e53a4e0a8837 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:49.938093 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8bac81-7d1e-4c7e-989e-e53a4e0a8837 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:49.940721 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8bac81-7d1e-4c7e-989e-e53a4e0a8837 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:49.964321 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-0f8bac81-7d1e-4c7e-989e-e53a4e0a8837 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:06:49.966713 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 314/636] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:06:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:49.967698 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8bac81-7d1e-4c7e-989e-e53a4e0a8837 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:50.018380 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb931b-13c9-46c4-ae42-939be1ea38de None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:50.061066 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08365ac-fe62-4c4b-baf1-5e2b3df20c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:50.062226 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08365ac-fe62-4c4b-baf1-5e2b3df20c2d None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:50.063110 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08365ac-fe62-4c4b-baf1-5e2b3df20c2d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:50.063610 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08365ac-fe62-4c4b-baf1-5e2b3df20c2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:50.074452 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8bac81-7d1e-4c7e-989e-e53a4e0a8837 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:50.077271 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08365ac-fe62-4c4b-baf1-5e2b3df20c2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:50.078918 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08365ac-fe62-4c4b-baf1-5e2b3df20c2d None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:50.100704 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-a08365ac-fe62-4c4b-baf1-5e2b3df20c2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:06:50.103001 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 323/637] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:06:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:50.104127 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08365ac-fe62-4c4b-baf1-5e2b3df20c2d None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:50.109355 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc53d0f5-06b3-4aeb-94c2-55588dec5a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:50.110417 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53d0f5-06b3-4aeb-94c2-55588dec5a27 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:50.110899 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53d0f5-06b3-4aeb-94c2-55588dec5a27 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:50.111391 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53d0f5-06b3-4aeb-94c2-55588dec5a27 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:50.125021 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc53d0f5-06b3-4aeb-94c2-55588dec5a27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:06:50.134609 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-fc53d0f5-06b3-4aeb-94c2-55588dec5a27 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 07 06:06:50.140669 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 315/638] 10.222.0.24 () {56 vars in 1102 bytes} [Thu Apr 7 06:06:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:50.140669 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc53d0f5-06b3-4aeb-94c2-55588dec5a27 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:50.223777 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08365ac-fe62-4c4b-baf1-5e2b3df20c2d None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:50.243624 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc53d0f5-06b3-4aeb-94c2-55588dec5a27 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:50.266411 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde4cd2a-f890-4bab-9d23-850b0302e870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:50.267866 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4cd2a-f890-4bab-9d23-850b0302e870 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:50.268296 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4cd2a-f890-4bab-9d23-850b0302e870 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:50.268734 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4cd2a-f890-4bab-9d23-850b0302e870 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:50.270047 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde4cd2a-f890-4bab-9d23-850b0302e870 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:50.270499 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde4cd2a-f890-4bab-9d23-850b0302e870 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:50.272508 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde4cd2a-f890-4bab-9d23-850b0302e870 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:50.277959 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94467f44-d655-4f36-a9de-db450baad41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:50.278772 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94467f44-d655-4f36-a9de-db450baad41a None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:50.279157 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94467f44-d655-4f36-a9de-db450baad41a None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:50.279532 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94467f44-d655-4f36-a9de-db450baad41a None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:50.280391 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94467f44-d655-4f36-a9de-db450baad41a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:50.280845 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94467f44-d655-4f36-a9de-db450baad41a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:50.282309 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94467f44-d655-4f36-a9de-db450baad41a None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:50.286302 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 324/639] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:06:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:50.287265 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde4cd2a-f890-4bab-9d23-850b0302e870 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:50.296158 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 316/640] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:06:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:50.297688 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b5d6b-2a08-460d-ab82-6c6fa7cb0d51 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:50.298079 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b5d6b-2a08-460d-ab82-6c6fa7cb0d51 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:50.298455 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b5d6b-2a08-460d-ab82-6c6fa7cb0d51 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:50.300077 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 317/641] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:06:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:06:50.301017 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335b5d6b-2a08-460d-ab82-6c6fa7cb0d51 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:50.386801 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde4cd2a-f890-4bab-9d23-850b0302e870 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:50.400245 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335b5d6b-2a08-460d-ab82-6c6fa7cb0d51 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:50.424273 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dbe013-3b08-4144-ac9a-c60b767b409c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:50.425064 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dbe013-3b08-4144-ac9a-c60b767b409c None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:50.425356 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dbe013-3b08-4144-ac9a-c60b767b409c None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:50.425634 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dbe013-3b08-4144-ac9a-c60b767b409c None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:50.426381 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dbe013-3b08-4144-ac9a-c60b767b409c None admin] RBAC: Adding query filter params (name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:50.426686 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dbe013-3b08-4144-ac9a-c60b767b409c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:50.428084 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dbe013-3b08-4144-ac9a-c60b767b409c None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:50.435625 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e507e82-40b9-44b5-b0f5-1d6c65958a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:50.438429 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e507e82-40b9-44b5-b0f5-1d6c65958a51 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:50.438862 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e507e82-40b9-44b5-b0f5-1d6c65958a51 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:50.439276 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e507e82-40b9-44b5-b0f5-1d6c65958a51 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:50.440409 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 325/642] 10.222.0.24 () {56 vars in 1103 bytes} [Thu Apr 7 06:06:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:50.441130 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dbe013-3b08-4144-ac9a-c60b767b409c None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:50.447879 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e507e82-40b9-44b5-b0f5-1d6c65958a51 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:50.449498 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e507e82-40b9-44b5-b0f5-1d6c65958a51 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:50.463417 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-1e507e82-40b9-44b5-b0f5-1d6c65958a51 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 07 06:06:50.465374 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 318/643] 10.222.0.24 () {56 vars in 1099 bytes} [Thu Apr 7 06:06:50 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:50.466938 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074fbb5d-da22-47de-88fe-6951fa40a633 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:50.467222 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074fbb5d-da22-47de-88fe-6951fa40a633 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:50.467496 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074fbb5d-da22-47de-88fe-6951fa40a633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:50.485394 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-074fbb5d-da22-47de-88fe-6951fa40a633 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:06:50.486656 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-074fbb5d-da22-47de-88fe-6951fa40a633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:06:50.553071 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dbe013-3b08-4144-ac9a-c60b767b409c None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:50.555225 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 319/644] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:06:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:06:50.556098 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074fbb5d-da22-47de-88fe-6951fa40a633 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:50.590787 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5738743-33ee-4eff-9786-3ed746a0b381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:50.591587 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5738743-33ee-4eff-9786-3ed746a0b381 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:50.591916 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5738743-33ee-4eff-9786-3ed746a0b381 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:50.592210 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5738743-33ee-4eff-9786-3ed746a0b381 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:50.598639 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5738743-33ee-4eff-9786-3ed746a0b381 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:50.600097 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5738743-33ee-4eff-9786-3ed746a0b381 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:50.613576 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-b5738743-33ee-4eff-9786-3ed746a0b381 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 07 06:06:50.615163 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 326/645] 10.222.0.24 () {56 vars in 1111 bytes} [Thu Apr 7 06:06:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:50.615785 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5738743-33ee-4eff-9786-3ed746a0b381 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:50.659070 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074fbb5d-da22-47de-88fe-6951fa40a633 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:50.691841 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9fff84-a8ce-430a-9249-4b8ea6309a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:50.692627 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9fff84-a8ce-430a-9249-4b8ea6309a93 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:50.692912 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9fff84-a8ce-430a-9249-4b8ea6309a93 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:50.693186 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9fff84-a8ce-430a-9249-4b8ea6309a93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:50.703437 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9fff84-a8ce-430a-9249-4b8ea6309a93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:50.704946 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9fff84-a8ce-430a-9249-4b8ea6309a93 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:50.714252 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5738743-33ee-4eff-9786-3ed746a0b381 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:50.721272 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-2a9fff84-a8ce-430a-9249-4b8ea6309a93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:06:50.722459 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 320/646] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:06:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:50.723232 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9fff84-a8ce-430a-9249-4b8ea6309a93 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:50.751897 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825851df-56fb-477b-8d8c-045fe41431a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:50.752583 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825851df-56fb-477b-8d8c-045fe41431a2 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:50.752890 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825851df-56fb-477b-8d8c-045fe41431a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:50.753177 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825851df-56fb-477b-8d8c-045fe41431a2 None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:50.754013 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825851df-56fb-477b-8d8c-045fe41431a2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:50.754325 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825851df-56fb-477b-8d8c-045fe41431a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:50.755782 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825851df-56fb-477b-8d8c-045fe41431a2 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:50.775111 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 327/647] 10.222.0.24 () {56 vars in 1137 bytes} [Thu Apr 7 06:06:50 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:50.775998 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825851df-56fb-477b-8d8c-045fe41431a2 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:50.830728 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9fff84-a8ce-430a-9249-4b8ea6309a93 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:50.865249 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a00f0-d012-4056-b00b-a668aa787fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:50.866044 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a00f0-d012-4056-b00b-a668aa787fd7 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:50.866329 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a00f0-d012-4056-b00b-a668aa787fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:50.866663 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a00f0-d012-4056-b00b-a668aa787fd7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:50.875878 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825851df-56fb-477b-8d8c-045fe41431a2 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:50.876882 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23a00f0-d012-4056-b00b-a668aa787fd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:06:50.884509 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-b23a00f0-d012-4056-b00b-a668aa787fd7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 07 06:06:50.890395 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 321/648] 10.222.0.24 () {56 vars in 1102 bytes} [Thu Apr 7 06:06:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:50.890395 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a00f0-d012-4056-b00b-a668aa787fd7 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:50.913948 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d23135-d9ed-41b1-b023-4cefe894b9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:50.914698 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d23135-d9ed-41b1-b023-4cefe894b9b7 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:50.914991 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d23135-d9ed-41b1-b023-4cefe894b9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:50.915295 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d23135-d9ed-41b1-b023-4cefe894b9b7 None admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:50.916118 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d23135-d9ed-41b1-b023-4cefe894b9b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:50.916424 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d23135-d9ed-41b1-b023-4cefe894b9b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:50.917855 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d23135-d9ed-41b1-b023-4cefe894b9b7 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:50.929166 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 328/649] 10.222.0.24 () {56 vars in 1148 bytes} [Thu Apr 7 06:06:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:50.929975 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d23135-d9ed-41b1-b023-4cefe894b9b7 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:50.990487 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a00f0-d012-4056-b00b-a668aa787fd7 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:51.024218 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af44d84-0720-4542-9c52-056c5dacf5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:51.025197 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af44d84-0720-4542-9c52-056c5dacf5b0 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:51.025637 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af44d84-0720-4542-9c52-056c5dacf5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:51.026067 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af44d84-0720-4542-9c52-056c5dacf5b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:51.026931 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af44d84-0720-4542-9c52-056c5dacf5b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:51.027381 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af44d84-0720-4542-9c52-056c5dacf5b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:51.028930 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af44d84-0720-4542-9c52-056c5dacf5b0 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:51.029194 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d23135-d9ed-41b1-b023-4cefe894b9b7 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:51.041567 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 322/650] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:06:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:51.042633 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af44d84-0720-4542-9c52-056c5dacf5b0 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:51.066089 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b49edb5-911e-4064-9885-b98485d39224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:51.066756 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49edb5-911e-4064-9885-b98485d39224 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:51.067043 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49edb5-911e-4064-9885-b98485d39224 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:51.067322 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49edb5-911e-4064-9885-b98485d39224 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:51.133548 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b49edb5-911e-4064-9885-b98485d39224 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:51.135012 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b49edb5-911e-4064-9885-b98485d39224 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:51.146805 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af44d84-0720-4542-9c52-056c5dacf5b0 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:51.181021 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d1225e-b2f8-4b2e-9ea2-6e47c8c17459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:51.181612 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1225e-b2f8-4b2e-9ea2-6e47c8c17459 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:51.181899 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1225e-b2f8-4b2e-9ea2-6e47c8c17459 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:51.182177 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1225e-b2f8-4b2e-9ea2-6e47c8c17459 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:51.182919 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d1225e-b2f8-4b2e-9ea2-6e47c8c17459 None admin] RBAC: Adding query filter params (name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:51.183225 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d1225e-b2f8-4b2e-9ea2-6e47c8c17459 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:51.184629 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d1225e-b2f8-4b2e-9ea2-6e47c8c17459 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:51.192584 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 323/651] 10.222.0.24 () {56 vars in 1103 bytes} [Thu Apr 7 06:06:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:51.193609 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d1225e-b2f8-4b2e-9ea2-6e47c8c17459 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:51.230772 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 329/652] 10.222.0.24 () {58 vars in 1282 bytes} [Thu Apr 7 06:06:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 07 06:06:51.232173 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b49edb5-911e-4064-9885-b98485d39224 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:51.292268 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d1225e-b2f8-4b2e-9ea2-6e47c8c17459 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:51.325810 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f09a6-16f2-4397-8398-1db54b15ef85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:51.326396 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f09a6-16f2-4397-8398-1db54b15ef85 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:51.326686 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f09a6-16f2-4397-8398-1db54b15ef85 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:51.326963 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f09a6-16f2-4397-8398-1db54b15ef85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:51.327829 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557f09a6-16f2-4397-8398-1db54b15ef85 None admin] RBAC: Adding query filter params (role.id=64a6094c7a2942afb375bfb185843fd6, scope.project.id=de88f2c333ae49cfa7fff7fa1ed0022c, user.id=02cd81f6620f410db450871fb29961f6) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:51.328147 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557f09a6-16f2-4397-8398-1db54b15ef85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:51.329569 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557f09a6-16f2-4397-8398-1db54b15ef85 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:51.331082 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b49edb5-911e-4064-9885-b98485d39224 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:51.335833 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 324/653] 10.222.0.24 () {56 vars in 1374 bytes} [Thu Apr 7 06:06:51 2022] GET /identity/v3/role_assignments?user.id=02cd81f6620f410db450871fb29961f6&scope.project.id=de88f2c333ae49cfa7fff7fa1ed0022c&role.id=64a6094c7a2942afb375bfb185843fd6 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:51.336643 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f09a6-16f2-4397-8398-1db54b15ef85 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:51.369432 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c06b65-8fae-464f-98db-eaaed0a3d792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:51.370633 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c06b65-8fae-464f-98db-eaaed0a3d792 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:51.371731 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c06b65-8fae-464f-98db-eaaed0a3d792 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:51.372299 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c06b65-8fae-464f-98db-eaaed0a3d792 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:51.383795 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c06b65-8fae-464f-98db-eaaed0a3d792 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:51.387283 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c06b65-8fae-464f-98db-eaaed0a3d792 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:51.410956 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-22c06b65-8fae-464f-98db-eaaed0a3d792 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 07 06:06:51.414090 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 330/654] 10.222.0.24 () {56 vars in 1102 bytes} [Thu Apr 7 06:06:51 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:51.415168 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c06b65-8fae-464f-98db-eaaed0a3d792 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:51.466399 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f09a6-16f2-4397-8398-1db54b15ef85 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:51.502400 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e6e1d8-ffde-47d8-9fda-bdf26e1981d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:51.503593 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6e1d8-ffde-47d8-9fda-bdf26e1981d1 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:51.503922 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6e1d8-ffde-47d8-9fda-bdf26e1981d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:51.504462 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6e1d8-ffde-47d8-9fda-bdf26e1981d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:51.518760 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e6e1d8-ffde-47d8-9fda-bdf26e1981d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:51.520805 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e6e1d8-ffde-47d8-9fda-bdf26e1981d1 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:51.543661 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-61e6e1d8-ffde-47d8-9fda-bdf26e1981d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:06:51.545377 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 325/655] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:06:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:51.546242 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e6e1d8-ffde-47d8-9fda-bdf26e1981d1 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:51.555409 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c06b65-8fae-464f-98db-eaaed0a3d792 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:51.595629 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964de5d-c026-4616-bc6e-80b255aebfef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:51.597275 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964de5d-c026-4616-bc6e-80b255aebfef None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:51.598016 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964de5d-c026-4616-bc6e-80b255aebfef None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:51.598306 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964de5d-c026-4616-bc6e-80b255aebfef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:51.616382 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1964de5d-c026-4616-bc6e-80b255aebfef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:51.617890 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1964de5d-c026-4616-bc6e-80b255aebfef None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:51.639715 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-1964de5d-c026-4616-bc6e-80b255aebfef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:06:51.642071 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 331/656] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:06:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:51.643162 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964de5d-c026-4616-bc6e-80b255aebfef None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:51.669749 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e6e1d8-ffde-47d8-9fda-bdf26e1981d1 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:51.704343 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b19c08-fe9e-4683-8862-776171fa70df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:51.705298 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b19c08-fe9e-4683-8862-776171fa70df None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:51.705792 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b19c08-fe9e-4683-8862-776171fa70df None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:51.706270 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b19c08-fe9e-4683-8862-776171fa70df None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:51.707246 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b19c08-fe9e-4683-8862-776171fa70df None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:51.707702 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b19c08-fe9e-4683-8862-776171fa70df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:51.709291 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b19c08-fe9e-4683-8862-776171fa70df None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:51.730838 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 326/657] 10.222.0.24 () {56 vars in 1139 bytes} [Thu Apr 7 06:06:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:51.732512 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b19c08-fe9e-4683-8862-776171fa70df None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:51.743712 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964de5d-c026-4616-bc6e-80b255aebfef None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:51.778496 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf43dc-a26b-44ce-bffc-5636681c538b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:51.779200 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf43dc-a26b-44ce-bffc-5636681c538b None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:51.779491 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf43dc-a26b-44ce-bffc-5636681c538b None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:51.779793 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf43dc-a26b-44ce-bffc-5636681c538b None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:51.780533 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cf43dc-a26b-44ce-bffc-5636681c538b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:51.780844 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cf43dc-a26b-44ce-bffc-5636681c538b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:51.782213 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cf43dc-a26b-44ce-bffc-5636681c538b None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:51.797697 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 332/658] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:06:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:51.797697 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7d217-054a-49ee-92df-f00d5d320723 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:51.797697 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7d217-054a-49ee-92df-f00d5d320723 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:51.797697 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7d217-054a-49ee-92df-f00d5d320723 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:51.797697 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 333/659] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:06:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:06:51.797697 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded7d217-054a-49ee-92df-f00d5d320723 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:51.845139 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b19c08-fe9e-4683-8862-776171fa70df None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:51.880342 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f19043-2cba-4060-aa6f-38d8b7600f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:51.881014 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f19043-2cba-4060-aa6f-38d8b7600f4f None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:51.881442 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f19043-2cba-4060-aa6f-38d8b7600f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:51.881719 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f19043-2cba-4060-aa6f-38d8b7600f4f None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:51.883240 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f19043-2cba-4060-aa6f-38d8b7600f4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:51.883560 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f19043-2cba-4060-aa6f-38d8b7600f4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:51.885392 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f19043-2cba-4060-aa6f-38d8b7600f4f None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:51.897468 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 327/660] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:06:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:51.898645 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f19043-2cba-4060-aa6f-38d8b7600f4f None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:51.899994 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded7d217-054a-49ee-92df-f00d5d320723 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:51.934154 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68948d9e-1d72-4cb3-bba5-c8556823974d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:51.934814 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68948d9e-1d72-4cb3-bba5-c8556823974d None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:51.935102 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68948d9e-1d72-4cb3-bba5-c8556823974d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:51.935382 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68948d9e-1d72-4cb3-bba5-c8556823974d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:52.003325 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f19043-2cba-4060-aa6f-38d8b7600f4f None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:52.004318 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68948d9e-1d72-4cb3-bba5-c8556823974d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:52.005768 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68948d9e-1d72-4cb3-bba5-c8556823974d None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:52.035676 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadde5e4-1ff2-44a1-bb02-d2bc8ecd4acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:52.036490 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadde5e4-1ff2-44a1-bb02-d2bc8ecd4acd None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:52.036776 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadde5e4-1ff2-44a1-bb02-d2bc8ecd4acd None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:52.037053 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadde5e4-1ff2-44a1-bb02-d2bc8ecd4acd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:52.044373 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadde5e4-1ff2-44a1-bb02-d2bc8ecd4acd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:52.045832 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadde5e4-1ff2-44a1-bb02-d2bc8ecd4acd None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:52.059215 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-aadde5e4-1ff2-44a1-bb02-d2bc8ecd4acd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 07 06:06:52.060423 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 328/661] 10.222.0.24 () {56 vars in 1099 bytes} [Thu Apr 7 06:06:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:52.061584 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f0d45-7353-45cd-980c-f2dc1c779ecc None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:52.061872 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f0d45-7353-45cd-980c-f2dc1c779ecc None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:52.062149 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f0d45-7353-45cd-980c-f2dc1c779ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:52.077909 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-5d3f0d45-7353-45cd-980c-f2dc1c779ecc None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:06:52.079092 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-5d3f0d45-7353-45cd-980c-f2dc1c779ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:06:52.106002 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 334/662] 10.222.0.24 () {58 vars in 1282 bytes} [Thu Apr 7 06:06:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 07 06:06:52.110513 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68948d9e-1d72-4cb3-bba5-c8556823974d None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:52.153689 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 329/663] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:06:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:06:52.155962 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f0d45-7353-45cd-980c-f2dc1c779ecc None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:52.213952 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68948d9e-1d72-4cb3-bba5-c8556823974d None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:52.247199 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e35cbe-bb6f-4f9d-aa43-f6e58b88d606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:52.248032 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e35cbe-bb6f-4f9d-aa43-f6e58b88d606 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:52.248324 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e35cbe-bb6f-4f9d-aa43-f6e58b88d606 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:52.248607 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e35cbe-bb6f-4f9d-aa43-f6e58b88d606 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:52.250585 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f0d45-7353-45cd-980c-f2dc1c779ecc None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:52.255104 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e35cbe-bb6f-4f9d-aa43-f6e58b88d606 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:52.256512 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e35cbe-bb6f-4f9d-aa43-f6e58b88d606 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:52.269841 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-e1e35cbe-bb6f-4f9d-aa43-f6e58b88d606 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 07 06:06:52.275705 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 335/664] 10.222.0.24 () {56 vars in 1111 bytes} [Thu Apr 7 06:06:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:52.275705 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e35cbe-bb6f-4f9d-aa43-f6e58b88d606 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:52.284052 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c77d4f-4241-4fe4-8b53-bba670916601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:52.284723 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c77d4f-4241-4fe4-8b53-bba670916601 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:52.285007 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c77d4f-4241-4fe4-8b53-bba670916601 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:52.285285 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c77d4f-4241-4fe4-8b53-bba670916601 None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:52.286126 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c77d4f-4241-4fe4-8b53-bba670916601 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:52.286436 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c77d4f-4241-4fe4-8b53-bba670916601 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:52.287971 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c77d4f-4241-4fe4-8b53-bba670916601 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:52.305426 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 330/665] 10.222.0.24 () {56 vars in 1137 bytes} [Thu Apr 7 06:06:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:52.306567 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c77d4f-4241-4fe4-8b53-bba670916601 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:52.372536 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e35cbe-bb6f-4f9d-aa43-f6e58b88d606 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:52.401482 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c77d4f-4241-4fe4-8b53-bba670916601 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:52.405854 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38ad43-14a4-4c2a-bb3f-3b44ece70e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:52.406662 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38ad43-14a4-4c2a-bb3f-3b44ece70e25 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:52.406950 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38ad43-14a4-4c2a-bb3f-3b44ece70e25 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:52.407232 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38ad43-14a4-4c2a-bb3f-3b44ece70e25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:52.417580 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c38ad43-14a4-4c2a-bb3f-3b44ece70e25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:52.419025 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c38ad43-14a4-4c2a-bb3f-3b44ece70e25 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:52.434426 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef53d6-4854-480d-9118-8b5358c19986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:52.434880 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-0c38ad43-14a4-4c2a-bb3f-3b44ece70e25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:06:52.435281 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef53d6-4854-480d-9118-8b5358c19986 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:52.435572 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef53d6-4854-480d-9118-8b5358c19986 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:52.435878 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef53d6-4854-480d-9118-8b5358c19986 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:52.440491 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 336/666] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:06:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:52.440491 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38ad43-14a4-4c2a-bb3f-3b44ece70e25 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:52.452941 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef53d6-4854-480d-9118-8b5358c19986 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:06:52.460148 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-9fef53d6-4854-480d-9118-8b5358c19986 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 07 06:06:52.466548 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 331/667] 10.222.0.24 () {56 vars in 1102 bytes} [Thu Apr 7 06:06:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:52.466548 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef53d6-4854-480d-9118-8b5358c19986 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:52.543316 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38ad43-14a4-4c2a-bb3f-3b44ece70e25 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:52.565033 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef53d6-4854-480d-9118-8b5358c19986 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:52.578528 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e22022e-a0a5-4208-ae40-b8322511b1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:52.579202 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22022e-a0a5-4208-ae40-b8322511b1ab None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:52.579487 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22022e-a0a5-4208-ae40-b8322511b1ab None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:52.579778 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22022e-a0a5-4208-ae40-b8322511b1ab None admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:52.580576 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e22022e-a0a5-4208-ae40-b8322511b1ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:52.580886 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e22022e-a0a5-4208-ae40-b8322511b1ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:52.582315 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e22022e-a0a5-4208-ae40-b8322511b1ab None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:52.595519 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 337/668] 10.222.0.24 () {56 vars in 1148 bytes} [Thu Apr 7 06:06:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:52.595519 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e22022e-a0a5-4208-ae40-b8322511b1ab None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:52.604078 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d95d185-4f06-4173-9288-cb3ce2f7b38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:52.604736 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95d185-4f06-4173-9288-cb3ce2f7b38b None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:52.605028 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95d185-4f06-4173-9288-cb3ce2f7b38b None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:52.605310 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95d185-4f06-4173-9288-cb3ce2f7b38b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:52.671990 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d95d185-4f06-4173-9288-cb3ce2f7b38b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:52.673454 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d95d185-4f06-4173-9288-cb3ce2f7b38b None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:52.695267 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e22022e-a0a5-4208-ae40-b8322511b1ab None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:52.728654 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c1746f-9225-418e-a10d-37dfb457f7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:52.729353 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1746f-9225-418e-a10d-37dfb457f7da None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:52.729644 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1746f-9225-418e-a10d-37dfb457f7da None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:52.730031 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1746f-9225-418e-a10d-37dfb457f7da None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:52.730652 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c1746f-9225-418e-a10d-37dfb457f7da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:52.730963 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c1746f-9225-418e-a10d-37dfb457f7da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:52.732358 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c1746f-9225-418e-a10d-37dfb457f7da None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:52.744093 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 338/669] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:06:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:52.745325 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c1746f-9225-418e-a10d-37dfb457f7da None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:52.790103 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 332/670] 10.222.0.24 () {58 vars in 1282 bytes} [Thu Apr 7 06:06:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 07 06:06:52.790103 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d95d185-4f06-4173-9288-cb3ce2f7b38b None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:52.861383 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c1746f-9225-418e-a10d-37dfb457f7da None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:52.882042 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d95d185-4f06-4173-9288-cb3ce2f7b38b None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:52.893592 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce80e8f4-9536-432c-b0ad-e6b6b1d4ad20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:52.894266 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce80e8f4-9536-432c-b0ad-e6b6b1d4ad20 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:52.894551 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce80e8f4-9536-432c-b0ad-e6b6b1d4ad20 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:52.894855 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce80e8f4-9536-432c-b0ad-e6b6b1d4ad20 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:52.895574 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce80e8f4-9536-432c-b0ad-e6b6b1d4ad20 None admin] RBAC: Adding query filter params (name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:52.895914 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce80e8f4-9536-432c-b0ad-e6b6b1d4ad20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:52.897270 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce80e8f4-9536-432c-b0ad-e6b6b1d4ad20 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:52.906953 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 339/671] 10.222.0.24 () {56 vars in 1103 bytes} [Thu Apr 7 06:06:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:52.908491 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce80e8f4-9536-432c-b0ad-e6b6b1d4ad20 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:52.916097 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b0bdae-45be-407f-8caa-82c84cd4df5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:52.916755 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0bdae-45be-407f-8caa-82c84cd4df5e None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:52.917039 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0bdae-45be-407f-8caa-82c84cd4df5e None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:52.917313 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0bdae-45be-407f-8caa-82c84cd4df5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:52.918146 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b0bdae-45be-407f-8caa-82c84cd4df5e None admin] RBAC: Adding query filter params (role.id=64a6094c7a2942afb375bfb185843fd6, scope.project.id=de88f2c333ae49cfa7fff7fa1ed0022c, user.id=0ca88debdfcc4a9d918e3b0138a9add1) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:52.918458 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b0bdae-45be-407f-8caa-82c84cd4df5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:52.919921 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b0bdae-45be-407f-8caa-82c84cd4df5e None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:52.925593 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 333/672] 10.222.0.24 () {56 vars in 1374 bytes} [Thu Apr 7 06:06:52 2022] GET /identity/v3/role_assignments?user.id=0ca88debdfcc4a9d918e3b0138a9add1&scope.project.id=de88f2c333ae49cfa7fff7fa1ed0022c&role.id=64a6094c7a2942afb375bfb185843fd6 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:52.926419 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b0bdae-45be-407f-8caa-82c84cd4df5e None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:53.031834 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce80e8f4-9536-432c-b0ad-e6b6b1d4ad20 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:53.056908 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b0bdae-45be-407f-8caa-82c84cd4df5e None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:53.068373 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1d2af-60ed-488c-a13a-e4dfefffc757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:53.069206 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1d2af-60ed-488c-a13a-e4dfefffc757 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:53.069489 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1d2af-60ed-488c-a13a-e4dfefffc757 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:53.070389 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1d2af-60ed-488c-a13a-e4dfefffc757 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:53.078034 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e1d2af-60ed-488c-a13a-e4dfefffc757 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:53.079511 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e1d2af-60ed-488c-a13a-e4dfefffc757 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:53.097488 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-87e1d2af-60ed-488c-a13a-e4dfefffc757 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 07 06:06:53.099334 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 340/673] 10.222.0.24 () {56 vars in 1111 bytes} [Thu Apr 7 06:06:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:53.100196 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1d2af-60ed-488c-a13a-e4dfefffc757 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:53.108262 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a43c8-c293-4d20-af88-62c17479e96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:53.109920 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a43c8-c293-4d20-af88-62c17479e96e None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:53.110412 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a43c8-c293-4d20-af88-62c17479e96e None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:53.110902 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a43c8-c293-4d20-af88-62c17479e96e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:53.124820 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a43c8-c293-4d20-af88-62c17479e96e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:53.126574 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a43c8-c293-4d20-af88-62c17479e96e None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:53.143698 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-474a43c8-c293-4d20-af88-62c17479e96e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:06:53.145201 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 334/674] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:06:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:53.145868 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a43c8-c293-4d20-af88-62c17479e96e None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:53.218780 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1d2af-60ed-488c-a13a-e4dfefffc757 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:53.245352 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a43c8-c293-4d20-af88-62c17479e96e None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:53.253462 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2326ca5a-4539-4fc2-9663-500555ef1e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:53.254270 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326ca5a-4539-4fc2-9663-500555ef1e02 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:53.254549 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326ca5a-4539-4fc2-9663-500555ef1e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:53.254819 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326ca5a-4539-4fc2-9663-500555ef1e02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:53.264910 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2326ca5a-4539-4fc2-9663-500555ef1e02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:53.266402 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2326ca5a-4539-4fc2-9663-500555ef1e02 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:53.278504 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e53c578-d981-4452-85eb-5a1623b7ac2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:53.279160 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53c578-d981-4452-85eb-5a1623b7ac2f None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:53.279444 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53c578-d981-4452-85eb-5a1623b7ac2f None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:53.279716 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53c578-d981-4452-85eb-5a1623b7ac2f None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:53.280527 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e53c578-d981-4452-85eb-5a1623b7ac2f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:53.280833 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e53c578-d981-4452-85eb-5a1623b7ac2f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:53.282260 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e53c578-d981-4452-85eb-5a1623b7ac2f None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:53.283662 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-2326ca5a-4539-4fc2-9663-500555ef1e02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:06:53.285290 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 341/675] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:06:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:53.286108 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2326ca5a-4539-4fc2-9663-500555ef1e02 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:53.294760 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 335/676] 10.222.0.24 () {56 vars in 1148 bytes} [Thu Apr 7 06:06:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:53.295668 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e53c578-d981-4452-85eb-5a1623b7ac2f None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:53.384907 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2326ca5a-4539-4fc2-9663-500555ef1e02 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:53.395909 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e53c578-d981-4452-85eb-5a1623b7ac2f None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:53.421156 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863e2857-63d1-404a-bb43-a066486e1f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:53.421836 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e2857-63d1-404a-bb43-a066486e1f85 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:53.422104 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e2857-63d1-404a-bb43-a066486e1f85 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:53.422376 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e2857-63d1-404a-bb43-a066486e1f85 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:53.423093 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863e2857-63d1-404a-bb43-a066486e1f85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:53.423396 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863e2857-63d1-404a-bb43-a066486e1f85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:53.424798 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863e2857-63d1-404a-bb43-a066486e1f85 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:53.431290 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1f3853-c2f7-4489-acb9-acb69d910769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:53.431975 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f3853-c2f7-4489-acb9-acb69d910769 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:53.432260 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f3853-c2f7-4489-acb9-acb69d910769 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:53.432532 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f3853-c2f7-4489-acb9-acb69d910769 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:53.433247 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1f3853-c2f7-4489-acb9-acb69d910769 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:53.433547 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1f3853-c2f7-4489-acb9-acb69d910769 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:53.434901 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1f3853-c2f7-4489-acb9-acb69d910769 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:53.441752 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 342/677] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:06:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:53.442642 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863e2857-63d1-404a-bb43-a066486e1f85 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:53.447918 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 336/678] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:06:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:53.448582 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1f3853-c2f7-4489-acb9-acb69d910769 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:53.541546 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863e2857-63d1-404a-bb43-a066486e1f85 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:53.547558 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1f3853-c2f7-4489-acb9-acb69d910769 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:53.573576 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4147e-4271-4ad2-ac6d-e52e0b2f3901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:53.574224 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4147e-4271-4ad2-ac6d-e52e0b2f3901 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:53.574504 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4147e-4271-4ad2-ac6d-e52e0b2f3901 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:53.574778 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4147e-4271-4ad2-ac6d-e52e0b2f3901 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:53.575595 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc4147e-4271-4ad2-ac6d-e52e0b2f3901 None admin] RBAC: Adding query filter params (role.id=64a6094c7a2942afb375bfb185843fd6, scope.project.id=de88f2c333ae49cfa7fff7fa1ed0022c, user.id=bb7f549fd26e4642828d4f476aef0239) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:53.575926 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc4147e-4271-4ad2-ac6d-e52e0b2f3901 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:53.577566 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc4147e-4271-4ad2-ac6d-e52e0b2f3901 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:53.580219 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f385962-671b-4cf6-809b-60c47275be3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:53.581009 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f385962-671b-4cf6-809b-60c47275be3d None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:53.581296 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f385962-671b-4cf6-809b-60c47275be3d None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:53.581567 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f385962-671b-4cf6-809b-60c47275be3d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:53.584193 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 343/679] 10.222.0.24 () {56 vars in 1374 bytes} [Thu Apr 7 06:06:53 2022] GET /identity/v3/role_assignments?user.id=bb7f549fd26e4642828d4f476aef0239&scope.project.id=de88f2c333ae49cfa7fff7fa1ed0022c&role.id=64a6094c7a2942afb375bfb185843fd6 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:53.584989 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4147e-4271-4ad2-ac6d-e52e0b2f3901 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:53.588896 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f385962-671b-4cf6-809b-60c47275be3d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:53.590348 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f385962-671b-4cf6-809b-60c47275be3d None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:53.604883 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-4f385962-671b-4cf6-809b-60c47275be3d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 07 06:06:53.606453 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 337/680] 10.222.0.24 () {56 vars in 1111 bytes} [Thu Apr 7 06:06:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:53.616914 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f385962-671b-4cf6-809b-60c47275be3d None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:53.697764 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4147e-4271-4ad2-ac6d-e52e0b2f3901 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:53.733119 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0867f029-a66f-4a69-8433-a88180ca4ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:53.733946 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867f029-a66f-4a69-8433-a88180ca4ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:53.734247 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867f029-a66f-4a69-8433-a88180ca4ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:53.744862 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867f029-a66f-4a69-8433-a88180ca4ab7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:53.744862 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0867f029-a66f-4a69-8433-a88180ca4ab7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:53.745233 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0867f029-a66f-4a69-8433-a88180ca4ab7 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:53.760300 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-0867f029-a66f-4a69-8433-a88180ca4ab7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 07 06:06:53.761858 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 344/681] 10.222.0.24 () {56 vars in 1096 bytes} [Thu Apr 7 06:06:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:53.768518 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0867f029-a66f-4a69-8433-a88180ca4ab7 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:53.795442 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f385962-671b-4cf6-809b-60c47275be3d None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:53.843246 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3ad05e-6177-4e2b-85f2-da88cce1463b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:53.843956 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ad05e-6177-4e2b-85f2-da88cce1463b None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:53.844242 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ad05e-6177-4e2b-85f2-da88cce1463b None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:53.844517 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ad05e-6177-4e2b-85f2-da88cce1463b None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:53.845306 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3ad05e-6177-4e2b-85f2-da88cce1463b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:53.845613 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3ad05e-6177-4e2b-85f2-da88cce1463b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:53.847047 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3ad05e-6177-4e2b-85f2-da88cce1463b None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:53.862848 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 338/682] 10.222.0.24 () {56 vars in 1148 bytes} [Thu Apr 7 06:06:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:53.869790 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3ad05e-6177-4e2b-85f2-da88cce1463b None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:53.891478 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0867f029-a66f-4a69-8433-a88180ca4ab7 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:53.940499 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3851e-c995-417a-b541-3642f972cde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:53.941661 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3851e-c995-417a-b541-3642f972cde7 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:53.941946 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3851e-c995-417a-b541-3642f972cde7 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:53.942486 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3851e-c995-417a-b541-3642f972cde7 None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:53.943345 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba3851e-c995-417a-b541-3642f972cde7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:53.943831 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba3851e-c995-417a-b541-3642f972cde7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:53.946554 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba3851e-c995-417a-b541-3642f972cde7 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:53.969287 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 345/683] 10.222.0.24 () {56 vars in 1135 bytes} [Thu Apr 7 06:06:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:53.971070 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d8e86-d1c3-499c-b856-769dc3a846bc None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:53.971359 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d8e86-d1c3-499c-b856-769dc3a846bc None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:53.971962 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d8e86-d1c3-499c-b856-769dc3a846bc None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:53.973742 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 346/684] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:06:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:06:53.974412 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3ad05e-6177-4e2b-85f2-da88cce1463b None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:53.975355 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880d8e86-d1c3-499c-b856-769dc3a846bc None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:54.009029 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd1433-7b20-4ad4-b2e5-caaff6e9b0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:54.009821 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd1433-7b20-4ad4-b2e5-caaff6e9b0bd None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:54.010173 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd1433-7b20-4ad4-b2e5-caaff6e9b0bd None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:54.010516 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd1433-7b20-4ad4-b2e5-caaff6e9b0bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:54.011423 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afd1433-7b20-4ad4-b2e5-caaff6e9b0bd None admin] RBAC: Adding query filter params (role.id=64a6094c7a2942afb375bfb185843fd6, scope.project.id=de88f2c333ae49cfa7fff7fa1ed0022c, user.id=0fc81e8151cc4dd2a79d3c6c9d9ceaeb) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:54.011845 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afd1433-7b20-4ad4-b2e5-caaff6e9b0bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:54.013346 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afd1433-7b20-4ad4-b2e5-caaff6e9b0bd None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:54.019527 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 339/685] 10.222.0.24 () {56 vars in 1374 bytes} [Thu Apr 7 06:06:53 2022] GET /identity/v3/role_assignments?user.id=0fc81e8151cc4dd2a79d3c6c9d9ceaeb&scope.project.id=de88f2c333ae49cfa7fff7fa1ed0022c&role.id=64a6094c7a2942afb375bfb185843fd6 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:06:54.020858 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a01eb-5c9f-405a-87be-03b91126bce6 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:54.021212 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a01eb-5c9f-405a-87be-03b91126bce6 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:54.021560 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a01eb-5c9f-405a-87be-03b91126bce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:54.061538 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-762a01eb-5c9f-405a-87be-03b91126bce6 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:06:54.062769 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-762a01eb-5c9f-405a-87be-03b91126bce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:06:54.127714 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880d8e86-d1c3-499c-b856-769dc3a846bc None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:54.192836 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef41cf70-2c25-49ec-b6a3-1c243a3e46d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:54.193513 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41cf70-2c25-49ec-b6a3-1c243a3e46d0 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:54.193796 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41cf70-2c25-49ec-b6a3-1c243a3e46d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:54.194070 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41cf70-2c25-49ec-b6a3-1c243a3e46d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:54.195280 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 340/686] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:06:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:06:54.227821 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a01eb-5c9f-405a-87be-03b91126bce6 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:54.301414 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef41cf70-2c25-49ec-b6a3-1c243a3e46d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:54.303453 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef41cf70-2c25-49ec-b6a3-1c243a3e46d0 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:54.342960 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a01eb-5c9f-405a-87be-03b91126bce6 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:54.378768 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023617b3-677a-4f59-a0cc-71b5cb9d286a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:54.379926 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023617b3-677a-4f59-a0cc-71b5cb9d286a None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:54.380416 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023617b3-677a-4f59-a0cc-71b5cb9d286a None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:54.380890 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023617b3-677a-4f59-a0cc-71b5cb9d286a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:54.391822 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023617b3-677a-4f59-a0cc-71b5cb9d286a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:06:54.399451 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-023617b3-677a-4f59-a0cc-71b5cb9d286a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 07 06:06:54.401267 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 341/687] 10.222.0.24 () {56 vars in 1096 bytes} [Thu Apr 7 06:06:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 07 06:06:54.406995 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023617b3-677a-4f59-a0cc-71b5cb9d286a None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:54.422688 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 347/688] 10.222.0.24 () {58 vars in 1282 bytes} [Thu Apr 7 06:06:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 07 06:06:54.430439 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef41cf70-2c25-49ec-b6a3-1c243a3e46d0 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:54.547669 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023617b3-677a-4f59-a0cc-71b5cb9d286a None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:54.551963 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef41cf70-2c25-49ec-b6a3-1c243a3e46d0 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:54.586384 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448b860e-21ea-46bf-a163-48611ab3ef00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:54.586384 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b860e-21ea-46bf-a163-48611ab3ef00 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:54.586384 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b860e-21ea-46bf-a163-48611ab3ef00 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:54.586384 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b860e-21ea-46bf-a163-48611ab3ef00 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:54.586830 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448b860e-21ea-46bf-a163-48611ab3ef00 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:54.586830 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448b860e-21ea-46bf-a163-48611ab3ef00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:54.586830 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448b860e-21ea-46bf-a163-48611ab3ef00 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:54.595703 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 342/689] 10.222.0.24 () {56 vars in 1099 bytes} [Thu Apr 7 06:06:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:54.600628 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448b860e-21ea-46bf-a163-48611ab3ef00 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:54.616694 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd84b4-e7df-47a1-b287-7a8cea6c8160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:54.619051 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd84b4-e7df-47a1-b287-7a8cea6c8160 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:54.619051 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd84b4-e7df-47a1-b287-7a8cea6c8160 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:54.619051 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd84b4-e7df-47a1-b287-7a8cea6c8160 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:54.634301 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bd84b4-e7df-47a1-b287-7a8cea6c8160 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:54.637339 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bd84b4-e7df-47a1-b287-7a8cea6c8160 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:54.679579 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-54bd84b4-e7df-47a1-b287-7a8cea6c8160 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:06:54.688207 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 348/690] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:06:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:54.693174 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd84b4-e7df-47a1-b287-7a8cea6c8160 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:54.734216 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448b860e-21ea-46bf-a163-48611ab3ef00 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:54.780515 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3502f382-9970-4e4c-9379-57a01c0634bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:54.781580 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502f382-9970-4e4c-9379-57a01c0634bc None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:54.782009 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502f382-9970-4e4c-9379-57a01c0634bc None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:54.782452 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502f382-9970-4e4c-9379-57a01c0634bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:54.800227 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3502f382-9970-4e4c-9379-57a01c0634bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:54.803226 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3502f382-9970-4e4c-9379-57a01c0634bc None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:54.829284 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-3502f382-9970-4e4c-9379-57a01c0634bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:06:54.831044 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 343/691] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:06:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 07 06:06:54.836865 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3502f382-9970-4e4c-9379-57a01c0634bc None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:54.906905 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd84b4-e7df-47a1-b287-7a8cea6c8160 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:54.953894 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3502f382-9970-4e4c-9379-57a01c0634bc None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:54.984439 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221d882-d900-45d3-aa23-2bc5de6924ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:54.985118 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221d882-d900-45d3-aa23-2bc5de6924ba None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:54.985403 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221d882-d900-45d3-aa23-2bc5de6924ba None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:54.985681 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221d882-d900-45d3-aa23-2bc5de6924ba None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:54.986410 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a221d882-d900-45d3-aa23-2bc5de6924ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:54.986717 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a221d882-d900-45d3-aa23-2bc5de6924ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:54.995769 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a221d882-d900-45d3-aa23-2bc5de6924ba None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:54.999480 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b935e83-646f-40cc-8f64-e654f7a03551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:55.000145 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 349/692] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:06:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:06:55.000572 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b935e83-646f-40cc-8f64-e654f7a03551 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:55.001043 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b935e83-646f-40cc-8f64-e654f7a03551 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:55.001485 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b935e83-646f-40cc-8f64-e654f7a03551 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:55.002360 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b935e83-646f-40cc-8f64-e654f7a03551 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:55.002822 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b935e83-646f-40cc-8f64-e654f7a03551 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:55.007767 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221d882-d900-45d3-aa23-2bc5de6924ba None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:55.008048 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b935e83-646f-40cc-8f64-e654f7a03551 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:55.032967 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 344/693] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:06:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:55.039450 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b935e83-646f-40cc-8f64-e654f7a03551 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:55.203313 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221d882-d900-45d3-aa23-2bc5de6924ba None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:55.220994 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b935e83-646f-40cc-8f64-e654f7a03551 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:55.263404 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e82b80-daf6-4c44-bafe-2bfaedcbdaa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:55.264237 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e82b80-daf6-4c44-bafe-2bfaedcbdaa9 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:55.264520 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e82b80-daf6-4c44-bafe-2bfaedcbdaa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:55.264797 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e82b80-daf6-4c44-bafe-2bfaedcbdaa9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:55.265961 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69bd627-deea-4462-8b36-37c5df4cc97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:55.266752 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69bd627-deea-4462-8b36-37c5df4cc97d None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:55.267040 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69bd627-deea-4462-8b36-37c5df4cc97d None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:55.267305 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69bd627-deea-4462-8b36-37c5df4cc97d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:55.280552 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e82b80-daf6-4c44-bafe-2bfaedcbdaa9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:55.281980 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e82b80-daf6-4c44-bafe-2bfaedcbdaa9 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:55.283071 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69bd627-deea-4462-8b36-37c5df4cc97d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:55.284513 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69bd627-deea-4462-8b36-37c5df4cc97d None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:55.299077 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-43e82b80-daf6-4c44-bafe-2bfaedcbdaa9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 07 06:06:55.300612 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 350/694] 10.222.0.24 () {56 vars in 1111 bytes} [Thu Apr 7 06:06:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 07 06:06:55.306089 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e82b80-daf6-4c44-bafe-2bfaedcbdaa9 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:55.306464 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-e69bd627-deea-4462-8b36-37c5df4cc97d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 07 06:06:55.309360 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 345/695] 10.222.0.24 () {56 vars in 1093 bytes} [Thu Apr 7 06:06:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:55.314230 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69bd627-deea-4462-8b36-37c5df4cc97d None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:55.405910 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e82b80-daf6-4c44-bafe-2bfaedcbdaa9 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:55.449357 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c3e66b-2401-4203-92b8-aa2981fc5327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:55.450809 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3e66b-2401-4203-92b8-aa2981fc5327 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:55.451315 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3e66b-2401-4203-92b8-aa2981fc5327 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:55.451831 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3e66b-2401-4203-92b8-aa2981fc5327 None admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:55.452822 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c3e66b-2401-4203-92b8-aa2981fc5327 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:55.453386 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c3e66b-2401-4203-92b8-aa2981fc5327 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:55.455005 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c3e66b-2401-4203-92b8-aa2981fc5327 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:55.477153 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69bd627-deea-4462-8b36-37c5df4cc97d None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:55.487292 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 351/696] 10.222.0.24 () {56 vars in 1148 bytes} [Thu Apr 7 06:06:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:06:55.493088 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c3e66b-2401-4203-92b8-aa2981fc5327 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:55.521837 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e32cdf8-4ba8-4f73-9af0-2fe00d300663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:55.522978 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e32cdf8-4ba8-4f73-9af0-2fe00d300663 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:55.523483 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e32cdf8-4ba8-4f73-9af0-2fe00d300663 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:55.523983 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e32cdf8-4ba8-4f73-9af0-2fe00d300663 None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:55.525034 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e32cdf8-4ba8-4f73-9af0-2fe00d300663 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:55.526317 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e32cdf8-4ba8-4f73-9af0-2fe00d300663 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:55.528511 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e32cdf8-4ba8-4f73-9af0-2fe00d300663 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:55.557498 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 346/697] 10.222.0.24 () {56 vars in 1133 bytes} [Thu Apr 7 06:06:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:06:55.559977 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da00d40-39af-472d-92ef-086c08d41985 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:55.562410 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da00d40-39af-472d-92ef-086c08d41985 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:55.562690 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da00d40-39af-472d-92ef-086c08d41985 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:55.564371 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 347/698] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:06:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:06:55.565604 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da00d40-39af-472d-92ef-086c08d41985 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:55.638188 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c3e66b-2401-4203-92b8-aa2981fc5327 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:55.673130 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041393e-7fd6-40d2-8a1c-1b0ac7c25db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:55.673852 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041393e-7fd6-40d2-8a1c-1b0ac7c25db7 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:55.674136 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041393e-7fd6-40d2-8a1c-1b0ac7c25db7 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:55.674461 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041393e-7fd6-40d2-8a1c-1b0ac7c25db7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:55.675991 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e041393e-7fd6-40d2-8a1c-1b0ac7c25db7 None admin] RBAC: Adding query filter params (role.id=64a6094c7a2942afb375bfb185843fd6, scope.project.id=de88f2c333ae49cfa7fff7fa1ed0022c, user.id=8b4abbb8c5324b7babd69e3b4473b3e2) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:55.676521 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e041393e-7fd6-40d2-8a1c-1b0ac7c25db7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:55.679099 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e041393e-7fd6-40d2-8a1c-1b0ac7c25db7 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:55.685762 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 352/699] 10.222.0.24 () {56 vars in 1374 bytes} [Thu Apr 7 06:06:55 2022] GET /identity/v3/role_assignments?user.id=8b4abbb8c5324b7babd69e3b4473b3e2&scope.project.id=de88f2c333ae49cfa7fff7fa1ed0022c&role.id=64a6094c7a2942afb375bfb185843fd6 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:55.687102 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67fc36-7a6e-4cdd-acb7-8fec1f3176f7 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:55.687394 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67fc36-7a6e-4cdd-acb7-8fec1f3176f7 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:55.687667 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67fc36-7a6e-4cdd-acb7-8fec1f3176f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:55.689854 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da00d40-39af-472d-92ef-086c08d41985 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:55.705821 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-8c67fc36-7a6e-4cdd-acb7-8fec1f3176f7 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:06:55.707012 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-8c67fc36-7a6e-4cdd-acb7-8fec1f3176f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:06:55.733246 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96931fd8-6dde-441a-a3bf-c0c52c665d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:55.734060 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96931fd8-6dde-441a-a3bf-c0c52c665d30 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:55.734476 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96931fd8-6dde-441a-a3bf-c0c52c665d30 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:55.734761 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96931fd8-6dde-441a-a3bf-c0c52c665d30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:55.796131 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 353/700] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:06:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:06:55.826524 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96931fd8-6dde-441a-a3bf-c0c52c665d30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:55.828812 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96931fd8-6dde-441a-a3bf-c0c52c665d30 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:55.837280 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c67fc36-7a6e-4cdd-acb7-8fec1f3176f7 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:55.962790 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c67fc36-7a6e-4cdd-acb7-8fec1f3176f7 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:56.004259 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 348/701] 10.222.0.24 () {58 vars in 1282 bytes} [Thu Apr 7 06:06:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 07 06:06:56.005027 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1bb3cc-db4c-40bb-acba-d765b80194ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:56.005943 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1bb3cc-db4c-40bb-acba-d765b80194ef None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:56.006230 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1bb3cc-db4c-40bb-acba-d765b80194ef None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:56.006564 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1bb3cc-db4c-40bb-acba-d765b80194ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:56.011796 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96931fd8-6dde-441a-a3bf-c0c52c665d30 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:56.024695 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1bb3cc-db4c-40bb-acba-d765b80194ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:56.027075 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1bb3cc-db4c-40bb-acba-d765b80194ef None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:56.048889 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-5a1bb3cc-db4c-40bb-acba-d765b80194ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:06:56.056233 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 354/702] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:06:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 07 06:06:56.057442 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1bb3cc-db4c-40bb-acba-d765b80194ef None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:56.129737 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96931fd8-6dde-441a-a3bf-c0c52c665d30 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:56.165878 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0306b3b3-c305-4e22-84fa-d5f26192e0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:56.166684 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306b3b3-c305-4e22-84fa-d5f26192e0e6 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:56.166971 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306b3b3-c305-4e22-84fa-d5f26192e0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:56.167249 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306b3b3-c305-4e22-84fa-d5f26192e0e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:56.178287 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0306b3b3-c305-4e22-84fa-d5f26192e0e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:56.180480 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0306b3b3-c305-4e22-84fa-d5f26192e0e6 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:56.190571 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1bb3cc-db4c-40bb-acba-d765b80194ef None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:56.198034 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-0306b3b3-c305-4e22-84fa-d5f26192e0e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:06:56.199399 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 349/703] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:06:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 07 06:06:56.204964 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0306b3b3-c305-4e22-84fa-d5f26192e0e6 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:56.231592 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c35782-9101-4a02-a6ab-2264eeb7a821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:56.232214 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c35782-9101-4a02-a6ab-2264eeb7a821 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:56.232733 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c35782-9101-4a02-a6ab-2264eeb7a821 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:56.232733 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c35782-9101-4a02-a6ab-2264eeb7a821 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:56.233477 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c35782-9101-4a02-a6ab-2264eeb7a821 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:56.233782 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c35782-9101-4a02-a6ab-2264eeb7a821 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:56.235263 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c35782-9101-4a02-a6ab-2264eeb7a821 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:56.247332 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 355/704] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:06:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:56.252650 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c35782-9101-4a02-a6ab-2264eeb7a821 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:56.317350 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0306b3b3-c305-4e22-84fa-d5f26192e0e6 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:56.351763 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c35782-9101-4a02-a6ab-2264eeb7a821 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:56.353022 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43da23a-bda9-4dde-84be-e17776223d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:56.353926 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43da23a-bda9-4dde-84be-e17776223d43 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:56.354423 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43da23a-bda9-4dde-84be-e17776223d43 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:56.354888 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43da23a-bda9-4dde-84be-e17776223d43 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:56.355826 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43da23a-bda9-4dde-84be-e17776223d43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:56.356325 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43da23a-bda9-4dde-84be-e17776223d43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:56.357958 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43da23a-bda9-4dde-84be-e17776223d43 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:56.370327 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 350/705] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:06:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:06:56.375893 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43da23a-bda9-4dde-84be-e17776223d43 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:56.385947 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6b59f-b7f8-45fc-8c03-da1ac85f55b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:56.386821 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6b59f-b7f8-45fc-8c03-da1ac85f55b6 None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:56.386952 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6b59f-b7f8-45fc-8c03-da1ac85f55b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:56.387167 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6b59f-b7f8-45fc-8c03-da1ac85f55b6 None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:56.387918 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b6b59f-b7f8-45fc-8c03-da1ac85f55b6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:56.389519 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b6b59f-b7f8-45fc-8c03-da1ac85f55b6 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:56.487946 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43da23a-bda9-4dde-84be-e17776223d43 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:56.514634 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 356/706] 10.222.0.24 () {60 vars in 1132 bytes} [Thu Apr 7 06:06:56 2022] POST /identity/v3/users => generated 254 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:06:56.517405 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a2b824-3338-431e-8c9f-5e9ec6ca3079 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:56.517919 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a2b824-3338-431e-8c9f-5e9ec6ca3079 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:56.518517 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a2b824-3338-431e-8c9f-5e9ec6ca3079 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:56.520968 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 357/707] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:06:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:06:56.525673 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e92bcf-55a5-4639-b9d2-2ecad95a95ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:56.526639 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e92bcf-55a5-4639-b9d2-2ecad95a95ea None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:56.527028 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e92bcf-55a5-4639-b9d2-2ecad95a95ea None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:56.527408 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e92bcf-55a5-4639-b9d2-2ecad95a95ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:56.528444 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635de43a-b7b2-4377-9359-0a438e1fc6c3 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:56.528919 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635de43a-b7b2-4377-9359-0a438e1fc6c3 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:56.529343 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635de43a-b7b2-4377-9359-0a438e1fc6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:56.536488 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e92bcf-55a5-4639-b9d2-2ecad95a95ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:56.540241 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e92bcf-55a5-4639-b9d2-2ecad95a95ea None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:56.550791 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-635de43a-b7b2-4377-9359-0a438e1fc6c3 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:06:56.552286 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-635de43a-b7b2-4377-9359-0a438e1fc6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:06:56.557400 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-91e92bcf-55a5-4639-b9d2-2ecad95a95ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 07 06:06:56.558796 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 351/708] 10.222.0.24 () {56 vars in 1111 bytes} [Thu Apr 7 06:06:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:56.564740 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e92bcf-55a5-4639-b9d2-2ecad95a95ea None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:56.639868 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 358/709] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:06:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 07 06:06:56.664427 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635de43a-b7b2-4377-9359-0a438e1fc6c3 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:56.720000 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e92bcf-55a5-4639-b9d2-2ecad95a95ea None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:56.756955 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa8ef19-2e77-421d-94fb-1b01294f7daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:56.757582 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8ef19-2e77-421d-94fb-1b01294f7daa None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:56.757869 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8ef19-2e77-421d-94fb-1b01294f7daa None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:56.758148 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8ef19-2e77-421d-94fb-1b01294f7daa None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:56.759011 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa8ef19-2e77-421d-94fb-1b01294f7daa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:56.759342 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa8ef19-2e77-421d-94fb-1b01294f7daa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:56.760875 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa8ef19-2e77-421d-94fb-1b01294f7daa None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:56.774585 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 352/710] 10.222.0.24 () {56 vars in 1148 bytes} [Thu Apr 7 06:06:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:56.780723 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa8ef19-2e77-421d-94fb-1b01294f7daa None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:56.843574 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635de43a-b7b2-4377-9359-0a438e1fc6c3 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:56.880337 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca886ec-3181-4196-a37f-63d45c585605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:56.881239 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca886ec-3181-4196-a37f-63d45c585605 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:56.881653 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca886ec-3181-4196-a37f-63d45c585605 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:56.882454 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca886ec-3181-4196-a37f-63d45c585605 None admin] PATH_INFO: `/v3/services/network` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:56.883241 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca886ec-3181-4196-a37f-63d45c585605 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:56.884728 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca886ec-3181-4196-a37f-63d45c585605 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:56.898297 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-7ca886ec-3181-4196-a37f-63d45c585605 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 07 06:06:56.898953 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa8ef19-2e77-421d-94fb-1b01294f7daa None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:56.903784 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 359/711] 10.222.0.24 () {56 vars in 1111 bytes} [Thu Apr 7 06:06:56 2022] GET /identity/v3/services/network => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 07 06:06:56.907454 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca886ec-3181-4196-a37f-63d45c585605 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:56.940243 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6300262-27f5-41b4-a9db-23c7788b8dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:56.941207 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6300262-27f5-41b4-a9db-23c7788b8dfd None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:56.945471 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6300262-27f5-41b4-a9db-23c7788b8dfd None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:56.945471 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6300262-27f5-41b4-a9db-23c7788b8dfd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:56.945471 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6300262-27f5-41b4-a9db-23c7788b8dfd None admin] RBAC: Adding query filter params (role.id=0fab680bc76f4a73826e9beb59e8129b, scope.project.id=de88f2c333ae49cfa7fff7fa1ed0022c, user.id=02cd81f6620f410db450871fb29961f6) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:56.945471 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6300262-27f5-41b4-a9db-23c7788b8dfd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:56.945471 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6300262-27f5-41b4-a9db-23c7788b8dfd None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:56.951458 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 353/712] 10.222.0.24 () {56 vars in 1374 bytes} [Thu Apr 7 06:06:56 2022] GET /identity/v3/role_assignments?user.id=02cd81f6620f410db450871fb29961f6&scope.project.id=de88f2c333ae49cfa7fff7fa1ed0022c&role.id=0fab680bc76f4a73826e9beb59e8129b => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:56.967850 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222ede6-cbaa-41d0-b364-09529450e4cd None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:56.968401 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222ede6-cbaa-41d0-b364-09529450e4cd None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:56.968828 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222ede6-cbaa-41d0-b364-09529450e4cd None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:56.971453 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 354/713] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:06:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 07 06:06:56.978035 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67892ca-e130-4f04-af88-ee9f55c477e2 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:56.978388 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67892ca-e130-4f04-af88-ee9f55c477e2 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:56.978594 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67892ca-e130-4f04-af88-ee9f55c477e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:56.997471 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-c67892ca-e130-4f04-af88-ee9f55c477e2 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:06:56.999274 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-c67892ca-e130-4f04-af88-ee9f55c477e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:06:57.045093 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca886ec-3181-4196-a37f-63d45c585605 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:57.083040 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 355/714] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:06:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:06:57.088175 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a298c771-a476-4027-ad85-a002f46b7c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:57.089163 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298c771-a476-4027-ad85-a002f46b7c23 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:57.089656 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298c771-a476-4027-ad85-a002f46b7c23 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:57.090156 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298c771-a476-4027-ad85-a002f46b7c23 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:57.091094 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a298c771-a476-4027-ad85-a002f46b7c23 None admin] RBAC: Adding query filter params (name=network) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:57.091614 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a298c771-a476-4027-ad85-a002f46b7c23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:57.093263 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a298c771-a476-4027-ad85-a002f46b7c23 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:57.098851 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 360/715] 10.222.0.24 () {56 vars in 1112 bytes} [Thu Apr 7 06:06:56 2022] GET /identity/v3/services?name=network => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:57.105884 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a298c771-a476-4027-ad85-a002f46b7c23 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:57.106961 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67892ca-e130-4f04-af88-ee9f55c477e2 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:57.214936 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a298c771-a476-4027-ad85-a002f46b7c23 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:57.233151 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67892ca-e130-4f04-af88-ee9f55c477e2 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:57.269876 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3996383-48f9-4608-a554-7bdc48d836ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:57.270684 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3996383-48f9-4608-a554-7bdc48d836ef None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:57.270961 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3996383-48f9-4608-a554-7bdc48d836ef None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:57.271231 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3996383-48f9-4608-a554-7bdc48d836ef None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:57.271919 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3996383-48f9-4608-a554-7bdc48d836ef None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:57.273810 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3996383-48f9-4608-a554-7bdc48d836ef None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:57.276108 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95024852-0791-471c-bb18-e4803ffa2fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:57.276776 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95024852-0791-471c-bb18-e4803ffa2fa2 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:57.277056 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95024852-0791-471c-bb18-e4803ffa2fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:57.277325 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95024852-0791-471c-bb18-e4803ffa2fa2 None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:57.278031 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95024852-0791-471c-bb18-e4803ffa2fa2 None admin] RBAC: Adding query filter params (type=network) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:57.278331 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95024852-0791-471c-bb18-e4803ffa2fa2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:57.279681 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95024852-0791-471c-bb18-e4803ffa2fa2 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:57.294534 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-e3996383-48f9-4608-a554-7bdc48d836ef None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 07 06:06:57.294922 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 356/716] 10.222.0.24 () {56 vars in 1112 bytes} [Thu Apr 7 06:06:57 2022] GET /identity/v3/services?type=network => generated 124 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:57.295927 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 361/717] 10.222.0.24 () {56 vars in 1129 bytes} [Thu Apr 7 06:06:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:57.303197 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95024852-0791-471c-bb18-e4803ffa2fa2 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:57.413176 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95024852-0791-471c-bb18-e4803ffa2fa2 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:57.455487 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95088f56-4655-439d-acca-0634dfe05b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:57.456207 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95088f56-4655-439d-acca-0634dfe05b25 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:57.456491 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95088f56-4655-439d-acca-0634dfe05b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:57.456765 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95088f56-4655-439d-acca-0634dfe05b25 None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:57.457490 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95088f56-4655-439d-acca-0634dfe05b25 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:57.457795 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95088f56-4655-439d-acca-0634dfe05b25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:57.459206 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95088f56-4655-439d-acca-0634dfe05b25 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:57.469283 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 357/718] 10.222.0.24 () {56 vars in 1124 bytes} [Thu Apr 7 06:06:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:57.475191 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3996383-48f9-4608-a554-7bdc48d836ef None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:57.622983 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3996383-48f9-4608-a554-7bdc48d836ef None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:57.657718 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50070e09-673e-492d-99ae-801b8b2bfb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:57.658389 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50070e09-673e-492d-99ae-801b8b2bfb38 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:57.658677 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50070e09-673e-492d-99ae-801b8b2bfb38 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:57.658953 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50070e09-673e-492d-99ae-801b8b2bfb38 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:57.659665 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50070e09-673e-492d-99ae-801b8b2bfb38 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:57.660003 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50070e09-673e-492d-99ae-801b8b2bfb38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:57.661365 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50070e09-673e-492d-99ae-801b8b2bfb38 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:57.667694 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 362/719] 10.222.0.24 () {56 vars in 1124 bytes} [Thu Apr 7 06:06:57 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:59.037017 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d80f2-d1c6-41a5-9c65-cc119732aa72 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:59.037516 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d80f2-d1c6-41a5-9c65-cc119732aa72 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:59.037617 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d80f2-d1c6-41a5-9c65-cc119732aa72 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:59.039779 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 358/720] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:06:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:06:59.045169 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b7a98d-3f88-4b06-906a-e2687c79a48a None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:59.045588 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b7a98d-3f88-4b06-906a-e2687c79a48a None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:59.045760 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b7a98d-3f88-4b06-906a-e2687c79a48a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:59.068950 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-19b7a98d-3f88-4b06-906a-e2687c79a48a None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:06:59.070240 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-19b7a98d-3f88-4b06-906a-e2687c79a48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:06:59.150747 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 363/721] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:06:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:06:59.183186 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d80f2-d1c6-41a5-9c65-cc119732aa72 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:59.332586 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d80f2-d1c6-41a5-9c65-cc119732aa72 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:59.384605 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae300cb-4508-4b3e-872c-9aaf3d44ef53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:59.385436 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae300cb-4508-4b3e-872c-9aaf3d44ef53 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:59.385722 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae300cb-4508-4b3e-872c-9aaf3d44ef53 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:59.385986 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae300cb-4508-4b3e-872c-9aaf3d44ef53 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:59.398182 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae300cb-4508-4b3e-872c-9aaf3d44ef53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:06:59.405292 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-0ae300cb-4508-4b3e-872c-9aaf3d44ef53 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 07 06:06:59.411236 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 359/722] 10.222.0.24 () {56 vars in 1096 bytes} [Thu Apr 7 06:06:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:59.412621 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b7a98d-3f88-4b06-906a-e2687c79a48a None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:59.534133 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b7a98d-3f88-4b06-906a-e2687c79a48a None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:59.575251 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7ffde8-4dec-43d9-948a-3b478f07664a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:59.575957 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ffde8-4dec-43d9-948a-3b478f07664a None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:59.576245 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ffde8-4dec-43d9-948a-3b478f07664a None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:59.576522 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ffde8-4dec-43d9-948a-3b478f07664a None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:59.577276 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7ffde8-4dec-43d9-948a-3b478f07664a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:06:59.577584 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7ffde8-4dec-43d9-948a-3b478f07664a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:59.578954 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7ffde8-4dec-43d9-948a-3b478f07664a None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:59.588191 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 364/723] 10.222.0.24 () {56 vars in 1099 bytes} [Thu Apr 7 06:06:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:06:59.593436 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae300cb-4508-4b3e-872c-9aaf3d44ef53 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:59.761031 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae300cb-4508-4b3e-872c-9aaf3d44ef53 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:59.823398 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb1894-45cd-489f-8904-f31e2eb9294b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:06:59.824229 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb1894-45cd-489f-8904-f31e2eb9294b None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:59.824517 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb1894-45cd-489f-8904-f31e2eb9294b None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:59.824790 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb1894-45cd-489f-8904-f31e2eb9294b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:59.845898 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb1894-45cd-489f-8904-f31e2eb9294b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:06:59.847296 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb1894-45cd-489f-8904-f31e2eb9294b None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:06:59.848748 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1724fac-77ef-4e64-8e59-2aeefc2b26c1 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:59.849236 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1724fac-77ef-4e64-8e59-2aeefc2b26c1 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:59.849664 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1724fac-77ef-4e64-8e59-2aeefc2b26c1 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:59.855927 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 365/724] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:06:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:06:59.857292 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b0e797-44ad-4087-8a82-fc7b7450a9f7 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:59.857579 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b0e797-44ad-4087-8a82-fc7b7450a9f7 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:59.858537 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b0e797-44ad-4087-8a82-fc7b7450a9f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:59.865367 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-14bb1894-45cd-489f-8904-f31e2eb9294b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:06:59.867417 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 360/725] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:06:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:06:59.872912 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb1894-45cd-489f-8904-f31e2eb9294b None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:06:59.893155 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-e9b0e797-44ad-4087-8a82-fc7b7450a9f7 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:06:59.894355 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e9b0e797-44ad-4087-8a82-fc7b7450a9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:06:59.974842 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb1894-45cd-489f-8904-f31e2eb9294b None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:06:59.983814 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 366/726] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:06:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:06:59.985385 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75076d-3ae4-4b9e-abd8-3a0e770e249e None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:06:59.985826 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75076d-3ae4-4b9e-abd8-3a0e770e249e None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:06:59.986278 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75076d-3ae4-4b9e-abd8-3a0e770e249e None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:06:59.991237 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 367/727] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:06:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:07:00.003006 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d828d-c128-4d54-8eea-d47f3a65052c None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:00.003525 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d828d-c128-4d54-8eea-d47f3a65052c None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:00.003992 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d828d-c128-4d54-8eea-d47f3a65052c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:00.025460 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-287d828d-c128-4d54-8eea-d47f3a65052c None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:07:00.026834 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-287d828d-c128-4d54-8eea-d47f3a65052c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:07:00.032594 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f9a539-3a68-43a0-8572-14e192713e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:00.033464 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9a539-3a68-43a0-8572-14e192713e28 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:00.033929 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9a539-3a68-43a0-8572-14e192713e28 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:00.034366 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9a539-3a68-43a0-8572-14e192713e28 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:00.035290 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f9a539-3a68-43a0-8572-14e192713e28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:00.035777 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f9a539-3a68-43a0-8572-14e192713e28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:00.037352 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f9a539-3a68-43a0-8572-14e192713e28 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:00.051158 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 361/728] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:06:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:07:00.056358 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f9a539-3a68-43a0-8572-14e192713e28 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:00.115982 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 368/729] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:07:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 07 06:07:00.117999 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d828d-c128-4d54-8eea-d47f3a65052c None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:00.181075 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f9a539-3a68-43a0-8572-14e192713e28 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:00.213394 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ecccb8-3950-48a9-af31-2a4dc82e0060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:00.214187 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecccb8-3950-48a9-af31-2a4dc82e0060 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:00.214476 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecccb8-3950-48a9-af31-2a4dc82e0060 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:00.214753 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecccb8-3950-48a9-af31-2a4dc82e0060 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:00.224584 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ecccb8-3950-48a9-af31-2a4dc82e0060 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:07:00.226475 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d828d-c128-4d54-8eea-d47f3a65052c None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:00.232017 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-c2ecccb8-3950-48a9-af31-2a4dc82e0060 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 07 06:07:00.233211 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 362/730] 10.222.0.24 () {56 vars in 1102 bytes} [Thu Apr 7 06:07:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:00.233978 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ecccb8-3950-48a9-af31-2a4dc82e0060 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:00.265971 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573d2739-52c0-4e39-82f3-994de75005aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:00.266794 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d2739-52c0-4e39-82f3-994de75005aa None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:00.267059 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d2739-52c0-4e39-82f3-994de75005aa None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:00.267333 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d2739-52c0-4e39-82f3-994de75005aa None admin] PATH_INFO: `/v3/users/swift` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:00.274779 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573d2739-52c0-4e39-82f3-994de75005aa None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:00.276271 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573d2739-52c0-4e39-82f3-994de75005aa None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:00.290357 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-573d2739-52c0-4e39-82f3-994de75005aa None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 07 06:07:00.296117 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 369/731] 10.222.0.24 () {56 vars in 1096 bytes} [Thu Apr 7 06:07:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:00.296117 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2ab0e-290f-4b83-b477-bb4f47f5c493 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:00.296117 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2ab0e-290f-4b83-b477-bb4f47f5c493 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:00.296117 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2ab0e-290f-4b83-b477-bb4f47f5c493 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:00.296117 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 370/732] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:07:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:07:00.296117 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b2ab0e-290f-4b83-b477-bb4f47f5c493 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:00.338707 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ecccb8-3950-48a9-af31-2a4dc82e0060 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:00.373287 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20984726-044d-413f-8e28-69508032fdd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:00.374014 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20984726-044d-413f-8e28-69508032fdd2 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:00.374296 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20984726-044d-413f-8e28-69508032fdd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:00.374654 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20984726-044d-413f-8e28-69508032fdd2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:00.387033 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20984726-044d-413f-8e28-69508032fdd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:07:00.392005 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b2ab0e-290f-4b83-b477-bb4f47f5c493 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:00.398972 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-20984726-044d-413f-8e28-69508032fdd2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 07 06:07:00.400550 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 363/733] 10.222.0.24 () {56 vars in 1096 bytes} [Thu Apr 7 06:07:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:00.401358 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20984726-044d-413f-8e28-69508032fdd2 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:00.428050 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19022c65-c4d8-4305-90ed-56eacbddec8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:00.428755 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19022c65-c4d8-4305-90ed-56eacbddec8d None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:00.429049 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19022c65-c4d8-4305-90ed-56eacbddec8d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:00.429325 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19022c65-c4d8-4305-90ed-56eacbddec8d None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:00.430069 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19022c65-c4d8-4305-90ed-56eacbddec8d None admin] RBAC: Adding query filter params (name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:00.430379 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19022c65-c4d8-4305-90ed-56eacbddec8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:00.431731 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19022c65-c4d8-4305-90ed-56eacbddec8d None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:00.443947 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 371/734] 10.222.0.24 () {56 vars in 1103 bytes} [Thu Apr 7 06:07:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:00.443947 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de27dedd-90a3-4d5a-a2ac-773efc9c7a25 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:00.443947 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de27dedd-90a3-4d5a-a2ac-773efc9c7a25 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:00.443947 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de27dedd-90a3-4d5a-a2ac-773efc9c7a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:00.457522 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-de27dedd-90a3-4d5a-a2ac-773efc9c7a25 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:07:00.458702 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-de27dedd-90a3-4d5a-a2ac-773efc9c7a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:07:00.501913 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20984726-044d-413f-8e28-69508032fdd2 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:00.525958 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 372/735] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:07:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:07:00.526707 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de27dedd-90a3-4d5a-a2ac-773efc9c7a25 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:00.542394 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc602a2b-2082-412a-a179-0fafd3c8fd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:00.543063 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc602a2b-2082-412a-a179-0fafd3c8fd6f None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:00.543351 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc602a2b-2082-412a-a179-0fafd3c8fd6f None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:00.543628 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc602a2b-2082-412a-a179-0fafd3c8fd6f None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:00.544490 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc602a2b-2082-412a-a179-0fafd3c8fd6f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:00.544800 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc602a2b-2082-412a-a179-0fafd3c8fd6f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:00.546240 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc602a2b-2082-412a-a179-0fafd3c8fd6f None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:00.563065 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 364/736] 10.222.0.24 () {56 vars in 1135 bytes} [Thu Apr 7 06:07:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:00.563906 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc602a2b-2082-412a-a179-0fafd3c8fd6f None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:00.619448 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de27dedd-90a3-4d5a-a2ac-773efc9c7a25 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:00.652581 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904f5994-23ee-434f-a38d-4ac275d9551f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:00.653182 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f5994-23ee-434f-a38d-4ac275d9551f None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:00.653470 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f5994-23ee-434f-a38d-4ac275d9551f None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:00.653740 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f5994-23ee-434f-a38d-4ac275d9551f None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:00.654479 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904f5994-23ee-434f-a38d-4ac275d9551f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:00.654784 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904f5994-23ee-434f-a38d-4ac275d9551f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:00.656198 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904f5994-23ee-434f-a38d-4ac275d9551f None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:00.658601 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc602a2b-2082-412a-a179-0fafd3c8fd6f None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:00.663814 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 373/737] 10.222.0.24 () {56 vars in 1099 bytes} [Thu Apr 7 06:07:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:00.665030 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08ca1a-3d0b-4b73-a2c6-0a92ae9929ac None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:00.665320 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08ca1a-3d0b-4b73-a2c6-0a92ae9929ac None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:00.665603 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08ca1a-3d0b-4b73-a2c6-0a92ae9929ac None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:00.666821 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 374/738] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:07:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:07:00.667509 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a08ca1a-3d0b-4b73-a2c6-0a92ae9929ac None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:00.696485 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b84b613-477b-4e9f-b319-d5a2054d6931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:00.697276 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84b613-477b-4e9f-b319-d5a2054d6931 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:00.697746 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84b613-477b-4e9f-b319-d5a2054d6931 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:00.698030 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84b613-477b-4e9f-b319-d5a2054d6931 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:00.707657 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b84b613-477b-4e9f-b319-d5a2054d6931 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:00.715310 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b84b613-477b-4e9f-b319-d5a2054d6931 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:00.725376 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-1b84b613-477b-4e9f-b319-d5a2054d6931 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:07:00.727209 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 365/739] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:07:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:00.727921 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b84b613-477b-4e9f-b319-d5a2054d6931 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:00.764292 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a08ca1a-3d0b-4b73-a2c6-0a92ae9929ac None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:00.796889 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87de5501-881f-4619-b58a-eadfd045bc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:00.797587 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de5501-881f-4619-b58a-eadfd045bc73 None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:00.797869 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de5501-881f-4619-b58a-eadfd045bc73 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:00.798146 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de5501-881f-4619-b58a-eadfd045bc73 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:00.798867 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87de5501-881f-4619-b58a-eadfd045bc73 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:00.800261 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87de5501-881f-4619-b58a-eadfd045bc73 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:00.822691 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b84b613-477b-4e9f-b319-d5a2054d6931 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:00.854786 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951a0f60-0dd5-4898-afe8-b437d4354d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:00.855426 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a0f60-0dd5-4898-afe8-b437d4354d21 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:00.855716 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a0f60-0dd5-4898-afe8-b437d4354d21 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:00.856023 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a0f60-0dd5-4898-afe8-b437d4354d21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:00.895714 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 375/740] 10.222.0.24 () {60 vars in 1141 bytes} [Thu Apr 7 06:07:00 2022] POST /identity/v3/services => generated 240 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:07:00.896382 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87de5501-881f-4619-b58a-eadfd045bc73 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:00.931868 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951a0f60-0dd5-4898-afe8-b437d4354d21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:00.933313 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951a0f60-0dd5-4898-afe8-b437d4354d21 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:01.014539 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87de5501-881f-4619-b58a-eadfd045bc73 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:01.037482 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 366/741] 10.222.0.24 () {58 vars in 1282 bytes} [Thu Apr 7 06:07:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 07 06:07:01.039547 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3dda2-5803-4fb2-b969-bfc9cf5e6bd9 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:01.039867 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3dda2-5803-4fb2-b969-bfc9cf5e6bd9 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:01.040149 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3dda2-5803-4fb2-b969-bfc9cf5e6bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:01.056307 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d8a538-3cf9-46c6-a437-7535ec7483dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:01.057130 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8a538-3cf9-46c6-a437-7535ec7483dd None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:01.057416 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8a538-3cf9-46c6-a437-7535ec7483dd None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:01.057693 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8a538-3cf9-46c6-a437-7535ec7483dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:01.058536 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-34d3dda2-5803-4fb2-b969-bfc9cf5e6bd9 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:07:01.059817 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-34d3dda2-5803-4fb2-b969-bfc9cf5e6bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:07:01.068414 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d8a538-3cf9-46c6-a437-7535ec7483dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:01.070009 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d8a538-3cf9-46c6-a437-7535ec7483dd None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:01.087613 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-d7d8a538-3cf9-46c6-a437-7535ec7483dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:07:01.088987 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 376/742] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:07:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:01.092621 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d8a538-3cf9-46c6-a437-7535ec7483dd None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:01.135800 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 367/743] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:07:01 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 07 06:07:01.135800 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3dda2-5803-4fb2-b969-bfc9cf5e6bd9 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:01.192525 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d8a538-3cf9-46c6-a437-7535ec7483dd None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:01.226181 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d397626b-74b4-4a33-919b-144f4cbc9a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:01.226719 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d397626b-74b4-4a33-919b-144f4cbc9a7f None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:01.227004 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d397626b-74b4-4a33-919b-144f4cbc9a7f None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:01.227277 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d397626b-74b4-4a33-919b-144f4cbc9a7f None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:01.228028 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d397626b-74b4-4a33-919b-144f4cbc9a7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:01.228335 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d397626b-74b4-4a33-919b-144f4cbc9a7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:01.229083 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3dda2-5803-4fb2-b969-bfc9cf5e6bd9 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:01.229717 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d397626b-74b4-4a33-919b-144f4cbc9a7f None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:01.241808 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 377/744] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:07:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:01.242914 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d397626b-74b4-4a33-919b-144f4cbc9a7f None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:01.266787 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d4d9f-21b6-47be-a062-edf1c043fb41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:01.267587 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d4d9f-21b6-47be-a062-edf1c043fb41 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:01.267909 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d4d9f-21b6-47be-a062-edf1c043fb41 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:01.268186 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d4d9f-21b6-47be-a062-edf1c043fb41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:01.278545 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416d4d9f-21b6-47be-a062-edf1c043fb41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:01.280027 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416d4d9f-21b6-47be-a062-edf1c043fb41 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:01.296808 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-416d4d9f-21b6-47be-a062-edf1c043fb41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:07:01.302379 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 368/745] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:07:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:01.302379 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d4d9f-21b6-47be-a062-edf1c043fb41 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:01.341593 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d397626b-74b4-4a33-919b-144f4cbc9a7f None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:01.374500 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2267b6a9-d3a4-4a33-9849-13a8d666f260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:01.375167 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267b6a9-d3a4-4a33-9849-13a8d666f260 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:01.375452 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267b6a9-d3a4-4a33-9849-13a8d666f260 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:01.375727 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267b6a9-d3a4-4a33-9849-13a8d666f260 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:01.376469 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2267b6a9-d3a4-4a33-9849-13a8d666f260 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:01.376775 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2267b6a9-d3a4-4a33-9849-13a8d666f260 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:01.378141 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2267b6a9-d3a4-4a33-9849-13a8d666f260 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:01.392063 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 378/746] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:07:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:01.393167 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2267b6a9-d3a4-4a33-9849-13a8d666f260 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:01.400578 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d4d9f-21b6-47be-a062-edf1c043fb41 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:01.433997 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ee171c-2055-4077-89eb-1c332ed979d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:01.434662 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee171c-2055-4077-89eb-1c332ed979d0 None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:01.434947 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee171c-2055-4077-89eb-1c332ed979d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:01.435223 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee171c-2055-4077-89eb-1c332ed979d0 None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:01.435974 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ee171c-2055-4077-89eb-1c332ed979d0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:01.437405 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ee171c-2055-4077-89eb-1c332ed979d0 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:01.491802 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2267b6a9-d3a4-4a33-9849-13a8d666f260 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:01.527778 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 369/747] 10.222.0.24 () {60 vars in 1141 bytes} [Thu Apr 7 06:07:01 2022] POST /identity/v3/services => generated 251 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:07:01.527778 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ee171c-2055-4077-89eb-1c332ed979d0 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:01.538106 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f898fb0a-b871-45c5-aa9b-6885c752c50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:01.538949 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898fb0a-b871-45c5-aa9b-6885c752c50f None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:01.539264 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898fb0a-b871-45c5-aa9b-6885c752c50f None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:01.539537 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898fb0a-b871-45c5-aa9b-6885c752c50f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:01.548393 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f898fb0a-b871-45c5-aa9b-6885c752c50f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:01.549856 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f898fb0a-b871-45c5-aa9b-6885c752c50f None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:01.564749 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-f898fb0a-b871-45c5-aa9b-6885c752c50f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 07 06:07:01.566247 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 379/748] 10.222.0.24 () {56 vars in 1117 bytes} [Thu Apr 7 06:07:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:01.567084 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f898fb0a-b871-45c5-aa9b-6885c752c50f None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:01.645932 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ee171c-2055-4077-89eb-1c332ed979d0 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:01.675556 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f898fb0a-b871-45c5-aa9b-6885c752c50f None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:01.681613 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc73c00-7918-4728-b9ec-70149b5097d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:01.682457 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc73c00-7918-4728-b9ec-70149b5097d2 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:01.682841 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc73c00-7918-4728-b9ec-70149b5097d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:01.683220 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc73c00-7918-4728-b9ec-70149b5097d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:01.684103 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc73c00-7918-4728-b9ec-70149b5097d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:01.684518 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc73c00-7918-4728-b9ec-70149b5097d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:01.686032 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc73c00-7918-4728-b9ec-70149b5097d2 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:01.700239 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 370/749] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:07:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:01.701375 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc73c00-7918-4728-b9ec-70149b5097d2 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:01.711624 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06bb5d0-663d-44e6-b70e-2c6daf40746d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:01.712469 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06bb5d0-663d-44e6-b70e-2c6daf40746d None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:01.712754 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06bb5d0-663d-44e6-b70e-2c6daf40746d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:01.713030 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06bb5d0-663d-44e6-b70e-2c6daf40746d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:01.723904 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06bb5d0-663d-44e6-b70e-2c6daf40746d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:01.726719 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06bb5d0-663d-44e6-b70e-2c6daf40746d None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:01.747362 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-d06bb5d0-663d-44e6-b70e-2c6daf40746d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 07 06:07:01.747362 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 380/750] 10.222.0.24 () {56 vars in 1093 bytes} [Thu Apr 7 06:07:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:01.747362 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06bb5d0-663d-44e6-b70e-2c6daf40746d None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:01.821213 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc73c00-7918-4728-b9ec-70149b5097d2 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:01.859399 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa70d886-58bd-4379-8fb0-bb394581c2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:01.860118 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70d886-58bd-4379-8fb0-bb394581c2ed None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:01.860483 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70d886-58bd-4379-8fb0-bb394581c2ed None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:01.860756 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70d886-58bd-4379-8fb0-bb394581c2ed None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:01.861601 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa70d886-58bd-4379-8fb0-bb394581c2ed None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:01.861909 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa70d886-58bd-4379-8fb0-bb394581c2ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:01.863325 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa70d886-58bd-4379-8fb0-bb394581c2ed None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:01.870836 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06bb5d0-663d-44e6-b70e-2c6daf40746d None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:01.884681 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 371/751] 10.222.0.24 () {56 vars in 1149 bytes} [Thu Apr 7 06:07:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:01.885533 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa70d886-58bd-4379-8fb0-bb394581c2ed None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:01.912473 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160cb3d0-61eb-424b-955c-f2891d0c704f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:01.913921 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160cb3d0-61eb-424b-955c-f2891d0c704f None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:01.914208 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160cb3d0-61eb-424b-955c-f2891d0c704f None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:01.914488 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160cb3d0-61eb-424b-955c-f2891d0c704f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:01.923029 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160cb3d0-61eb-424b-955c-f2891d0c704f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:01.924957 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160cb3d0-61eb-424b-955c-f2891d0c704f None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:01.943242 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-160cb3d0-61eb-424b-955c-f2891d0c704f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 07 06:07:01.945221 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 381/752] 10.222.0.24 () {56 vars in 1111 bytes} [Thu Apr 7 06:07:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:01.946027 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160cb3d0-61eb-424b-955c-f2891d0c704f None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:01.987366 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa70d886-58bd-4379-8fb0-bb394581c2ed None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:02.021695 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b395e-f8fb-4d93-813d-473a807e8116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:02.022813 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b395e-f8fb-4d93-813d-473a807e8116 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:02.023107 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b395e-f8fb-4d93-813d-473a807e8116 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:02.023378 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b395e-f8fb-4d93-813d-473a807e8116 None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:02.024247 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6b395e-f8fb-4d93-813d-473a807e8116 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:02.024552 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6b395e-f8fb-4d93-813d-473a807e8116 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:02.025997 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6b395e-f8fb-4d93-813d-473a807e8116 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:02.044122 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 372/753] 10.222.0.24 () {56 vars in 1133 bytes} [Thu Apr 7 06:07:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:02.045124 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b395e-f8fb-4d93-813d-473a807e8116 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:02.046580 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160cb3d0-61eb-424b-955c-f2891d0c704f None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:02.081951 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e834a6-346f-40c0-9014-1516387a65a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:02.082607 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e834a6-346f-40c0-9014-1516387a65a8 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:02.082890 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e834a6-346f-40c0-9014-1516387a65a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:02.083164 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e834a6-346f-40c0-9014-1516387a65a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:02.144959 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b395e-f8fb-4d93-813d-473a807e8116 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:02.150216 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e834a6-346f-40c0-9014-1516387a65a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:02.151680 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e834a6-346f-40c0-9014-1516387a65a8 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:02.178983 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61822b7-2945-463f-bdcc-1b79a4044712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:02.179646 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61822b7-2945-463f-bdcc-1b79a4044712 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:02.179977 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61822b7-2945-463f-bdcc-1b79a4044712 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:02.180254 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61822b7-2945-463f-bdcc-1b79a4044712 None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:02.181038 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61822b7-2945-463f-bdcc-1b79a4044712 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:02.181403 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61822b7-2945-463f-bdcc-1b79a4044712 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:02.182884 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61822b7-2945-463f-bdcc-1b79a4044712 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:02.199790 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 373/754] 10.222.0.24 () {56 vars in 1148 bytes} [Thu Apr 7 06:07:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:02.200639 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61822b7-2945-463f-bdcc-1b79a4044712 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:02.249624 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 382/755] 10.222.0.24 () {58 vars in 1282 bytes} [Thu Apr 7 06:07:01 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 07 06:07:02.250478 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e834a6-346f-40c0-9014-1516387a65a8 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:02.297230 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61822b7-2945-463f-bdcc-1b79a4044712 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:02.330874 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3418cda-0751-4e96-bb5b-4581473288f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:02.331854 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3418cda-0751-4e96-bb5b-4581473288f0 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:02.332418 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3418cda-0751-4e96-bb5b-4581473288f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:02.332704 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3418cda-0751-4e96-bb5b-4581473288f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:02.346354 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3418cda-0751-4e96-bb5b-4581473288f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:02.346713 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e834a6-346f-40c0-9014-1516387a65a8 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:02.347825 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3418cda-0751-4e96-bb5b-4581473288f0 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:02.369345 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-c3418cda-0751-4e96-bb5b-4581473288f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:07:02.371479 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 374/756] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:07:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:02.372528 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3418cda-0751-4e96-bb5b-4581473288f0 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:02.380857 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967faf46-067d-4701-8680-00007af79366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:02.382173 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967faf46-067d-4701-8680-00007af79366 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:02.382563 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967faf46-067d-4701-8680-00007af79366 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:02.382906 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967faf46-067d-4701-8680-00007af79366 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:02.383851 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967faf46-067d-4701-8680-00007af79366 None admin] RBAC: Adding query filter params (role.id=0fab680bc76f4a73826e9beb59e8129b, scope.project.id=de88f2c333ae49cfa7fff7fa1ed0022c, user.id=8b4abbb8c5324b7babd69e3b4473b3e2) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:02.384231 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967faf46-067d-4701-8680-00007af79366 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:02.385716 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967faf46-067d-4701-8680-00007af79366 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:02.391608 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 383/757] 10.222.0.24 () {56 vars in 1374 bytes} [Thu Apr 7 06:07:02 2022] GET /identity/v3/role_assignments?user.id=8b4abbb8c5324b7babd69e3b4473b3e2&scope.project.id=de88f2c333ae49cfa7fff7fa1ed0022c&role.id=0fab680bc76f4a73826e9beb59e8129b => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:02.392509 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967faf46-067d-4701-8680-00007af79366 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:02.548503 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3418cda-0751-4e96-bb5b-4581473288f0 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:02.585511 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec79a2-4bf7-42b9-ae3b-23548cdde854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:02.586516 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec79a2-4bf7-42b9-ae3b-23548cdde854 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:02.586803 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec79a2-4bf7-42b9-ae3b-23548cdde854 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:02.587079 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec79a2-4bf7-42b9-ae3b-23548cdde854 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:02.593759 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967faf46-067d-4701-8680-00007af79366 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:02.598838 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cec79a2-4bf7-42b9-ae3b-23548cdde854 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:02.602353 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cec79a2-4bf7-42b9-ae3b-23548cdde854 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:02.620607 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-9cec79a2-4bf7-42b9-ae3b-23548cdde854 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:07:02.622239 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 375/758] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:07:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:02.628086 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec79a2-4bf7-42b9-ae3b-23548cdde854 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:02.646676 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de1d730-081a-44b4-8de2-4de28346fb2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:02.648181 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1d730-081a-44b4-8de2-4de28346fb2d None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:02.648672 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1d730-081a-44b4-8de2-4de28346fb2d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:02.649141 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1d730-081a-44b4-8de2-4de28346fb2d None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:02.650056 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de1d730-081a-44b4-8de2-4de28346fb2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:02.650655 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de1d730-081a-44b4-8de2-4de28346fb2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:02.652226 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de1d730-081a-44b4-8de2-4de28346fb2d None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:02.664177 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 384/759] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:07:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:02.672762 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de1d730-081a-44b4-8de2-4de28346fb2d None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:02.730783 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec79a2-4bf7-42b9-ae3b-23548cdde854 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:02.773731 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a72db20-36b4-4c33-bddd-c3435327eaa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:02.774621 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72db20-36b4-4c33-bddd-c3435327eaa3 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:02.774740 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72db20-36b4-4c33-bddd-c3435327eaa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:02.779488 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72db20-36b4-4c33-bddd-c3435327eaa3 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:02.779488 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a72db20-36b4-4c33-bddd-c3435327eaa3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:02.779488 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a72db20-36b4-4c33-bddd-c3435327eaa3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:02.779488 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a72db20-36b4-4c33-bddd-c3435327eaa3 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:02.797991 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 376/760] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:07:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:07:02.806769 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a72db20-36b4-4c33-bddd-c3435327eaa3 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:02.873930 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de1d730-081a-44b4-8de2-4de28346fb2d None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:02.922153 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a72db20-36b4-4c33-bddd-c3435327eaa3 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:02.956765 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c4e51-03fb-4def-a0fe-df8e02981d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:02.957578 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c4e51-03fb-4def-a0fe-df8e02981d17 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:02.957865 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c4e51-03fb-4def-a0fe-df8e02981d17 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:02.958143 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c4e51-03fb-4def-a0fe-df8e02981d17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:02.965007 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426bbf5d-5647-4ee9-a952-8aa14aa1e4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:02.965140 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071c4e51-03fb-4def-a0fe-df8e02981d17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:02.965811 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426bbf5d-5647-4ee9-a952-8aa14aa1e4bc None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:02.966091 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426bbf5d-5647-4ee9-a952-8aa14aa1e4bc None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:02.966362 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426bbf5d-5647-4ee9-a952-8aa14aa1e4bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:02.966527 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071c4e51-03fb-4def-a0fe-df8e02981d17 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:02.980824 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-071c4e51-03fb-4def-a0fe-df8e02981d17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 07 06:07:02.982436 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 377/761] 10.222.0.24 () {56 vars in 1111 bytes} [Thu Apr 7 06:07:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:02.983075 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426bbf5d-5647-4ee9-a952-8aa14aa1e4bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:02.987871 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426bbf5d-5647-4ee9-a952-8aa14aa1e4bc None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:02.993446 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c4e51-03fb-4def-a0fe-df8e02981d17 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:03.011773 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-426bbf5d-5647-4ee9-a952-8aa14aa1e4bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 07 06:07:03.011773 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 385/762] 10.222.0.24 () {56 vars in 1111 bytes} [Thu Apr 7 06:07:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:03.012770 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426bbf5d-5647-4ee9-a952-8aa14aa1e4bc None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:03.112177 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426bbf5d-5647-4ee9-a952-8aa14aa1e4bc None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:03.153806 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c4e51-03fb-4def-a0fe-df8e02981d17 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:03.156452 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63484863-2a7c-45fa-8f96-38b415f26892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:03.157126 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63484863-2a7c-45fa-8f96-38b415f26892 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:03.157409 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63484863-2a7c-45fa-8f96-38b415f26892 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:03.157684 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63484863-2a7c-45fa-8f96-38b415f26892 None admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:03.158467 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63484863-2a7c-45fa-8f96-38b415f26892 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:03.158774 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63484863-2a7c-45fa-8f96-38b415f26892 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:03.160245 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63484863-2a7c-45fa-8f96-38b415f26892 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:03.183795 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 386/763] 10.222.0.24 () {56 vars in 1148 bytes} [Thu Apr 7 06:07:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:03.187204 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63484863-2a7c-45fa-8f96-38b415f26892 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:03.206569 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa25a06-fb60-4d82-97c5-dd51fbae3279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:03.207245 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa25a06-fb60-4d82-97c5-dd51fbae3279 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:03.207533 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa25a06-fb60-4d82-97c5-dd51fbae3279 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:03.207837 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa25a06-fb60-4d82-97c5-dd51fbae3279 None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:03.208639 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa25a06-fb60-4d82-97c5-dd51fbae3279 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:03.208950 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa25a06-fb60-4d82-97c5-dd51fbae3279 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:03.210457 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa25a06-fb60-4d82-97c5-dd51fbae3279 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:03.235585 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 378/764] 10.222.0.24 () {56 vars in 1148 bytes} [Thu Apr 7 06:07:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:03.242741 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa25a06-fb60-4d82-97c5-dd51fbae3279 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:03.360262 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63484863-2a7c-45fa-8f96-38b415f26892 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:03.414442 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa25a06-fb60-4d82-97c5-dd51fbae3279 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:03.425503 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf4afb-e71d-47e3-b1d8-9b8d65aeb36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:03.426398 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf4afb-e71d-47e3-b1d8-9b8d65aeb36f None admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:03.426681 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf4afb-e71d-47e3-b1d8-9b8d65aeb36f None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:03.426957 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf4afb-e71d-47e3-b1d8-9b8d65aeb36f None admin] PATH_INFO: `/v3/projects/de88f2c333ae49cfa7fff7fa1ed0022c/users/02cd81f6620f410db450871fb29961f6/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:03.432246 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cf4afb-e71d-47e3-b1d8-9b8d65aeb36f None admin] RBAC: Authorizing `identity:create_grant(project_id=de88f2c333ae49cfa7fff7fa1ed0022c, user_id=02cd81f6620f410db450871fb29961f6, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:03.433700 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cf4afb-e71d-47e3-b1d8-9b8d65aeb36f None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:03.465346 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a82b6e-898e-429f-bb64-1484b605c9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:03.471344 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a82b6e-898e-429f-bb64-1484b605c9ff None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:03.471344 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a82b6e-898e-429f-bb64-1484b605c9ff None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:03.471344 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a82b6e-898e-429f-bb64-1484b605c9ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:03.471344 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a82b6e-898e-429f-bb64-1484b605c9ff None admin] RBAC: Adding query filter params (role.id=64a6094c7a2942afb375bfb185843fd6, scope.project.id=de88f2c333ae49cfa7fff7fa1ed0022c, user.id=f4435fb14c3844728531af63993f78c0) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:03.471344 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a82b6e-898e-429f-bb64-1484b605c9ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:03.471344 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a82b6e-898e-429f-bb64-1484b605c9ff None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:03.475646 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 379/765] 10.222.0.24 () {56 vars in 1374 bytes} [Thu Apr 7 06:07:03 2022] GET /identity/v3/role_assignments?user.id=f4435fb14c3844728531af63993f78c0&scope.project.id=de88f2c333ae49cfa7fff7fa1ed0022c&role.id=64a6094c7a2942afb375bfb185843fd6 => generated 259 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:03.514124 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d30af3b-eaef-4d15-bc97-694d880b0a04 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:03.523184 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d30af3b-eaef-4d15-bc97-694d880b0a04 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:03.523184 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d30af3b-eaef-4d15-bc97-694d880b0a04 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:03.523184 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 380/766] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:07:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 07 06:07:03.523184 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1569f4b-02ed-4449-81d7-844fd6adf9b1 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:03.523184 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1569f4b-02ed-4449-81d7-844fd6adf9b1 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:03.523184 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1569f4b-02ed-4449-81d7-844fd6adf9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:03.542013 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-f1569f4b-02ed-4449-81d7-844fd6adf9b1 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:07:03.543448 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-f1569f4b-02ed-4449-81d7-844fd6adf9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:07:03.552475 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 387/767] 10.222.0.24 () {58 vars in 1439 bytes} [Thu Apr 7 06:07:03 2022] PUT /identity/v3/projects/de88f2c333ae49cfa7fff7fa1ed0022c/users/02cd81f6620f410db450871fb29961f6/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:07:03.620093 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 381/768] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:07:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 07 06:07:03.644999 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf4afb-e71d-47e3-b1d8-9b8d65aeb36f None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:03.769960 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf4afb-e71d-47e3-b1d8-9b8d65aeb36f None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:03.807539 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce433b-99d2-4d12-8272-2573c4e593be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:03.808570 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce433b-99d2-4d12-8272-2573c4e593be None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:03.808860 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce433b-99d2-4d12-8272-2573c4e593be None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:03.809109 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce433b-99d2-4d12-8272-2573c4e593be None admin] PATH_INFO: `/v3/services/network` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:03.819863 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ce433b-99d2-4d12-8272-2573c4e593be None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:03.819863 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ce433b-99d2-4d12-8272-2573c4e593be None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:03.823620 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-25ce433b-99d2-4d12-8272-2573c4e593be None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 07 06:07:03.825323 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 388/769] 10.222.0.24 () {56 vars in 1111 bytes} [Thu Apr 7 06:07:03 2022] GET /identity/v3/services/network => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:03.831271 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1569f4b-02ed-4449-81d7-844fd6adf9b1 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:03.931172 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1569f4b-02ed-4449-81d7-844fd6adf9b1 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:03.964460 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0c2be9-edad-48d3-96a3-d740f3d715e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:03.965129 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c2be9-edad-48d3-96a3-d740f3d715e7 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:03.965412 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c2be9-edad-48d3-96a3-d740f3d715e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:03.965685 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c2be9-edad-48d3-96a3-d740f3d715e7 None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:03.966394 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0c2be9-edad-48d3-96a3-d740f3d715e7 None admin] RBAC: Adding query filter params (name=network) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:03.966701 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0c2be9-edad-48d3-96a3-d740f3d715e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:03.968100 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0c2be9-edad-48d3-96a3-d740f3d715e7 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:03.972995 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 382/770] 10.222.0.24 () {56 vars in 1112 bytes} [Thu Apr 7 06:07:03 2022] GET /identity/v3/services?name=network => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:03.979156 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce433b-99d2-4d12-8272-2573c4e593be None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:04.088832 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce433b-99d2-4d12-8272-2573c4e593be None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:04.123129 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1972ee-3b1a-4dd5-a73b-a77544b1f968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:04.124187 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1972ee-3b1a-4dd5-a73b-a77544b1f968 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:04.124669 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1972ee-3b1a-4dd5-a73b-a77544b1f968 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:04.125151 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1972ee-3b1a-4dd5-a73b-a77544b1f968 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:04.126058 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1972ee-3b1a-4dd5-a73b-a77544b1f968 None admin] RBAC: Adding query filter params (type=network) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:04.126566 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1972ee-3b1a-4dd5-a73b-a77544b1f968 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:04.128214 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1972ee-3b1a-4dd5-a73b-a77544b1f968 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:04.133806 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 389/771] 10.222.0.24 () {56 vars in 1112 bytes} [Thu Apr 7 06:07:03 2022] GET /identity/v3/services?type=network => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:04.142141 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0c2be9-edad-48d3-96a3-d740f3d715e7 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:04.286437 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0c2be9-edad-48d3-96a3-d740f3d715e7 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:04.332436 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3655fd20-3c89-462a-b374-24c45bf6122b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:04.333111 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655fd20-3c89-462a-b374-24c45bf6122b None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:04.333394 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655fd20-3c89-462a-b374-24c45bf6122b None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:04.333673 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655fd20-3c89-462a-b374-24c45bf6122b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:04.334466 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3655fd20-3c89-462a-b374-24c45bf6122b None admin] RBAC: Adding query filter params (interface=public, service_id=c8aba4925be442b0897a0282971fd53a, region_id=RegionOne) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:04.335314 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3655fd20-3c89-462a-b374-24c45bf6122b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:04.336790 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3655fd20-3c89-462a-b374-24c45bf6122b None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:04.344557 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 383/772] 10.222.0.24 () {56 vars in 1251 bytes} [Thu Apr 7 06:07:04 2022] GET /identity/v3/endpoints?service_id=c8aba4925be442b0897a0282971fd53a&interface=public®ion_id=RegionOne => generated 194 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:04.349949 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1972ee-3b1a-4dd5-a73b-a77544b1f968 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:04.409683 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b31366-a774-43f5-98a9-13b26ba0218c None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:04.409979 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b31366-a774-43f5-98a9-13b26ba0218c None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:04.410263 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b31366-a774-43f5-98a9-13b26ba0218c None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:04.411884 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 384/773] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:07:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 07 06:07:04.417592 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9149ad-6513-4cec-984a-13ac691f475f None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:04.417885 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9149ad-6513-4cec-984a-13ac691f475f None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:04.418160 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9149ad-6513-4cec-984a-13ac691f475f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:04.441083 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-7a9149ad-6513-4cec-984a-13ac691f475f None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:07:04.442340 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-7a9149ad-6513-4cec-984a-13ac691f475f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:07:04.473558 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1972ee-3b1a-4dd5-a73b-a77544b1f968 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:04.540484 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 385/774] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:07:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 07 06:07:04.557395 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438b780-e5e3-468e-96c6-50a9f74da110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:04.558092 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438b780-e5e3-468e-96c6-50a9f74da110 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:04.558381 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438b780-e5e3-468e-96c6-50a9f74da110 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:04.558658 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438b780-e5e3-468e-96c6-50a9f74da110 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:04.559349 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b438b780-e5e3-468e-96c6-50a9f74da110 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:04.560742 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b438b780-e5e3-468e-96c6-50a9f74da110 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:04.566477 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 390/775] 10.222.0.24 () {56 vars in 1087 bytes} [Thu Apr 7 06:07:04 2022] GET /identity/v3/services => generated 772 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:04.579037 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9149ad-6513-4cec-984a-13ac691f475f None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:04.705014 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9149ad-6513-4cec-984a-13ac691f475f None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:04.759938 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa1045-cdaa-4fa4-b214-93fa1454562a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:04.759938 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa1045-cdaa-4fa4-b214-93fa1454562a None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:04.759938 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa1045-cdaa-4fa4-b214-93fa1454562a None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:04.759938 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa1045-cdaa-4fa4-b214-93fa1454562a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:04.760398 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fa1045-cdaa-4fa4-b214-93fa1454562a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:04.761802 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fa1045-cdaa-4fa4-b214-93fa1454562a None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:04.782319 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-51fa1045-cdaa-4fa4-b214-93fa1454562a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 07 06:07:04.788117 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 386/776] 10.222.0.24 () {56 vars in 1129 bytes} [Thu Apr 7 06:07:04 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:04.789734 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438b780-e5e3-468e-96c6-50a9f74da110 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:04.910945 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438b780-e5e3-468e-96c6-50a9f74da110 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:04.953177 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fadce1-18bb-431f-b385-cb6da052e4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:04.953869 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fadce1-18bb-431f-b385-cb6da052e4aa None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:04.954154 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fadce1-18bb-431f-b385-cb6da052e4aa None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:04.954430 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fadce1-18bb-431f-b385-cb6da052e4aa None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:04.955194 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fadce1-18bb-431f-b385-cb6da052e4aa None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:04.955449 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fadce1-18bb-431f-b385-cb6da052e4aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:04.956833 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fadce1-18bb-431f-b385-cb6da052e4aa None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:04.966501 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 391/777] 10.222.0.24 () {56 vars in 1124 bytes} [Thu Apr 7 06:07:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:04.967775 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa1045-cdaa-4fa4-b214-93fa1454562a None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:05.102205 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa1045-cdaa-4fa4-b214-93fa1454562a None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:05.141542 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c1527-755b-4545-8ed3-e300062b1e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:05.142204 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c1527-755b-4545-8ed3-e300062b1e18 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:05.142486 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c1527-755b-4545-8ed3-e300062b1e18 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:05.142760 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c1527-755b-4545-8ed3-e300062b1e18 None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:05.143472 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16c1527-755b-4545-8ed3-e300062b1e18 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:05.143792 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16c1527-755b-4545-8ed3-e300062b1e18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:05.145170 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16c1527-755b-4545-8ed3-e300062b1e18 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:05.156712 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 387/778] 10.222.0.24 () {56 vars in 1124 bytes} [Thu Apr 7 06:07:04 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:05.163392 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fadce1-18bb-431f-b385-cb6da052e4aa None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:05.302563 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fadce1-18bb-431f-b385-cb6da052e4aa None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:05.312538 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ead520-d5d2-4d63-a62a-f52a7c33ce0c None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:05.313058 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ead520-d5d2-4d63-a62a-f52a7c33ce0c None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:05.313058 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ead520-d5d2-4d63-a62a-f52a7c33ce0c None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:05.315845 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 388/779] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:07:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 07 06:07:05.321031 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976f743-3ce5-418a-88c2-c6df905921aa None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:05.321323 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976f743-3ce5-418a-88c2-c6df905921aa None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:05.321598 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976f743-3ce5-418a-88c2-c6df905921aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:05.345187 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd114ef-58d4-4109-8287-7802dba1209e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:05.345853 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd114ef-58d4-4109-8287-7802dba1209e None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:05.346135 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd114ef-58d4-4109-8287-7802dba1209e None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:05.346416 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd114ef-58d4-4109-8287-7802dba1209e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:05.347210 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd114ef-58d4-4109-8287-7802dba1209e None admin] RBAC: Adding query filter params (interface=public, service_id=70e65f8bd8f9487a989eb58f7a387da5, region_id=RegionOne) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:05.347515 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd114ef-58d4-4109-8287-7802dba1209e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:05.349162 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd114ef-58d4-4109-8287-7802dba1209e None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:05.360391 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-9976f743-3ce5-418a-88c2-c6df905921aa None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:07:05.362899 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 392/780] 10.222.0.24 () {56 vars in 1251 bytes} [Thu Apr 7 06:07:05 2022] GET /identity/v3/endpoints?service_id=70e65f8bd8f9487a989eb58f7a387da5&interface=public®ion_id=RegionOne => generated 194 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:05.363375 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-9976f743-3ce5-418a-88c2-c6df905921aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:07:05.368804 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd114ef-58d4-4109-8287-7802dba1209e None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:05.493012 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd114ef-58d4-4109-8287-7802dba1209e None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:05.507218 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 389/781] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:07:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 07 06:07:05.526609 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c209a6-00cd-412c-ac31-f2874cad6635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:05.527281 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c209a6-00cd-412c-ac31-f2874cad6635 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:05.527566 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c209a6-00cd-412c-ac31-f2874cad6635 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:05.527877 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c209a6-00cd-412c-ac31-f2874cad6635 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:05.528564 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c209a6-00cd-412c-ac31-f2874cad6635 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:05.529925 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c209a6-00cd-412c-ac31-f2874cad6635 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:05.535335 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 393/782] 10.222.0.24 () {56 vars in 1087 bytes} [Thu Apr 7 06:07:05 2022] GET /identity/v3/services => generated 772 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:07:05.541190 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976f743-3ce5-418a-88c2-c6df905921aa None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:05.701280 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976f743-3ce5-418a-88c2-c6df905921aa None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:05.746220 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57098a6a-6165-4654-8bd3-44eb239bc320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:05.747024 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57098a6a-6165-4654-8bd3-44eb239bc320 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:05.747766 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57098a6a-6165-4654-8bd3-44eb239bc320 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:05.747766 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57098a6a-6165-4654-8bd3-44eb239bc320 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:05.763943 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57098a6a-6165-4654-8bd3-44eb239bc320 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:07:05.770812 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-57098a6a-6165-4654-8bd3-44eb239bc320 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 07 06:07:05.777370 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 390/783] 10.222.0.24 () {56 vars in 1096 bytes} [Thu Apr 7 06:07:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:05.778475 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c209a6-00cd-412c-ac31-f2874cad6635 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:05.906003 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c209a6-00cd-412c-ac31-f2874cad6635 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:05.939470 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18887659-9439-4d34-81ef-9f23eea4c47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:05.940177 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18887659-9439-4d34-81ef-9f23eea4c47f None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:05.940463 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18887659-9439-4d34-81ef-9f23eea4c47f None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:05.940740 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18887659-9439-4d34-81ef-9f23eea4c47f None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:05.941494 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18887659-9439-4d34-81ef-9f23eea4c47f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:05.941802 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18887659-9439-4d34-81ef-9f23eea4c47f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:05.943164 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18887659-9439-4d34-81ef-9f23eea4c47f None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:05.952680 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 394/784] 10.222.0.24 () {56 vars in 1099 bytes} [Thu Apr 7 06:07:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:05.959622 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57098a6a-6165-4654-8bd3-44eb239bc320 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:06.075662 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57098a6a-6165-4654-8bd3-44eb239bc320 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:06.116065 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03177691-8146-4b32-bda0-e125a8a3be90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:06.116867 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03177691-8146-4b32-bda0-e125a8a3be90 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:06.117152 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03177691-8146-4b32-bda0-e125a8a3be90 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:06.117429 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03177691-8146-4b32-bda0-e125a8a3be90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:06.134900 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03177691-8146-4b32-bda0-e125a8a3be90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:06.136401 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03177691-8146-4b32-bda0-e125a8a3be90 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:06.156073 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-03177691-8146-4b32-bda0-e125a8a3be90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:07:06.157575 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 391/785] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:07:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:06.163515 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18887659-9439-4d34-81ef-9f23eea4c47f None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:06.296844 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5c2e6-a658-4b4a-851c-f1b78fc402ba None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:06.297190 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5c2e6-a658-4b4a-851c-f1b78fc402ba None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:06.297408 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5c2e6-a658-4b4a-851c-f1b78fc402ba None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:06.299004 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 392/786] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:07:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:07:06.308937 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18887659-9439-4d34-81ef-9f23eea4c47f None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:06.318564 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1badcf8b-867c-439a-8f8d-569737babfdd None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:06.319339 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1badcf8b-867c-439a-8f8d-569737babfdd None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:06.319339 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1badcf8b-867c-439a-8f8d-569737babfdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:06.349958 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-1badcf8b-867c-439a-8f8d-569737babfdd None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:07:06.351249 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-1badcf8b-867c-439a-8f8d-569737babfdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:07:06.354542 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b73991-640d-455a-96fa-5ea205a7957a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:06.355208 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b73991-640d-455a-96fa-5ea205a7957a None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:06.355487 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b73991-640d-455a-96fa-5ea205a7957a None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:06.355769 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b73991-640d-455a-96fa-5ea205a7957a None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:06.356507 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b73991-640d-455a-96fa-5ea205a7957a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:06.356810 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b73991-640d-455a-96fa-5ea205a7957a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:06.358161 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b73991-640d-455a-96fa-5ea205a7957a None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:06.374528 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 395/787] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:07:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:06.379880 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b73991-640d-455a-96fa-5ea205a7957a None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:06.450391 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 393/788] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:07:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 07 06:07:06.452529 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd51f3-d383-4032-9923-f69ad5c93272 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:06.452826 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd51f3-d383-4032-9923-f69ad5c93272 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:06.453248 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd51f3-d383-4032-9923-f69ad5c93272 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:06.454757 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 394/789] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:07:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:07:06.460706 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f587a28-d3af-43b4-82fb-ee7fb3dfe652 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:06.460996 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f587a28-d3af-43b4-82fb-ee7fb3dfe652 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:06.461278 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f587a28-d3af-43b4-82fb-ee7fb3dfe652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:06.477317 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-0f587a28-d3af-43b4-82fb-ee7fb3dfe652 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:07:06.478496 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-0f587a28-d3af-43b4-82fb-ee7fb3dfe652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:07:06.489057 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b73991-640d-455a-96fa-5ea205a7957a None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:06.531781 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35857b-ee8b-40b0-ab42-36ca12052f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:06.532873 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35857b-ee8b-40b0-ab42-36ca12052f99 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:06.533305 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35857b-ee8b-40b0-ab42-36ca12052f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:06.533590 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35857b-ee8b-40b0-ab42-36ca12052f99 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:06.542903 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa35857b-ee8b-40b0-ab42-36ca12052f99 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:06.544192 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 395/790] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:07:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 07 06:07:06.544373 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa35857b-ee8b-40b0-ab42-36ca12052f99 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:06.545051 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f587a28-d3af-43b4-82fb-ee7fb3dfe652 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:06.560214 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-fa35857b-ee8b-40b0-ab42-36ca12052f99 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 07 06:07:06.561290 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 396/791] 10.222.0.24 () {56 vars in 1096 bytes} [Thu Apr 7 06:07:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 07 06:07:06.568481 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35857b-ee8b-40b0-ab42-36ca12052f99 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:06.676940 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f587a28-d3af-43b4-82fb-ee7fb3dfe652 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:06.695474 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35857b-ee8b-40b0-ab42-36ca12052f99 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:06.712092 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb8d82-7611-428a-8ff5-e42f790fb3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:06.712953 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb8d82-7611-428a-8ff5-e42f790fb3c5 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:06.713241 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb8d82-7611-428a-8ff5-e42f790fb3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:06.713518 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb8d82-7611-428a-8ff5-e42f790fb3c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:06.723701 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabb8d82-7611-428a-8ff5-e42f790fb3c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:07:06.730761 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-cabb8d82-7611-428a-8ff5-e42f790fb3c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 07 06:07:06.736735 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 396/792] 10.222.0.24 () {56 vars in 1096 bytes} [Thu Apr 7 06:07:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:06.737470 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed3183-97a3-404c-abd5-53c803bc9e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:06.737595 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb8d82-7611-428a-8ff5-e42f790fb3c5 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:06.738536 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed3183-97a3-404c-abd5-53c803bc9e46 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:06.739017 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed3183-97a3-404c-abd5-53c803bc9e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:06.739776 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed3183-97a3-404c-abd5-53c803bc9e46 None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:06.741074 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed3183-97a3-404c-abd5-53c803bc9e46 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:06.742549 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed3183-97a3-404c-abd5-53c803bc9e46 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:06.753765 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed3183-97a3-404c-abd5-53c803bc9e46 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:06.767785 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 397/793] 10.222.0.24 () {56 vars in 1135 bytes} [Thu Apr 7 06:07:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:06.767785 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed3183-97a3-404c-abd5-53c803bc9e46 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:06.847612 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb8d82-7611-428a-8ff5-e42f790fb3c5 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:06.874242 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed3183-97a3-404c-abd5-53c803bc9e46 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:06.883314 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29f0b9b-0d51-4191-90f5-1ff26ed2e61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:06.884348 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f0b9b-0d51-4191-90f5-1ff26ed2e61e None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:06.884770 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f0b9b-0d51-4191-90f5-1ff26ed2e61e None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:06.885186 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f0b9b-0d51-4191-90f5-1ff26ed2e61e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:06.895557 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29f0b9b-0d51-4191-90f5-1ff26ed2e61e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:07:06.902916 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-c29f0b9b-0d51-4191-90f5-1ff26ed2e61e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 07 06:07:06.907989 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 397/794] 10.222.0.24 () {56 vars in 1102 bytes} [Thu Apr 7 06:07:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:06.909137 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29f0b9b-0d51-4191-90f5-1ff26ed2e61e None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:06.909423 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe357b83-d38b-4873-a394-e6c641acb1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:06.911265 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe357b83-d38b-4873-a394-e6c641acb1b4 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:06.911265 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe357b83-d38b-4873-a394-e6c641acb1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:06.911265 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe357b83-d38b-4873-a394-e6c641acb1b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:06.911937 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe357b83-d38b-4873-a394-e6c641acb1b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:06.912314 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe357b83-d38b-4873-a394-e6c641acb1b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:06.914291 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe357b83-d38b-4873-a394-e6c641acb1b4 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:06.927547 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 398/795] 10.222.0.24 () {56 vars in 1099 bytes} [Thu Apr 7 06:07:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:06.927547 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe357b83-d38b-4873-a394-e6c641acb1b4 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:07.018147 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29f0b9b-0d51-4191-90f5-1ff26ed2e61e None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:07.023256 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe357b83-d38b-4873-a394-e6c641acb1b4 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:07.055433 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a75566d-a508-47d0-9d8e-ea6e73aabf91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:07.056574 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75566d-a508-47d0-9d8e-ea6e73aabf91 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:07.057062 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75566d-a508-47d0-9d8e-ea6e73aabf91 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:07.057524 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75566d-a508-47d0-9d8e-ea6e73aabf91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:07.066345 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559cd44e-d271-4339-a54c-2c93142034c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:07.067051 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559cd44e-d271-4339-a54c-2c93142034c6 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:07.067333 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559cd44e-d271-4339-a54c-2c93142034c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:07.067610 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559cd44e-d271-4339-a54c-2c93142034c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:07.068659 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559cd44e-d271-4339-a54c-2c93142034c6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:07.069278 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559cd44e-d271-4339-a54c-2c93142034c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:07.070486 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559cd44e-d271-4339-a54c-2c93142034c6 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:07.074026 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a75566d-a508-47d0-9d8e-ea6e73aabf91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:07.075961 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a75566d-a508-47d0-9d8e-ea6e73aabf91 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:07.085067 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 399/796] 10.222.0.24 () {56 vars in 1103 bytes} [Thu Apr 7 06:07:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:07.085067 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559cd44e-d271-4339-a54c-2c93142034c6 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:07.101530 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-9a75566d-a508-47d0-9d8e-ea6e73aabf91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:07:07.103327 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 398/797] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:07:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:07.104418 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a75566d-a508-47d0-9d8e-ea6e73aabf91 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:07.185173 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559cd44e-d271-4339-a54c-2c93142034c6 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:07.204451 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a75566d-a508-47d0-9d8e-ea6e73aabf91 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:07.218166 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b48e4-ed4a-48fb-b59a-fb29c8b072f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:07.219222 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b48e4-ed4a-48fb-b59a-fb29c8b072f1 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:07.219222 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b48e4-ed4a-48fb-b59a-fb29c8b072f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:07.219517 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b48e4-ed4a-48fb-b59a-fb29c8b072f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:07.229818 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012b48e4-ed4a-48fb-b59a-fb29c8b072f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:07.231260 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012b48e4-ed4a-48fb-b59a-fb29c8b072f1 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:07.240263 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cdeeae-5907-4f32-a827-9b768ca8ff14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:07.241919 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cdeeae-5907-4f32-a827-9b768ca8ff14 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:07.242422 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cdeeae-5907-4f32-a827-9b768ca8ff14 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:07.242895 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cdeeae-5907-4f32-a827-9b768ca8ff14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:07.248358 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-012b48e4-ed4a-48fb-b59a-fb29c8b072f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:07:07.254427 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 400/798] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:07:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:07.254427 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b48e4-ed4a-48fb-b59a-fb29c8b072f1 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:07.259091 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cdeeae-5907-4f32-a827-9b768ca8ff14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:07.260938 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cdeeae-5907-4f32-a827-9b768ca8ff14 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:07.278421 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-94cdeeae-5907-4f32-a827-9b768ca8ff14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:07:07.284534 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 399/799] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:07:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:07.285611 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cdeeae-5907-4f32-a827-9b768ca8ff14 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:07.349305 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b48e4-ed4a-48fb-b59a-fb29c8b072f1 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:07.385674 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e261c7a-bfa8-4c54-9af1-14c8ad74e91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:07.386018 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cdeeae-5907-4f32-a827-9b768ca8ff14 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:07.386533 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e261c7a-bfa8-4c54-9af1-14c8ad74e91d None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:07.386533 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e261c7a-bfa8-4c54-9af1-14c8ad74e91d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:07.386787 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e261c7a-bfa8-4c54-9af1-14c8ad74e91d None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:07.387449 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e261c7a-bfa8-4c54-9af1-14c8ad74e91d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:07.387771 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e261c7a-bfa8-4c54-9af1-14c8ad74e91d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:07.389142 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e261c7a-bfa8-4c54-9af1-14c8ad74e91d None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:07.401406 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 401/800] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:07:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:07.402384 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e261c7a-bfa8-4c54-9af1-14c8ad74e91d None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:07.423405 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b8575c-4518-41b0-bf4a-66dfbdf4a730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:07.424471 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b8575c-4518-41b0-bf4a-66dfbdf4a730 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:07.424957 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b8575c-4518-41b0-bf4a-66dfbdf4a730 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:07.425444 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b8575c-4518-41b0-bf4a-66dfbdf4a730 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:07.426438 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b8575c-4518-41b0-bf4a-66dfbdf4a730 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:07.426952 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b8575c-4518-41b0-bf4a-66dfbdf4a730 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:07.428655 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b8575c-4518-41b0-bf4a-66dfbdf4a730 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:07.440626 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 400/801] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:07:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:07.441698 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b8575c-4518-41b0-bf4a-66dfbdf4a730 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:07.507782 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e261c7a-bfa8-4c54-9af1-14c8ad74e91d None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:07.539429 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b8575c-4518-41b0-bf4a-66dfbdf4a730 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:07.540903 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabdaf4e-961c-4fe4-95ec-2ceba7d94232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:07.541733 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabdaf4e-961c-4fe4-95ec-2ceba7d94232 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:07.542021 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabdaf4e-961c-4fe4-95ec-2ceba7d94232 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:07.542294 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabdaf4e-961c-4fe4-95ec-2ceba7d94232 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:07.543015 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabdaf4e-961c-4fe4-95ec-2ceba7d94232 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:07.543320 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabdaf4e-961c-4fe4-95ec-2ceba7d94232 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:07.544713 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabdaf4e-961c-4fe4-95ec-2ceba7d94232 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:07.556251 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 402/802] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:07:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:07.557411 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035cecc-a904-47d7-84a0-f47139f82223 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:07.557702 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035cecc-a904-47d7-84a0-f47139f82223 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:07.557981 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035cecc-a904-47d7-84a0-f47139f82223 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:07.559315 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 403/803] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:07:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:07:07.560495 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9035cecc-a904-47d7-84a0-f47139f82223 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:07.579033 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9da9f3-a388-4518-bfdf-87954f4ede74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:07.579847 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9da9f3-a388-4518-bfdf-87954f4ede74 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:07.580131 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9da9f3-a388-4518-bfdf-87954f4ede74 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:07.580409 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9da9f3-a388-4518-bfdf-87954f4ede74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:07.586925 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9da9f3-a388-4518-bfdf-87954f4ede74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:07.588409 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9da9f3-a388-4518-bfdf-87954f4ede74 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:07.601474 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-af9da9f3-a388-4518-bfdf-87954f4ede74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 07 06:07:07.607440 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 401/804] 10.222.0.24 () {56 vars in 1111 bytes} [Thu Apr 7 06:07:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:07.607440 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9da9f3-a388-4518-bfdf-87954f4ede74 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:07.674728 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9035cecc-a904-47d7-84a0-f47139f82223 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:07.704665 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9da9f3-a388-4518-bfdf-87954f4ede74 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:07.709860 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe97cf-c271-4a74-94a3-ac395460a266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:07.710662 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe97cf-c271-4a74-94a3-ac395460a266 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:07.710943 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe97cf-c271-4a74-94a3-ac395460a266 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:07.711218 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe97cf-c271-4a74-94a3-ac395460a266 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:07.719337 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfe97cf-c271-4a74-94a3-ac395460a266 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:07.720818 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfe97cf-c271-4a74-94a3-ac395460a266 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:07.734833 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-8bfe97cf-c271-4a74-94a3-ac395460a266 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 07 06:07:07.740853 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 404/805] 10.222.0.24 () {56 vars in 1093 bytes} [Thu Apr 7 06:07:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:07.740853 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b80345-3a6c-4421-af8b-ec7bf7950d81 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:07.740853 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b80345-3a6c-4421-af8b-ec7bf7950d81 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:07.740853 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b80345-3a6c-4421-af8b-ec7bf7950d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:07.748787 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd449d0-4bd0-4cd4-a6bf-59ab78f0482d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:07.748787 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd449d0-4bd0-4cd4-a6bf-59ab78f0482d None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:07.748787 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd449d0-4bd0-4cd4-a6bf-59ab78f0482d None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:07.748787 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd449d0-4bd0-4cd4-a6bf-59ab78f0482d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:07.751679 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd449d0-4bd0-4cd4-a6bf-59ab78f0482d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:07.753191 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd449d0-4bd0-4cd4-a6bf-59ab78f0482d None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:07.756767 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-97b80345-3a6c-4421-af8b-ec7bf7950d81 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:07:07.757955 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-97b80345-3a6c-4421-af8b-ec7bf7950d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:07:07.771351 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-efd449d0-4bd0-4cd4-a6bf-59ab78f0482d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 07 06:07:07.773187 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 402/806] 10.222.0.24 () {56 vars in 1117 bytes} [Thu Apr 7 06:07:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:07.776951 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd449d0-4bd0-4cd4-a6bf-59ab78f0482d None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:07.831954 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 405/807] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:07:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 07 06:07:07.831954 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b80345-3a6c-4421-af8b-ec7bf7950d81 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:07.889845 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd449d0-4bd0-4cd4-a6bf-59ab78f0482d None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:07.924631 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18b725e-ad3b-4091-8f61-ff5182b87e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:07.925354 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b725e-ad3b-4091-8f61-ff5182b87e4d None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:07.925583 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b725e-ad3b-4091-8f61-ff5182b87e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:07.925864 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b725e-ad3b-4091-8f61-ff5182b87e4d None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:07.926645 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18b725e-ad3b-4091-8f61-ff5182b87e4d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:07.926958 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18b725e-ad3b-4091-8f61-ff5182b87e4d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:07.928964 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18b725e-ad3b-4091-8f61-ff5182b87e4d None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:07.934908 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b80345-3a6c-4421-af8b-ec7bf7950d81 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:07.944107 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 403/808] 10.222.0.24 () {56 vars in 1148 bytes} [Thu Apr 7 06:07:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:07.944848 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18b725e-ad3b-4091-8f61-ff5182b87e4d None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:07.969423 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a7a4c1-a218-4d23-82c5-626d2acf9d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:07.970185 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7a4c1-a218-4d23-82c5-626d2acf9d81 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:07.970377 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7a4c1-a218-4d23-82c5-626d2acf9d81 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:07.970640 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7a4c1-a218-4d23-82c5-626d2acf9d81 None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:07.971470 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a7a4c1-a218-4d23-82c5-626d2acf9d81 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:07.971804 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a7a4c1-a218-4d23-82c5-626d2acf9d81 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:07.973263 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a7a4c1-a218-4d23-82c5-626d2acf9d81 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:07.990412 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 406/809] 10.222.0.24 () {56 vars in 1133 bytes} [Thu Apr 7 06:07:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:07.991935 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a7a4c1-a218-4d23-82c5-626d2acf9d81 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:08.050305 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18b725e-ad3b-4091-8f61-ff5182b87e4d None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:08.083604 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0732ad2f-77af-4119-84a6-5f8cbc59a96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:08.084302 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732ad2f-77af-4119-84a6-5f8cbc59a96d None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:08.085128 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732ad2f-77af-4119-84a6-5f8cbc59a96d None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:08.085400 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732ad2f-77af-4119-84a6-5f8cbc59a96d None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:08.086225 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0732ad2f-77af-4119-84a6-5f8cbc59a96d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:08.086532 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0732ad2f-77af-4119-84a6-5f8cbc59a96d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:08.087166 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a7a4c1-a218-4d23-82c5-626d2acf9d81 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:08.087991 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0732ad2f-77af-4119-84a6-5f8cbc59a96d None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:08.109252 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 404/810] 10.222.0.24 () {56 vars in 1149 bytes} [Thu Apr 7 06:07:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:08.109252 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0732ad2f-77af-4119-84a6-5f8cbc59a96d None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:08.123676 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e337e067-235c-4925-a712-91212ec283e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:08.124518 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337e067-235c-4925-a712-91212ec283e8 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:08.124808 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337e067-235c-4925-a712-91212ec283e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:08.125086 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337e067-235c-4925-a712-91212ec283e8 None admin] PATH_INFO: `/v3/services/network` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:08.125742 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e337e067-235c-4925-a712-91212ec283e8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:08.127104 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e337e067-235c-4925-a712-91212ec283e8 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:08.138390 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-e337e067-235c-4925-a712-91212ec283e8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 07 06:07:08.139570 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 407/811] 10.222.0.24 () {56 vars in 1111 bytes} [Thu Apr 7 06:07:07 2022] GET /identity/v3/services/network => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:08.140365 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e337e067-235c-4925-a712-91212ec283e8 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:08.214481 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0732ad2f-77af-4119-84a6-5f8cbc59a96d None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:08.240966 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e337e067-235c-4925-a712-91212ec283e8 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:08.248331 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006c936-955c-4468-888f-15f5cf5655be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:08.249226 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006c936-955c-4468-888f-15f5cf5655be None admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:08.249511 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006c936-955c-4468-888f-15f5cf5655be None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:08.249788 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006c936-955c-4468-888f-15f5cf5655be None admin] PATH_INFO: `/v3/projects/de88f2c333ae49cfa7fff7fa1ed0022c/users/8b4abbb8c5324b7babd69e3b4473b3e2/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:08.251812 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b006c936-955c-4468-888f-15f5cf5655be None admin] RBAC: Authorizing `identity:create_grant(project_id=de88f2c333ae49cfa7fff7fa1ed0022c, user_id=8b4abbb8c5324b7babd69e3b4473b3e2, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:08.253238 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b006c936-955c-4468-888f-15f5cf5655be None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:08.274541 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc437f8d-0142-4c68-9882-843cc6a36f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:08.275192 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc437f8d-0142-4c68-9882-843cc6a36f21 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:08.275538 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc437f8d-0142-4c68-9882-843cc6a36f21 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:08.276089 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc437f8d-0142-4c68-9882-843cc6a36f21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:08.312919 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 405/812] 10.222.0.24 () {58 vars in 1439 bytes} [Thu Apr 7 06:07:08 2022] PUT /identity/v3/projects/de88f2c333ae49cfa7fff7fa1ed0022c/users/8b4abbb8c5324b7babd69e3b4473b3e2/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:07:08.313519 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006c936-955c-4468-888f-15f5cf5655be None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:08.348075 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc437f8d-0142-4c68-9882-843cc6a36f21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:08.349935 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc437f8d-0142-4c68-9882-843cc6a36f21 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:08.431536 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006c936-955c-4468-888f-15f5cf5655be None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:08.465408 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 408/813] 10.222.0.24 () {58 vars in 1282 bytes} [Thu Apr 7 06:07:08 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 07 06:07:08.465408 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc437f8d-0142-4c68-9882-843cc6a36f21 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:08.477257 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462aa72-107b-4933-b3f7-7f439de5c96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:08.478047 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462aa72-107b-4933-b3f7-7f439de5c96d None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:08.478331 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462aa72-107b-4933-b3f7-7f439de5c96d None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:08.478657 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462aa72-107b-4933-b3f7-7f439de5c96d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:08.489616 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d462aa72-107b-4933-b3f7-7f439de5c96d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:08.491596 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d462aa72-107b-4933-b3f7-7f439de5c96d None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:08.509713 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-d462aa72-107b-4933-b3f7-7f439de5c96d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:07:08.511014 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 406/814] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:07:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:08.512275 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a0020-8081-43e1-a1ef-6c1f6b83c681 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:08.512559 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a0020-8081-43e1-a1ef-6c1f6b83c681 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:08.512835 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a0020-8081-43e1-a1ef-6c1f6b83c681 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:08.514223 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 407/815] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:07:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:07:08.514776 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a0020-8081-43e1-a1ef-6c1f6b83c681 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:08.574080 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc437f8d-0142-4c68-9882-843cc6a36f21 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:08.617603 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc02c6c7-6629-4baa-a89d-2fe69b8eed78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:08.618464 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc02c6c7-6629-4baa-a89d-2fe69b8eed78 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:08.618773 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc02c6c7-6629-4baa-a89d-2fe69b8eed78 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:08.619193 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc02c6c7-6629-4baa-a89d-2fe69b8eed78 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:08.619935 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc02c6c7-6629-4baa-a89d-2fe69b8eed78 None admin] RBAC: Adding query filter params (name=network) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:08.620242 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc02c6c7-6629-4baa-a89d-2fe69b8eed78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:08.621768 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc02c6c7-6629-4baa-a89d-2fe69b8eed78 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:08.632214 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 409/816] 10.222.0.24 () {56 vars in 1112 bytes} [Thu Apr 7 06:07:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:08.632214 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc02c6c7-6629-4baa-a89d-2fe69b8eed78 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:08.640306 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a0020-8081-43e1-a1ef-6c1f6b83c681 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:08.675237 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a388825c-20c7-49b3-a5ed-84bf00bd6253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:08.676401 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388825c-20c7-49b3-a5ed-84bf00bd6253 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:08.676914 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388825c-20c7-49b3-a5ed-84bf00bd6253 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:08.677389 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388825c-20c7-49b3-a5ed-84bf00bd6253 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:08.689763 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a388825c-20c7-49b3-a5ed-84bf00bd6253 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:08.691595 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a388825c-20c7-49b3-a5ed-84bf00bd6253 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:08.709410 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-a388825c-20c7-49b3-a5ed-84bf00bd6253 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:07:08.716410 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 408/817] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:07:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:08.718154 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef66e94-d224-44d1-8325-ba6c0cf0e48f None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:08.718723 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef66e94-d224-44d1-8325-ba6c0cf0e48f None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:08.719231 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef66e94-d224-44d1-8325-ba6c0cf0e48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:08.736659 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-fef66e94-d224-44d1-8325-ba6c0cf0e48f None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:07:08.738298 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-fef66e94-d224-44d1-8325-ba6c0cf0e48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:07:08.755629 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc02c6c7-6629-4baa-a89d-2fe69b8eed78 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:08.802578 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e04490c-8332-4aac-b0f5-b296446e0d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:08.803774 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e04490c-8332-4aac-b0f5-b296446e0d46 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:08.804058 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e04490c-8332-4aac-b0f5-b296446e0d46 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:08.804334 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e04490c-8332-4aac-b0f5-b296446e0d46 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:08.805054 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e04490c-8332-4aac-b0f5-b296446e0d46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:08.805785 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e04490c-8332-4aac-b0f5-b296446e0d46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:08.808507 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e04490c-8332-4aac-b0f5-b296446e0d46 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:08.824306 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 410/818] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:07:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:08.825161 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e04490c-8332-4aac-b0f5-b296446e0d46 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:08.827890 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 409/819] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:07:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 07 06:07:08.828776 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef66e94-d224-44d1-8325-ba6c0cf0e48f None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:08.959623 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e04490c-8332-4aac-b0f5-b296446e0d46 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:08.975434 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef66e94-d224-44d1-8325-ba6c0cf0e48f None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:08.993011 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2549bf16-de65-48e5-b4f3-22fb552c3b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:08.993681 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549bf16-de65-48e5-b4f3-22fb552c3b4d None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:08.993973 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549bf16-de65-48e5-b4f3-22fb552c3b4d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:08.994248 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549bf16-de65-48e5-b4f3-22fb552c3b4d None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:08.994953 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2549bf16-de65-48e5-b4f3-22fb552c3b4d None admin] RBAC: Adding query filter params (type=network) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:08.995260 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2549bf16-de65-48e5-b4f3-22fb552c3b4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:08.996650 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2549bf16-de65-48e5-b4f3-22fb552c3b4d None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:09.006138 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 411/820] 10.222.0.24 () {56 vars in 1112 bytes} [Thu Apr 7 06:07:08 2022] GET /identity/v3/services?type=network => generated 350 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:09.006138 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2549bf16-de65-48e5-b4f3-22fb552c3b4d None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:09.022982 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ead4a3-1c7d-465f-a099-5ce42c5fcdff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:09.024372 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ead4a3-1c7d-465f-a099-5ce42c5fcdff None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:09.024978 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ead4a3-1c7d-465f-a099-5ce42c5fcdff None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:09.025633 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ead4a3-1c7d-465f-a099-5ce42c5fcdff None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:09.026760 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ead4a3-1c7d-465f-a099-5ce42c5fcdff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:09.027398 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ead4a3-1c7d-465f-a099-5ce42c5fcdff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:09.029389 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ead4a3-1c7d-465f-a099-5ce42c5fcdff None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:09.041577 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 410/821] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:07:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:09.044647 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ead4a3-1c7d-465f-a099-5ce42c5fcdff None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:09.110427 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2549bf16-de65-48e5-b4f3-22fb552c3b4d None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:09.148734 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3eee1-51d7-465d-b74f-38a5ab859f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:09.149701 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3eee1-51d7-465d-b74f-38a5ab859f29 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:09.149994 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3eee1-51d7-465d-b74f-38a5ab859f29 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:09.150594 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3eee1-51d7-465d-b74f-38a5ab859f29 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:09.157893 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ead4a3-1c7d-465f-a099-5ce42c5fcdff None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:09.159438 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea3eee1-51d7-465d-b74f-38a5ab859f29 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:09.159551 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea3eee1-51d7-465d-b74f-38a5ab859f29 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:09.176544 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-5ea3eee1-51d7-465d-b74f-38a5ab859f29 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 07 06:07:09.178183 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 412/822] 10.222.0.24 () {56 vars in 1111 bytes} [Thu Apr 7 06:07:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:09.179471 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3eee1-51d7-465d-b74f-38a5ab859f29 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:09.193126 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7b5de5-dad8-4abe-9a73-66cc01367a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:09.193941 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b5de5-dad8-4abe-9a73-66cc01367a4e None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:09.194230 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b5de5-dad8-4abe-9a73-66cc01367a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:09.194516 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b5de5-dad8-4abe-9a73-66cc01367a4e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:09.195175 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7b5de5-dad8-4abe-9a73-66cc01367a4e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:09.196633 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7b5de5-dad8-4abe-9a73-66cc01367a4e None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:09.207819 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-df7b5de5-dad8-4abe-9a73-66cc01367a4e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 07 06:07:09.213936 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 411/823] 10.222.0.24 () {56 vars in 1129 bytes} [Thu Apr 7 06:07:09 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:09.213936 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7b5de5-dad8-4abe-9a73-66cc01367a4e None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:09.288740 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3eee1-51d7-465d-b74f-38a5ab859f29 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:09.307585 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7b5de5-dad8-4abe-9a73-66cc01367a4e None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:09.320768 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fbb9e0-d823-48fe-952c-d8e2bd56607d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:09.321435 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fbb9e0-d823-48fe-952c-d8e2bd56607d None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:09.321722 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fbb9e0-d823-48fe-952c-d8e2bd56607d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:09.321998 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fbb9e0-d823-48fe-952c-d8e2bd56607d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:09.322734 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fbb9e0-d823-48fe-952c-d8e2bd56607d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:09.324141 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fbb9e0-d823-48fe-952c-d8e2bd56607d None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:09.339670 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df6d69-995c-45c1-8348-cb76f4c3c46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:09.340509 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df6d69-995c-45c1-8348-cb76f4c3c46b None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:09.340793 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df6d69-995c-45c1-8348-cb76f4c3c46b None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:09.341067 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df6d69-995c-45c1-8348-cb76f4c3c46b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:09.347659 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30df6d69-995c-45c1-8348-cb76f4c3c46b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:09.358348 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30df6d69-995c-45c1-8348-cb76f4c3c46b None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:09.362321 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-30df6d69-995c-45c1-8348-cb76f4c3c46b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 07 06:07:09.363493 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 412/824] 10.222.0.24 () {56 vars in 1111 bytes} [Thu Apr 7 06:07:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:09.364548 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df6d69-995c-45c1-8348-cb76f4c3c46b None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:09.421287 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 413/825] 10.222.0.24 () {60 vars in 1144 bytes} [Thu Apr 7 06:07:09 2022] POST /identity/v3/endpoints => generated 327 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:07:09.429004 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fbb9e0-d823-48fe-952c-d8e2bd56607d None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:09.476917 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df6d69-995c-45c1-8348-cb76f4c3c46b None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:09.523506 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0d5c8-8c2b-43b2-bc46-d137860537f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:09.524632 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0d5c8-8c2b-43b2-bc46-d137860537f2 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:09.525126 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0d5c8-8c2b-43b2-bc46-d137860537f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:09.525594 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0d5c8-8c2b-43b2-bc46-d137860537f2 None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:09.526609 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c0d5c8-8c2b-43b2-bc46-d137860537f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:09.527132 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c0d5c8-8c2b-43b2-bc46-d137860537f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:09.528869 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c0d5c8-8c2b-43b2-bc46-d137860537f2 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:09.542761 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 413/826] 10.222.0.24 () {56 vars in 1148 bytes} [Thu Apr 7 06:07:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:09.543999 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0d5c8-8c2b-43b2-bc46-d137860537f2 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:09.555393 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fbb9e0-d823-48fe-952c-d8e2bd56607d None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:09.595208 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c3c171-c8b1-4a93-8aac-b0603fffc5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:09.596050 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c3c171-c8b1-4a93-8aac-b0603fffc5e7 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:09.596282 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c3c171-c8b1-4a93-8aac-b0603fffc5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:09.596560 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c3c171-c8b1-4a93-8aac-b0603fffc5e7 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:09.597285 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c3c171-c8b1-4a93-8aac-b0603fffc5e7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:09.597600 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c3c171-c8b1-4a93-8aac-b0603fffc5e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:09.599189 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c3c171-c8b1-4a93-8aac-b0603fffc5e7 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:09.609223 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 414/827] 10.222.0.24 () {56 vars in 1124 bytes} [Thu Apr 7 06:07:09 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:09.609223 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c3c171-c8b1-4a93-8aac-b0603fffc5e7 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:09.662267 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0d5c8-8c2b-43b2-bc46-d137860537f2 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:09.701435 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1504218-a410-4ff9-b946-6c1ba8927011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:09.702101 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1504218-a410-4ff9-b946-6c1ba8927011 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:09.702383 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1504218-a410-4ff9-b946-6c1ba8927011 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:09.702662 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1504218-a410-4ff9-b946-6c1ba8927011 None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:09.703443 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1504218-a410-4ff9-b946-6c1ba8927011 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:09.703803 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1504218-a410-4ff9-b946-6c1ba8927011 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:09.706063 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1504218-a410-4ff9-b946-6c1ba8927011 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:09.719272 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 414/828] 10.222.0.24 () {56 vars in 1148 bytes} [Thu Apr 7 06:07:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:09.720685 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c3c171-c8b1-4a93-8aac-b0603fffc5e7 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:09.720819 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1504218-a410-4ff9-b946-6c1ba8927011 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:09.754978 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca76987c-bf2b-45fc-94bd-5a62d3b6b066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:09.755900 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca76987c-bf2b-45fc-94bd-5a62d3b6b066 None admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:09.756191 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca76987c-bf2b-45fc-94bd-5a62d3b6b066 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:09.757007 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca76987c-bf2b-45fc-94bd-5a62d3b6b066 None admin] PATH_INFO: `/v3/projects/de88f2c333ae49cfa7fff7fa1ed0022c/users/f4435fb14c3844728531af63993f78c0/roles/64a6094c7a2942afb375bfb185843fd6` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:09.782121 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca76987c-bf2b-45fc-94bd-5a62d3b6b066 None admin] RBAC: Authorizing `identity:create_grant(project_id=de88f2c333ae49cfa7fff7fa1ed0022c, user_id=f4435fb14c3844728531af63993f78c0, role_id=64a6094c7a2942afb375bfb185843fd6)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:09.784395 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca76987c-bf2b-45fc-94bd-5a62d3b6b066 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:09.823824 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1504218-a410-4ff9-b946-6c1ba8927011 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:09.855233 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 415/829] 10.222.0.24 () {58 vars in 1439 bytes} [Thu Apr 7 06:07:09 2022] PUT /identity/v3/projects/de88f2c333ae49cfa7fff7fa1ed0022c/users/f4435fb14c3844728531af63993f78c0/roles/64a6094c7a2942afb375bfb185843fd6 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:07:09.856084 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca76987c-bf2b-45fc-94bd-5a62d3b6b066 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:09.865333 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29347093-4bba-4243-9dc6-349e53ab52bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:09.866299 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29347093-4bba-4243-9dc6-349e53ab52bb None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:09.866726 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29347093-4bba-4243-9dc6-349e53ab52bb None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:09.867140 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29347093-4bba-4243-9dc6-349e53ab52bb None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:09.868095 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29347093-4bba-4243-9dc6-349e53ab52bb None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:09.868450 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29347093-4bba-4243-9dc6-349e53ab52bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:09.869953 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29347093-4bba-4243-9dc6-349e53ab52bb None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:09.880221 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 415/830] 10.222.0.24 () {56 vars in 1124 bytes} [Thu Apr 7 06:07:09 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:09.882040 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29347093-4bba-4243-9dc6-349e53ab52bb None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:09.995535 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca76987c-bf2b-45fc-94bd-5a62d3b6b066 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:09.996106 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29347093-4bba-4243-9dc6-349e53ab52bb None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:10.032732 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f406e06-a96d-4a2d-8134-71facaee0783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:10.033080 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f6226-12a7-43b9-aacf-62122fef6a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:10.033721 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f6226-12a7-43b9-aacf-62122fef6a8d None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:10.034011 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f6226-12a7-43b9-aacf-62122fef6a8d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:10.034292 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f6226-12a7-43b9-aacf-62122fef6a8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:10.034640 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f406e06-a96d-4a2d-8134-71facaee0783 None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:10.035150 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119f6226-12a7-43b9-aacf-62122fef6a8d None admin] RBAC: Adding query filter params (role.id=0fab680bc76f4a73826e9beb59e8129b, scope.project.id=de88f2c333ae49cfa7fff7fa1ed0022c, user.id=02cd81f6620f410db450871fb29961f6) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:10.035256 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f406e06-a96d-4a2d-8134-71facaee0783 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:10.035463 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119f6226-12a7-43b9-aacf-62122fef6a8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:10.035985 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f406e06-a96d-4a2d-8134-71facaee0783 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:10.036960 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119f6226-12a7-43b9-aacf-62122fef6a8d None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:10.037068 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f406e06-a96d-4a2d-8134-71facaee0783 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:10.038697 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f406e06-a96d-4a2d-8134-71facaee0783 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:10.047768 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 416/831] 10.222.0.24 () {56 vars in 1374 bytes} [Thu Apr 7 06:07:09 2022] GET /identity/v3/role_assignments?user.id=02cd81f6620f410db450871fb29961f6&scope.project.id=de88f2c333ae49cfa7fff7fa1ed0022c&role.id=0fab680bc76f4a73826e9beb59e8129b => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:10.124164 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 416/832] 10.222.0.24 () {60 vars in 1144 bytes} [Thu Apr 7 06:07:09 2022] POST /identity/v3/endpoints => generated 346 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:07:10.701144 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb3517-f2d7-4e89-90a8-fe19b2b5ab02 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:10.701654 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb3517-f2d7-4e89-90a8-fe19b2b5ab02 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:10.701756 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb3517-f2d7-4e89-90a8-fe19b2b5ab02 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:10.703265 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 417/833] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:07:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:07:10.708585 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6f798-7945-431d-858e-d06b3a438074 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:10.708977 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6f798-7945-431d-858e-d06b3a438074 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:10.709147 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6f798-7945-431d-858e-d06b3a438074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:10.728647 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-7ad6f798-7945-431d-858e-d06b3a438074 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:07:10.729827 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-7ad6f798-7945-431d-858e-d06b3a438074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:07:10.813461 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 417/834] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:07:10 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 07 06:07:10.837871 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bb3517-f2d7-4e89-90a8-fe19b2b5ab02 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:10.938784 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bb3517-f2d7-4e89-90a8-fe19b2b5ab02 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:10.973426 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb21c3-dbc3-46cd-b8fc-8ebb79bc9f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:10.974148 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb21c3-dbc3-46cd-b8fc-8ebb79bc9f8e None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:10.974486 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb21c3-dbc3-46cd-b8fc-8ebb79bc9f8e None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:10.974770 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb21c3-dbc3-46cd-b8fc-8ebb79bc9f8e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:10.985428 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cb21c3-dbc3-46cd-b8fc-8ebb79bc9f8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:07:10.993068 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-c3cb21c3-dbc3-46cd-b8fc-8ebb79bc9f8e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 07 06:07:10.994578 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 418/835] 10.222.0.24 () {56 vars in 1096 bytes} [Thu Apr 7 06:07:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:11.000130 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad6f798-7945-431d-858e-d06b3a438074 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:11.099770 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad6f798-7945-431d-858e-d06b3a438074 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:11.133406 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979facef-1374-4f37-a44c-b4cc1b2ffc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:11.134078 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979facef-1374-4f37-a44c-b4cc1b2ffc58 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:11.134358 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979facef-1374-4f37-a44c-b4cc1b2ffc58 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:11.134630 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979facef-1374-4f37-a44c-b4cc1b2ffc58 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:11.135427 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979facef-1374-4f37-a44c-b4cc1b2ffc58 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:11.135736 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979facef-1374-4f37-a44c-b4cc1b2ffc58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:11.137135 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979facef-1374-4f37-a44c-b4cc1b2ffc58 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:11.145573 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 418/836] 10.222.0.24 () {56 vars in 1099 bytes} [Thu Apr 7 06:07:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:11.151164 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb21c3-dbc3-46cd-b8fc-8ebb79bc9f8e None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:11.247683 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb21c3-dbc3-46cd-b8fc-8ebb79bc9f8e None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:11.280621 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f08a8-00bf-4727-8080-ce7458768461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:11.281445 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f08a8-00bf-4727-8080-ce7458768461 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:11.281725 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f08a8-00bf-4727-8080-ce7458768461 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:11.281996 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f08a8-00bf-4727-8080-ce7458768461 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:11.295360 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8f08a8-00bf-4727-8080-ce7458768461 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:11.296890 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8f08a8-00bf-4727-8080-ce7458768461 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:11.314679 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-3d8f08a8-00bf-4727-8080-ce7458768461 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:07:11.316272 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 419/837] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:07:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:11.322079 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979facef-1374-4f37-a44c-b4cc1b2ffc58 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:11.420059 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979facef-1374-4f37-a44c-b4cc1b2ffc58 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:11.453079 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cced47e2-e455-4182-ab2f-177b9d72e23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:11.453762 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced47e2-e455-4182-ab2f-177b9d72e23c None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:11.454042 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced47e2-e455-4182-ab2f-177b9d72e23c None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:11.454317 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced47e2-e455-4182-ab2f-177b9d72e23c None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:11.455038 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cced47e2-e455-4182-ab2f-177b9d72e23c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:11.455341 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cced47e2-e455-4182-ab2f-177b9d72e23c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:11.456804 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cced47e2-e455-4182-ab2f-177b9d72e23c None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:11.469206 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 419/838] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:07:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:11.474578 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f08a8-00bf-4727-8080-ce7458768461 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:11.575308 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f08a8-00bf-4727-8080-ce7458768461 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:11.608204 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a7fb93-9123-4c80-8507-739b0aec5338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:11.609003 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a7fb93-9123-4c80-8507-739b0aec5338 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:11.609288 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a7fb93-9123-4c80-8507-739b0aec5338 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:11.609561 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a7fb93-9123-4c80-8507-739b0aec5338 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:11.617991 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a7fb93-9123-4c80-8507-739b0aec5338 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:11.619423 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a7fb93-9123-4c80-8507-739b0aec5338 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:11.632706 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-42a7fb93-9123-4c80-8507-739b0aec5338 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 07 06:07:11.634225 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 420/839] 10.222.0.24 () {56 vars in 1096 bytes} [Thu Apr 7 06:07:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:11.641051 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cced47e2-e455-4182-ab2f-177b9d72e23c None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:11.744370 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cced47e2-e455-4182-ab2f-177b9d72e23c None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:11.781327 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18b4673-8266-4384-b9f4-b8b0cdf90c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:11.782026 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b4673-8266-4384-b9f4-b8b0cdf90c02 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:11.782309 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b4673-8266-4384-b9f4-b8b0cdf90c02 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:11.782579 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b4673-8266-4384-b9f4-b8b0cdf90c02 None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:11.783421 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18b4673-8266-4384-b9f4-b8b0cdf90c02 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:11.783765 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18b4673-8266-4384-b9f4-b8b0cdf90c02 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:11.785213 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18b4673-8266-4384-b9f4-b8b0cdf90c02 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:11.803043 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 420/840] 10.222.0.24 () {56 vars in 1135 bytes} [Thu Apr 7 06:07:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:11.809247 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a7fb93-9123-4c80-8507-739b0aec5338 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:11.911225 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a7fb93-9123-4c80-8507-739b0aec5338 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:11.944718 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e9c32-9349-40b0-b519-308e5f98ad6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:11.945370 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e9c32-9349-40b0-b519-308e5f98ad6a None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:11.945651 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e9c32-9349-40b0-b519-308e5f98ad6a None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:11.945922 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e9c32-9349-40b0-b519-308e5f98ad6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:12.014261 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4e9c32-9349-40b0-b519-308e5f98ad6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:12.015715 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4e9c32-9349-40b0-b519-308e5f98ad6a None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:12.115188 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 421/841] 10.222.0.24 () {58 vars in 1282 bytes} [Thu Apr 7 06:07:11 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 07 06:07:12.120624 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18b4673-8266-4384-b9f4-b8b0cdf90c02 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:12.209840 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff480bc8-25e0-4eff-89a0-06262820ceea None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:12.210452 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff480bc8-25e0-4eff-89a0-06262820ceea None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:12.210953 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff480bc8-25e0-4eff-89a0-06262820ceea None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:12.212834 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 422/842] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:07:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:07:12.217848 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f27c0a-f7c7-4b07-a4e9-b748fb36639c None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:12.218132 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f27c0a-f7c7-4b07-a4e9-b748fb36639c None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:12.218406 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f27c0a-f7c7-4b07-a4e9-b748fb36639c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:12.232705 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18b4673-8266-4384-b9f4-b8b0cdf90c02 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:12.235047 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-a1f27c0a-f7c7-4b07-a4e9-b748fb36639c None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:07:12.236249 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a1f27c0a-f7c7-4b07-a4e9-b748fb36639c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:07:12.266221 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f6b63-9743-4ae3-b6f0-0098d0f550bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:12.267019 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f6b63-9743-4ae3-b6f0-0098d0f550bc None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:12.267300 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f6b63-9743-4ae3-b6f0-0098d0f550bc None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:12.267574 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f6b63-9743-4ae3-b6f0-0098d0f550bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:12.278729 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f6b63-9743-4ae3-b6f0-0098d0f550bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:12.280207 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f6b63-9743-4ae3-b6f0-0098d0f550bc None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:12.296961 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-2f7f6b63-9743-4ae3-b6f0-0098d0f550bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:07:12.298496 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 421/843] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:07:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:12.304548 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f6b63-9743-4ae3-b6f0-0098d0f550bc None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:12.315871 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 423/844] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:07:12 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 07 06:07:12.334615 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f27c0a-f7c7-4b07-a4e9-b748fb36639c None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:12.406022 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f6b63-9743-4ae3-b6f0-0098d0f550bc None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:12.440256 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc91f38-a2ab-41fa-9ec4-f1d58f8787ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:12.441277 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc91f38-a2ab-41fa-9ec4-f1d58f8787ce None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:12.441777 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc91f38-a2ab-41fa-9ec4-f1d58f8787ce None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:12.442247 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc91f38-a2ab-41fa-9ec4-f1d58f8787ce None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:12.443166 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc91f38-a2ab-41fa-9ec4-f1d58f8787ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:12.443711 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc91f38-a2ab-41fa-9ec4-f1d58f8787ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:12.445365 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc91f38-a2ab-41fa-9ec4-f1d58f8787ce None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:12.454085 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f27c0a-f7c7-4b07-a4e9-b748fb36639c None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:12.463871 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 422/845] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:07:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:07:12.466022 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc91f38-a2ab-41fa-9ec4-f1d58f8787ce None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:12.500297 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce9ba4e-df06-46e5-948a-abc5febbabb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:12.501166 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9ba4e-df06-46e5-948a-abc5febbabb4 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:12.501447 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9ba4e-df06-46e5-948a-abc5febbabb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:12.501760 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9ba4e-df06-46e5-948a-abc5febbabb4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:12.514571 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce9ba4e-df06-46e5-948a-abc5febbabb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:07:12.524013 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-2ce9ba4e-df06-46e5-948a-abc5febbabb4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 07 06:07:12.525355 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 424/846] 10.222.0.24 () {56 vars in 1102 bytes} [Thu Apr 7 06:07:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:12.526501 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe7970-0ff4-4fb6-a27f-0947fa715afd None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:12.526847 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe7970-0ff4-4fb6-a27f-0947fa715afd None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:12.527180 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe7970-0ff4-4fb6-a27f-0947fa715afd None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:12.528710 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 425/847] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:07:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:07:12.531585 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe7970-0ff4-4fb6-a27f-0947fa715afd None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:12.570200 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc91f38-a2ab-41fa-9ec4-f1d58f8787ce None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:12.602685 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e2bf72-2a54-4dd5-a240-438324cb7571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:12.603950 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2bf72-2a54-4dd5-a240-438324cb7571 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:12.604239 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2bf72-2a54-4dd5-a240-438324cb7571 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:12.604549 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2bf72-2a54-4dd5-a240-438324cb7571 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:12.613240 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e2bf72-2a54-4dd5-a240-438324cb7571 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:12.614951 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e2bf72-2a54-4dd5-a240-438324cb7571 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:12.628065 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-d7e2bf72-2a54-4dd5-a240-438324cb7571 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 07 06:07:12.634513 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 423/848] 10.222.0.24 () {56 vars in 1111 bytes} [Thu Apr 7 06:07:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 07 06:07:12.634513 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22797427-2da6-40fd-aafa-d0183fa4fca5 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:12.634513 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22797427-2da6-40fd-aafa-d0183fa4fca5 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:12.634513 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22797427-2da6-40fd-aafa-d0183fa4fca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:12.637764 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe7970-0ff4-4fb6-a27f-0947fa715afd None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:12.647967 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-22797427-2da6-40fd-aafa-d0183fa4fca5 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:07:12.649864 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-22797427-2da6-40fd-aafa-d0183fa4fca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:07:12.669428 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc20c81-22fe-4281-86bc-aa60d7bee0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:12.670092 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc20c81-22fe-4281-86bc-aa60d7bee0d2 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:12.670372 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc20c81-22fe-4281-86bc-aa60d7bee0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:12.670641 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc20c81-22fe-4281-86bc-aa60d7bee0d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:12.671375 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc20c81-22fe-4281-86bc-aa60d7bee0d2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:12.671676 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc20c81-22fe-4281-86bc-aa60d7bee0d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:12.673068 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc20c81-22fe-4281-86bc-aa60d7bee0d2 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:12.680718 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 426/849] 10.222.0.24 () {56 vars in 1103 bytes} [Thu Apr 7 06:07:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:12.682005 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cbd9a6-f423-4cdd-aa13-6d25ec1b63b6 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:12.682265 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cbd9a6-f423-4cdd-aa13-6d25ec1b63b6 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:12.682549 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cbd9a6-f423-4cdd-aa13-6d25ec1b63b6 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:12.685604 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 427/850] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:07:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:07:12.685604 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cbd9a6-f423-4cdd-aa13-6d25ec1b63b6 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:12.716396 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 424/851] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:07:12 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 07 06:07:12.717159 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22797427-2da6-40fd-aafa-d0183fa4fca5 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:12.788273 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cbd9a6-f423-4cdd-aa13-6d25ec1b63b6 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:12.812007 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22797427-2da6-40fd-aafa-d0183fa4fca5 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:12.819937 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13a5e9-61b1-4f19-820b-e5c0dfb4e815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:12.820599 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13a5e9-61b1-4f19-820b-e5c0dfb4e815 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:12.820880 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13a5e9-61b1-4f19-820b-e5c0dfb4e815 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:12.821153 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13a5e9-61b1-4f19-820b-e5c0dfb4e815 None admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:12.821937 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f13a5e9-61b1-4f19-820b-e5c0dfb4e815 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:12.822247 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f13a5e9-61b1-4f19-820b-e5c0dfb4e815 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:12.823667 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f13a5e9-61b1-4f19-820b-e5c0dfb4e815 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:12.835519 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 428/852] 10.222.0.24 () {56 vars in 1148 bytes} [Thu Apr 7 06:07:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:12.837470 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4da287-ef1f-44f3-a6f0-1e0daf14b998 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:12.837759 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4da287-ef1f-44f3-a6f0-1e0daf14b998 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:12.838092 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4da287-ef1f-44f3-a6f0-1e0daf14b998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:12.845111 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f7497-ab03-42d4-bbda-8d7923e8434b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:12.845910 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f7497-ab03-42d4-bbda-8d7923e8434b None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:12.846197 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f7497-ab03-42d4-bbda-8d7923e8434b None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:12.846475 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f7497-ab03-42d4-bbda-8d7923e8434b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:12.853283 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-da4da287-ef1f-44f3-a6f0-1e0daf14b998 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:07:12.854460 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-da4da287-ef1f-44f3-a6f0-1e0daf14b998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:07:12.856376 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f7497-ab03-42d4-bbda-8d7923e8434b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:12.857810 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f7497-ab03-42d4-bbda-8d7923e8434b None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:12.874277 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-452f7497-ab03-42d4-bbda-8d7923e8434b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:07:12.875452 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 425/853] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:07:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:12.876246 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f7497-ab03-42d4-bbda-8d7923e8434b None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:12.916046 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 429/854] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:07:12 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 07 06:07:12.916877 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4da287-ef1f-44f3-a6f0-1e0daf14b998 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:12.969565 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f7497-ab03-42d4-bbda-8d7923e8434b None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:13.001514 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb8164d-c143-4d53-adf7-d1672554a99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:13.002302 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8164d-c143-4d53-adf7-d1672554a99a None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:13.002587 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8164d-c143-4d53-adf7-d1672554a99a None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:13.002863 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8164d-c143-4d53-adf7-d1672554a99a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:13.003518 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb8164d-c143-4d53-adf7-d1672554a99a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:13.004941 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb8164d-c143-4d53-adf7-d1672554a99a None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:13.016233 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-deb8164d-c143-4d53-adf7-d1672554a99a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 07 06:07:13.016912 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4da287-ef1f-44f3-a6f0-1e0daf14b998 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:13.017397 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 426/855] 10.222.0.24 () {56 vars in 1114 bytes} [Thu Apr 7 06:07:12 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 141 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:13.018153 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb8164d-c143-4d53-adf7-d1672554a99a None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:13.048794 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922487f1-f5af-4080-ae63-0688cccbcfaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:13.049455 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922487f1-f5af-4080-ae63-0688cccbcfaf None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:13.049744 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922487f1-f5af-4080-ae63-0688cccbcfaf None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:13.050018 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922487f1-f5af-4080-ae63-0688cccbcfaf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:13.050846 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922487f1-f5af-4080-ae63-0688cccbcfaf None admin] RBAC: Adding query filter params (role.id=0fab680bc76f4a73826e9beb59e8129b, scope.project.id=de88f2c333ae49cfa7fff7fa1ed0022c, user.id=8b4abbb8c5324b7babd69e3b4473b3e2) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:13.051158 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922487f1-f5af-4080-ae63-0688cccbcfaf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:13.052607 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922487f1-f5af-4080-ae63-0688cccbcfaf None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:13.058635 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 430/856] 10.222.0.24 () {56 vars in 1374 bytes} [Thu Apr 7 06:07:12 2022] GET /identity/v3/role_assignments?user.id=8b4abbb8c5324b7babd69e3b4473b3e2&scope.project.id=de88f2c333ae49cfa7fff7fa1ed0022c&role.id=0fab680bc76f4a73826e9beb59e8129b => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:13.059406 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922487f1-f5af-4080-ae63-0688cccbcfaf None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:13.123265 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb8164d-c143-4d53-adf7-d1672554a99a None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:13.158368 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edcadbe-a4fe-458d-8131-3a8313456a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:13.159072 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcadbe-a4fe-458d-8131-3a8313456a64 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:13.159346 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcadbe-a4fe-458d-8131-3a8313456a64 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:13.159632 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcadbe-a4fe-458d-8131-3a8313456a64 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:13.160417 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edcadbe-a4fe-458d-8131-3a8313456a64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:13.160728 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edcadbe-a4fe-458d-8131-3a8313456a64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:13.162130 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edcadbe-a4fe-458d-8131-3a8313456a64 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:13.162899 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922487f1-f5af-4080-ae63-0688cccbcfaf None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:13.175173 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 427/857] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:07:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:13.176089 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edcadbe-a4fe-458d-8131-3a8313456a64 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:13.203681 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d29c0f-7204-4f17-80aa-6ee7e5e3a118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:13.204531 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d29c0f-7204-4f17-80aa-6ee7e5e3a118 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:13.204863 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d29c0f-7204-4f17-80aa-6ee7e5e3a118 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:13.205077 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d29c0f-7204-4f17-80aa-6ee7e5e3a118 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:13.205838 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d29c0f-7204-4f17-80aa-6ee7e5e3a118 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:13.207283 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d29c0f-7204-4f17-80aa-6ee7e5e3a118 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:13.219685 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-64d29c0f-7204-4f17-80aa-6ee7e5e3a118 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 07 06:07:13.221987 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 431/858] 10.222.0.24 () {56 vars in 1132 bytes} [Thu Apr 7 06:07:13 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:13.222121 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d29c0f-7204-4f17-80aa-6ee7e5e3a118 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:13.292952 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edcadbe-a4fe-458d-8131-3a8313456a64 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:13.326041 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d29c0f-7204-4f17-80aa-6ee7e5e3a118 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:13.327592 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2c6a6b-73c5-475d-a243-eba1cd8db4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:13.328292 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c6a6b-73c5-475d-a243-eba1cd8db4db None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:13.328578 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c6a6b-73c5-475d-a243-eba1cd8db4db None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:13.328852 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c6a6b-73c5-475d-a243-eba1cd8db4db None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:13.329555 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2c6a6b-73c5-475d-a243-eba1cd8db4db None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:13.329861 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2c6a6b-73c5-475d-a243-eba1cd8db4db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:13.331218 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2c6a6b-73c5-475d-a243-eba1cd8db4db None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:13.340080 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 428/859] 10.222.0.24 () {56 vars in 1114 bytes} [Thu Apr 7 06:07:13 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:13.340080 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2c6a6b-73c5-475d-a243-eba1cd8db4db None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:13.362796 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b721a66-8033-44e5-9556-33e70cf84797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:13.364483 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b721a66-8033-44e5-9556-33e70cf84797 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:13.364775 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b721a66-8033-44e5-9556-33e70cf84797 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:13.365051 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b721a66-8033-44e5-9556-33e70cf84797 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:13.374719 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b721a66-8033-44e5-9556-33e70cf84797 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:13.376198 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b721a66-8033-44e5-9556-33e70cf84797 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:13.390762 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-1b721a66-8033-44e5-9556-33e70cf84797 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 07 06:07:13.396526 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 432/860] 10.222.0.24 () {56 vars in 1117 bytes} [Thu Apr 7 06:07:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:13.396526 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b721a66-8033-44e5-9556-33e70cf84797 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:13.440386 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2c6a6b-73c5-475d-a243-eba1cd8db4db None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:13.473455 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c59cc-eb3c-4af2-9ccd-8dfed4170a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:13.474053 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c59cc-eb3c-4af2-9ccd-8dfed4170a70 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:13.474340 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c59cc-eb3c-4af2-9ccd-8dfed4170a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:13.474648 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c59cc-eb3c-4af2-9ccd-8dfed4170a70 None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:13.475933 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357c59cc-eb3c-4af2-9ccd-8dfed4170a70 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:13.476247 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357c59cc-eb3c-4af2-9ccd-8dfed4170a70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:13.477615 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357c59cc-eb3c-4af2-9ccd-8dfed4170a70 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:13.481995 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 429/861] 10.222.0.24 () {56 vars in 1126 bytes} [Thu Apr 7 06:07:13 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:13.482775 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c59cc-eb3c-4af2-9ccd-8dfed4170a70 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:13.499291 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b721a66-8033-44e5-9556-33e70cf84797 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:13.538606 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cbb911-dc54-46f2-b47c-82f694c3a430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:13.540066 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cbb911-dc54-46f2-b47c-82f694c3a430 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:13.540563 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cbb911-dc54-46f2-b47c-82f694c3a430 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:13.540858 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cbb911-dc54-46f2-b47c-82f694c3a430 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:13.541612 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cbb911-dc54-46f2-b47c-82f694c3a430 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:13.541928 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cbb911-dc54-46f2-b47c-82f694c3a430 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:13.543291 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cbb911-dc54-46f2-b47c-82f694c3a430 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:13.556068 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 433/862] 10.222.0.24 () {56 vars in 1114 bytes} [Thu Apr 7 06:07:13 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:13.556068 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cbb911-dc54-46f2-b47c-82f694c3a430 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:13.595674 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c59cc-eb3c-4af2-9ccd-8dfed4170a70 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:13.641819 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768c004-4b9c-49f0-8453-99836259fc85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:13.642802 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768c004-4b9c-49f0-8453-99836259fc85 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:13.643094 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768c004-4b9c-49f0-8453-99836259fc85 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:13.643377 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768c004-4b9c-49f0-8453-99836259fc85 None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:13.644876 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6768c004-4b9c-49f0-8453-99836259fc85 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:13.645197 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6768c004-4b9c-49f0-8453-99836259fc85 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:13.647806 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6768c004-4b9c-49f0-8453-99836259fc85 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:13.653805 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cbb911-dc54-46f2-b47c-82f694c3a430 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:13.672668 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 430/863] 10.222.0.24 () {56 vars in 1149 bytes} [Thu Apr 7 06:07:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:13.679363 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768c004-4b9c-49f0-8453-99836259fc85 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:13.694691 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857d493-53f5-4665-b8a5-b8397c560aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:13.695393 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857d493-53f5-4665-b8a5-b8397c560aa9 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:13.695662 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857d493-53f5-4665-b8a5-b8397c560aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:13.695972 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857d493-53f5-4665-b8a5-b8397c560aa9 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:13.696691 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b857d493-53f5-4665-b8a5-b8397c560aa9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:13.697000 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b857d493-53f5-4665-b8a5-b8397c560aa9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:13.698392 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b857d493-53f5-4665-b8a5-b8397c560aa9 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:13.709728 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 434/864] 10.222.0.24 () {56 vars in 1126 bytes} [Thu Apr 7 06:07:13 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:13.808631 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768c004-4b9c-49f0-8453-99836259fc85 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:13.844914 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d857b-a50d-471c-bab5-e2a269a8e316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:13.845583 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d857b-a50d-471c-bab5-e2a269a8e316 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:13.845858 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d857b-a50d-471c-bab5-e2a269a8e316 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:13.846127 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d857b-a50d-471c-bab5-e2a269a8e316 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:13.919984 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2d857b-a50d-471c-bab5-e2a269a8e316 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:13.921460 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2d857b-a50d-471c-bab5-e2a269a8e316 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:14.022612 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 431/865] 10.222.0.24 () {58 vars in 1282 bytes} [Thu Apr 7 06:07:13 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 07 06:07:14.028709 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857d493-53f5-4665-b8a5-b8397c560aa9 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:14.138178 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857d493-53f5-4665-b8a5-b8397c560aa9 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:14.172154 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ae143b-ee6e-4e46-9b4c-14cf3c9b36b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:14.173001 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae143b-ee6e-4e46-9b4c-14cf3c9b36b2 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:14.173292 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae143b-ee6e-4e46-9b4c-14cf3c9b36b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:14.173572 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae143b-ee6e-4e46-9b4c-14cf3c9b36b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:14.184283 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ae143b-ee6e-4e46-9b4c-14cf3c9b36b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:14.185746 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ae143b-ee6e-4e46-9b4c-14cf3c9b36b2 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:14.202307 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-a4ae143b-ee6e-4e46-9b4c-14cf3c9b36b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:07:14.207878 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 435/866] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:07:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:14.209993 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d857b-a50d-471c-bab5-e2a269a8e316 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:14.311023 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d857b-a50d-471c-bab5-e2a269a8e316 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:14.345592 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501d5ec-1f50-47bf-86cb-a71c86a1b7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:14.346258 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501d5ec-1f50-47bf-86cb-a71c86a1b7a7 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:14.346552 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501d5ec-1f50-47bf-86cb-a71c86a1b7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:14.346832 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501d5ec-1f50-47bf-86cb-a71c86a1b7a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:14.347559 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c501d5ec-1f50-47bf-86cb-a71c86a1b7a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:14.347901 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c501d5ec-1f50-47bf-86cb-a71c86a1b7a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:14.349271 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c501d5ec-1f50-47bf-86cb-a71c86a1b7a7 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:14.361442 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 432/867] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:07:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:14.367195 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ae143b-ee6e-4e46-9b4c-14cf3c9b36b2 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:14.471239 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ae143b-ee6e-4e46-9b4c-14cf3c9b36b2 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:14.505529 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e82733a-526c-450f-a06b-9ba1ba0d62a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:14.506394 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82733a-526c-450f-a06b-9ba1ba0d62a1 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:14.506676 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82733a-526c-450f-a06b-9ba1ba0d62a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:14.506946 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82733a-526c-450f-a06b-9ba1ba0d62a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:14.513605 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e82733a-526c-450f-a06b-9ba1ba0d62a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:14.515047 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e82733a-526c-450f-a06b-9ba1ba0d62a1 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:14.528912 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-1e82733a-526c-450f-a06b-9ba1ba0d62a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 07 06:07:14.530471 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 436/868] 10.222.0.24 () {56 vars in 1111 bytes} [Thu Apr 7 06:07:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:14.535727 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501d5ec-1f50-47bf-86cb-a71c86a1b7a7 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:14.639336 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501d5ec-1f50-47bf-86cb-a71c86a1b7a7 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:14.676316 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcba896-8091-4cb8-8d78-b0c996459aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:14.676984 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcba896-8091-4cb8-8d78-b0c996459aeb None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:14.677274 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcba896-8091-4cb8-8d78-b0c996459aeb None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:14.677552 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcba896-8091-4cb8-8d78-b0c996459aeb None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:14.678890 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcba896-8091-4cb8-8d78-b0c996459aeb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:14.679262 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcba896-8091-4cb8-8d78-b0c996459aeb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:14.680732 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcba896-8091-4cb8-8d78-b0c996459aeb None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:14.693562 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 433/869] 10.222.0.24 () {56 vars in 1148 bytes} [Thu Apr 7 06:07:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:14.699430 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e82733a-526c-450f-a06b-9ba1ba0d62a1 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:14.806050 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e82733a-526c-450f-a06b-9ba1ba0d62a1 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:14.839802 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d694e015-1edb-4022-a491-c126318d5b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:14.840467 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694e015-1edb-4022-a491-c126318d5b8f None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:14.840749 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694e015-1edb-4022-a491-c126318d5b8f None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:14.841023 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694e015-1edb-4022-a491-c126318d5b8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:14.841843 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d694e015-1edb-4022-a491-c126318d5b8f None admin] RBAC: Adding query filter params (role.id=64a6094c7a2942afb375bfb185843fd6, scope.project.id=de88f2c333ae49cfa7fff7fa1ed0022c, user.id=f4435fb14c3844728531af63993f78c0) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:14.842154 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d694e015-1edb-4022-a491-c126318d5b8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:14.843574 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d694e015-1edb-4022-a491-c126318d5b8f None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:14.850004 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 437/870] 10.222.0.24 () {56 vars in 1374 bytes} [Thu Apr 7 06:07:14 2022] GET /identity/v3/role_assignments?user.id=f4435fb14c3844728531af63993f78c0&scope.project.id=de88f2c333ae49cfa7fff7fa1ed0022c&role.id=64a6094c7a2942afb375bfb185843fd6 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:15.417268 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dadd88-8d2c-4ca9-93bb-bfc6750268e5 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:15.417784 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dadd88-8d2c-4ca9-93bb-bfc6750268e5 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:15.417887 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dadd88-8d2c-4ca9-93bb-bfc6750268e5 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:15.419477 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 434/871] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:07:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:07:15.425105 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56587c2-42dd-4fbd-9c7a-e4b8db5302f6 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:15.425532 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56587c2-42dd-4fbd-9c7a-e4b8db5302f6 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:15.425719 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56587c2-42dd-4fbd-9c7a-e4b8db5302f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:15.442844 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-c56587c2-42dd-4fbd-9c7a-e4b8db5302f6 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:07:15.444160 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c56587c2-42dd-4fbd-9c7a-e4b8db5302f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:07:15.510538 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 438/872] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:07:15 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 07 06:07:15.538014 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dadd88-8d2c-4ca9-93bb-bfc6750268e5 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:15.645567 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dadd88-8d2c-4ca9-93bb-bfc6750268e5 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:15.681793 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b39d94c-0d13-4a52-b08b-a996418b78fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:15.683086 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b39d94c-0d13-4a52-b08b-a996418b78fb None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:15.683584 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b39d94c-0d13-4a52-b08b-a996418b78fb None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:15.684140 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b39d94c-0d13-4a52-b08b-a996418b78fb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:15.685034 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b39d94c-0d13-4a52-b08b-a996418b78fb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:15.686673 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b39d94c-0d13-4a52-b08b-a996418b78fb None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:15.702659 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-3b39d94c-0d13-4a52-b08b-a996418b78fb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 07 06:07:15.704666 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 435/873] 10.222.0.24 () {56 vars in 1126 bytes} [Thu Apr 7 06:07:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:15.712407 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56587c2-42dd-4fbd-9c7a-e4b8db5302f6 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:15.820127 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56587c2-42dd-4fbd-9c7a-e4b8db5302f6 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:15.859972 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58598c-9865-4796-8d77-07c6a8e9c4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:15.860652 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58598c-9865-4796-8d77-07c6a8e9c4a5 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:15.860946 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58598c-9865-4796-8d77-07c6a8e9c4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:15.861224 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58598c-9865-4796-8d77-07c6a8e9c4a5 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:15.861999 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d58598c-9865-4796-8d77-07c6a8e9c4a5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:15.862314 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d58598c-9865-4796-8d77-07c6a8e9c4a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:15.863732 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d58598c-9865-4796-8d77-07c6a8e9c4a5 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:15.869420 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 439/874] 10.222.0.24 () {56 vars in 1122 bytes} [Thu Apr 7 06:07:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:15.875030 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b39d94c-0d13-4a52-b08b-a996418b78fb None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:15.959354 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48279de7-6406-48a7-9a18-2d34ad341c5e None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:15.959648 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48279de7-6406-48a7-9a18-2d34ad341c5e None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:15.959869 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48279de7-6406-48a7-9a18-2d34ad341c5e None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:15.962936 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 440/875] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:07:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:07:15.967107 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59904471-2a5e-42a6-a39d-d75215154866 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:15.967391 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59904471-2a5e-42a6-a39d-d75215154866 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:15.967668 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59904471-2a5e-42a6-a39d-d75215154866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:15.978144 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b39d94c-0d13-4a52-b08b-a996418b78fb None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:15.984477 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-59904471-2a5e-42a6-a39d-d75215154866 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:07:15.985630 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-59904471-2a5e-42a6-a39d-d75215154866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:07:16.020142 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc61e0ca-9bf8-4e50-92c6-ad82db1e83ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:16.020984 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc61e0ca-9bf8-4e50-92c6-ad82db1e83ce None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:16.022934 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc61e0ca-9bf8-4e50-92c6-ad82db1e83ce None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:16.023238 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc61e0ca-9bf8-4e50-92c6-ad82db1e83ce None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:16.023998 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc61e0ca-9bf8-4e50-92c6-ad82db1e83ce None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:16.024318 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc61e0ca-9bf8-4e50-92c6-ad82db1e83ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:16.025722 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc61e0ca-9bf8-4e50-92c6-ad82db1e83ce None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:16.032387 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 436/876] 10.222.0.24 () {56 vars in 1122 bytes} [Thu Apr 7 06:07:15 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:16.063896 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 441/877] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:07:15 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 07 06:07:16.065719 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1fd459-cbc8-4d37-a750-daad9e4abe38 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:16.066026 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1fd459-cbc8-4d37-a750-daad9e4abe38 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:16.066306 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1fd459-cbc8-4d37-a750-daad9e4abe38 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:16.067955 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 437/878] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:07:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:07:16.073663 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43903e1-68b3-41b6-977e-afbc26f473e3 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:16.074312 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43903e1-68b3-41b6-977e-afbc26f473e3 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:16.074806 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43903e1-68b3-41b6-977e-afbc26f473e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:16.086268 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1fd459-cbc8-4d37-a750-daad9e4abe38 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:16.093314 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-f43903e1-68b3-41b6-977e-afbc26f473e3 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:07:16.094563 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f43903e1-68b3-41b6-977e-afbc26f473e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:07:16.183994 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 442/879] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:07:16 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 07 06:07:16.208729 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43903e1-68b3-41b6-977e-afbc26f473e3 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:16.218445 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1fd459-cbc8-4d37-a750-daad9e4abe38 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:16.263603 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02051f88-62ae-461f-8812-8be419258620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:16.264654 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02051f88-62ae-461f-8812-8be419258620 None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:16.265134 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02051f88-62ae-461f-8812-8be419258620 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:16.265603 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02051f88-62ae-461f-8812-8be419258620 None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:16.266508 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02051f88-62ae-461f-8812-8be419258620 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:16.268086 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02051f88-62ae-461f-8812-8be419258620 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:16.316179 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43903e1-68b3-41b6-977e-afbc26f473e3 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:16.351843 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 438/880] 10.222.0.24 () {60 vars in 1141 bytes} [Thu Apr 7 06:07:16 2022] POST /identity/v3/services => generated 251 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:07:16.367333 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13825136-5e0b-4c48-bb34-846b30c8ccba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:16.368064 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13825136-5e0b-4c48-bb34-846b30c8ccba None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:16.368389 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13825136-5e0b-4c48-bb34-846b30c8ccba None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:16.368668 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13825136-5e0b-4c48-bb34-846b30c8ccba None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:16.369522 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13825136-5e0b-4c48-bb34-846b30c8ccba None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:16.371024 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13825136-5e0b-4c48-bb34-846b30c8ccba None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:16.451653 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 443/881] 10.222.0.24 () {60 vars in 1141 bytes} [Thu Apr 7 06:07:16 2022] POST /identity/v3/services => generated 269 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:07:17.297872 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53cb4e2-10fd-42b0-8b88-c701a153fc02 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:17.298390 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53cb4e2-10fd-42b0-8b88-c701a153fc02 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:17.298468 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53cb4e2-10fd-42b0-8b88-c701a153fc02 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:17.299965 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 439/882] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:07:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:07:17.305245 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e9250-07c1-401e-9adb-16194d773404 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:17.305541 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e9250-07c1-401e-9adb-16194d773404 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:17.305825 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e9250-07c1-401e-9adb-16194d773404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:17.322923 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-dd9e9250-07c1-401e-9adb-16194d773404 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:07:17.324145 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-dd9e9250-07c1-401e-9adb-16194d773404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:07:17.397043 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 444/883] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:07:17 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 07 06:07:17.422058 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53cb4e2-10fd-42b0-8b88-c701a153fc02 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:17.528284 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53cb4e2-10fd-42b0-8b88-c701a153fc02 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:17.565229 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b472020-fd0d-468c-b219-9b807e073bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:17.566249 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b472020-fd0d-468c-b219-9b807e073bea None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:17.566602 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b472020-fd0d-468c-b219-9b807e073bea None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:17.566883 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b472020-fd0d-468c-b219-9b807e073bea None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:17.578586 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b472020-fd0d-468c-b219-9b807e073bea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:07:17.586970 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-8b472020-fd0d-468c-b219-9b807e073bea None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 07 06:07:17.588559 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 440/884] 10.222.0.24 () {56 vars in 1120 bytes} [Thu Apr 7 06:07:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:17.596861 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9e9250-07c1-401e-9adb-16194d773404 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:17.698909 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9e9250-07c1-401e-9adb-16194d773404 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:17.733532 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7167d49-5f66-41e7-b5a5-86c1b0c7fde3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:17.734535 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7167d49-5f66-41e7-b5a5-86c1b0c7fde3 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:17.735039 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7167d49-5f66-41e7-b5a5-86c1b0c7fde3 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:17.735529 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7167d49-5f66-41e7-b5a5-86c1b0c7fde3 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:17.736501 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7167d49-5f66-41e7-b5a5-86c1b0c7fde3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:17.736969 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7167d49-5f66-41e7-b5a5-86c1b0c7fde3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:17.738476 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7167d49-5f66-41e7-b5a5-86c1b0c7fde3 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:17.747271 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 445/885] 10.222.0.24 () {56 vars in 1115 bytes} [Thu Apr 7 06:07:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:17.756804 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b472020-fd0d-468c-b219-9b807e073bea None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:17.877894 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b472020-fd0d-468c-b219-9b807e073bea None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:17.911796 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c8a3ef-887e-4a2b-a9f0-a4515b936ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:17.913127 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8a3ef-887e-4a2b-a9f0-a4515b936ce3 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:17.913416 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8a3ef-887e-4a2b-a9f0-a4515b936ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:17.913693 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8a3ef-887e-4a2b-a9f0-a4515b936ce3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:17.924300 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c8a3ef-887e-4a2b-a9f0-a4515b936ce3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:17.925745 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c8a3ef-887e-4a2b-a9f0-a4515b936ce3 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:17.942058 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-14c8a3ef-887e-4a2b-a9f0-a4515b936ce3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:07:17.944118 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 441/886] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:07:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:17.949821 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7167d49-5f66-41e7-b5a5-86c1b0c7fde3 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:18.054077 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7167d49-5f66-41e7-b5a5-86c1b0c7fde3 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:18.088771 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aeb9db-9ac5-4931-be1c-6f424568e21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:18.089817 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aeb9db-9ac5-4931-be1c-6f424568e21c None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:18.090337 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aeb9db-9ac5-4931-be1c-6f424568e21c None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:18.090812 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aeb9db-9ac5-4931-be1c-6f424568e21c None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:18.091734 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aeb9db-9ac5-4931-be1c-6f424568e21c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:18.092311 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aeb9db-9ac5-4931-be1c-6f424568e21c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:18.093940 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aeb9db-9ac5-4931-be1c-6f424568e21c None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:18.106712 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 446/887] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:07:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:18.112574 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c8a3ef-887e-4a2b-a9f0-a4515b936ce3 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:18.215608 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c8a3ef-887e-4a2b-a9f0-a4515b936ce3 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:18.250343 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb32d7-832d-4bd3-a39e-70e77dab4850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:18.251176 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb32d7-832d-4bd3-a39e-70e77dab4850 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:18.251463 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb32d7-832d-4bd3-a39e-70e77dab4850 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:18.251760 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb32d7-832d-4bd3-a39e-70e77dab4850 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:18.259685 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eb32d7-832d-4bd3-a39e-70e77dab4850 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:18.261179 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eb32d7-832d-4bd3-a39e-70e77dab4850 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:18.275790 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-f3eb32d7-832d-4bd3-a39e-70e77dab4850 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 07 06:07:18.277322 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 442/888] 10.222.0.24 () {56 vars in 1117 bytes} [Thu Apr 7 06:07:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:18.282940 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aeb9db-9ac5-4931-be1c-6f424568e21c None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:18.388359 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aeb9db-9ac5-4931-be1c-6f424568e21c None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:18.401604 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df05ec-6c18-42b0-98c2-f356ab20bb37 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:18.402107 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df05ec-6c18-42b0-98c2-f356ab20bb37 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:18.402185 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df05ec-6c18-42b0-98c2-f356ab20bb37 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:18.403801 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 443/889] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:07:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:07:18.408824 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7fb71c-b211-40d9-94e7-1a1f164febab None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:18.409119 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7fb71c-b211-40d9-94e7-1a1f164febab None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:18.409405 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7fb71c-b211-40d9-94e7-1a1f164febab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:18.424722 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a3ae72-4fde-42b4-9ee0-ad24dcfcbf85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:18.425764 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a3ae72-4fde-42b4-9ee0-ad24dcfcbf85 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:18.426300 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a3ae72-4fde-42b4-9ee0-ad24dcfcbf85 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:18.426773 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a3ae72-4fde-42b4-9ee0-ad24dcfcbf85 None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:18.428454 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a3ae72-4fde-42b4-9ee0-ad24dcfcbf85 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:18.428634 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-9a7fb71c-b211-40d9-94e7-1a1f164febab None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:07:18.429149 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a3ae72-4fde-42b4-9ee0-ad24dcfcbf85 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:18.429825 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-9a7fb71c-b211-40d9-94e7-1a1f164febab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:07:18.430983 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a3ae72-4fde-42b4-9ee0-ad24dcfcbf85 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:18.448938 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 447/890] 10.222.0.24 () {56 vars in 1149 bytes} [Thu Apr 7 06:07:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:18.454704 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a3ae72-4fde-42b4-9ee0-ad24dcfcbf85 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:18.511929 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 444/891] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:07:18 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 07 06:07:18.535634 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7fb71c-b211-40d9-94e7-1a1f164febab None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:18.580683 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a3ae72-4fde-42b4-9ee0-ad24dcfcbf85 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:18.622034 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24baca18-a7a3-425b-8ebb-dcb6fa71a6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:18.623892 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24baca18-a7a3-425b-8ebb-dcb6fa71a6a3 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:18.624369 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24baca18-a7a3-425b-8ebb-dcb6fa71a6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:18.624826 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24baca18-a7a3-425b-8ebb-dcb6fa71a6a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:18.651053 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7fb71c-b211-40d9-94e7-1a1f164febab None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:18.694704 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b0b35-d56d-4b75-a952-1ad14342ef39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:18.696227 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b0b35-d56d-4b75-a952-1ad14342ef39 None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:18.696711 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b0b35-d56d-4b75-a952-1ad14342ef39 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:18.697131 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b0b35-d56d-4b75-a952-1ad14342ef39 None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:18.698533 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2b0b35-d56d-4b75-a952-1ad14342ef39 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:18.700553 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2b0b35-d56d-4b75-a952-1ad14342ef39 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:18.708309 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24baca18-a7a3-425b-8ebb-dcb6fa71a6a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:18.709994 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24baca18-a7a3-425b-8ebb-dcb6fa71a6a3 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:18.779481 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 445/892] 10.222.0.24 () {60 vars in 1141 bytes} [Thu Apr 7 06:07:18 2022] POST /identity/v3/services => generated 241 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:07:18.780873 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84643ef-553f-4e92-9024-1d800235eda6 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:18.781166 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84643ef-553f-4e92-9024-1d800235eda6 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:18.781444 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84643ef-553f-4e92-9024-1d800235eda6 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:18.787069 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 446/893] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:07:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:07:18.794763 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ac3a5-5470-4dba-aa4c-de0ddad25fcb None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:18.794763 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ac3a5-5470-4dba-aa4c-de0ddad25fcb None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:18.794763 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ac3a5-5470-4dba-aa4c-de0ddad25fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:18.809046 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-7c4ac3a5-5470-4dba-aa4c-de0ddad25fcb None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:07:18.810659 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-7c4ac3a5-5470-4dba-aa4c-de0ddad25fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:07:18.815857 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 448/894] 10.222.0.24 () {58 vars in 1282 bytes} [Thu Apr 7 06:07:18 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 07 06:07:18.821388 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24baca18-a7a3-425b-8ebb-dcb6fa71a6a3 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:18.892148 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 447/895] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:07:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 07 06:07:18.893560 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb5c19-b5b0-4b71-b8fb-48f18217c4a7 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:18.893851 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb5c19-b5b0-4b71-b8fb-48f18217c4a7 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:18.894130 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb5c19-b5b0-4b71-b8fb-48f18217c4a7 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:18.895633 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 448/896] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:07:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:07:18.901218 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56360667-60a8-4f4c-914a-20d162048f65 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:18.901524 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56360667-60a8-4f4c-914a-20d162048f65 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:18.901878 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56360667-60a8-4f4c-914a-20d162048f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:18.920757 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-56360667-60a8-4f4c-914a-20d162048f65 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:07:18.921959 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-56360667-60a8-4f4c-914a-20d162048f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:07:18.950468 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24baca18-a7a3-425b-8ebb-dcb6fa71a6a3 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:18.988122 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb4ad8-2020-4c25-afd4-4ec00a618318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:18.988122 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb4ad8-2020-4c25-afd4-4ec00a618318 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:18.988122 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb4ad8-2020-4c25-afd4-4ec00a618318 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:18.988440 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb4ad8-2020-4c25-afd4-4ec00a618318 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:18.996693 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 449/897] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:07:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 07 06:07:18.997546 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56360667-60a8-4f4c-914a-20d162048f65 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:19.002089 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fb4ad8-2020-4c25-afd4-4ec00a618318 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:19.003649 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fb4ad8-2020-4c25-afd4-4ec00a618318 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:19.020943 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-f4fb4ad8-2020-4c25-afd4-4ec00a618318 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:07:19.022555 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 449/898] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:07:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:19.023661 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb4ad8-2020-4c25-afd4-4ec00a618318 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:19.106713 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56360667-60a8-4f4c-914a-20d162048f65 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:19.122084 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb4ad8-2020-4c25-afd4-4ec00a618318 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:19.140761 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7dafd5-3fb9-464a-9c0c-2fa0ebdf5c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:19.141578 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7dafd5-3fb9-464a-9c0c-2fa0ebdf5c9f None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:19.141862 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7dafd5-3fb9-464a-9c0c-2fa0ebdf5c9f None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:19.142138 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7dafd5-3fb9-464a-9c0c-2fa0ebdf5c9f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:19.142797 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7dafd5-3fb9-464a-9c0c-2fa0ebdf5c9f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:19.144210 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7dafd5-3fb9-464a-9c0c-2fa0ebdf5c9f None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:19.154818 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd9bd01-13c1-4134-aa81-25036bae6ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:19.155621 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9bd01-13c1-4134-aa81-25036bae6ee9 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:19.155720 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-bf7dafd5-3fb9-464a-9c0c-2fa0ebdf5c9f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 07 06:07:19.155969 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9bd01-13c1-4134-aa81-25036bae6ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:19.156209 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9bd01-13c1-4134-aa81-25036bae6ee9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:19.156857 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd9bd01-13c1-4134-aa81-25036bae6ee9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:19.162057 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 450/899] 10.222.0.24 () {56 vars in 1114 bytes} [Thu Apr 7 06:07:18 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:19.162057 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7dafd5-3fb9-464a-9c0c-2fa0ebdf5c9f None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:19.162294 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd9bd01-13c1-4134-aa81-25036bae6ee9 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:19.173482 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-3dd9bd01-13c1-4134-aa81-25036bae6ee9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 07 06:07:19.174963 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 450/900] 10.222.0.24 () {56 vars in 1132 bytes} [Thu Apr 7 06:07:19 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:19.175726 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd9bd01-13c1-4134-aa81-25036bae6ee9 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:19.267765 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7dafd5-3fb9-464a-9c0c-2fa0ebdf5c9f None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:19.273323 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd9bd01-13c1-4134-aa81-25036bae6ee9 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:19.301376 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564be918-26a2-44f5-b932-26cca4b11b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:19.302035 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564be918-26a2-44f5-b932-26cca4b11b8d None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:19.302329 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564be918-26a2-44f5-b932-26cca4b11b8d None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:19.303217 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564be918-26a2-44f5-b932-26cca4b11b8d None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:19.303977 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564be918-26a2-44f5-b932-26cca4b11b8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:19.304283 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564be918-26a2-44f5-b932-26cca4b11b8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:19.305637 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564be918-26a2-44f5-b932-26cca4b11b8d None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:19.310304 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f6c68-ffc0-4120-96d9-9226821a4cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:19.311169 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f6c68-ffc0-4120-96d9-9226821a4cb4 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:19.311637 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f6c68-ffc0-4120-96d9-9226821a4cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:19.312126 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f6c68-ffc0-4120-96d9-9226821a4cb4 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:19.312832 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8f6c68-ffc0-4120-96d9-9226821a4cb4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:19.313151 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8f6c68-ffc0-4120-96d9-9226821a4cb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:19.314507 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8f6c68-ffc0-4120-96d9-9226821a4cb4 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:19.321363 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 451/901] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:07:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:19.321363 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564be918-26a2-44f5-b932-26cca4b11b8d None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:19.328078 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 451/902] 10.222.0.24 () {56 vars in 1114 bytes} [Thu Apr 7 06:07:19 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:19.328078 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f6c68-ffc0-4120-96d9-9226821a4cb4 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:19.418156 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564be918-26a2-44f5-b932-26cca4b11b8d None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:19.427536 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f6c68-ffc0-4120-96d9-9226821a4cb4 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:19.451506 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d808f88-d02b-4f57-82e0-3ad1775cf63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:19.452194 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d808f88-d02b-4f57-82e0-3ad1775cf63b None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:19.452475 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d808f88-d02b-4f57-82e0-3ad1775cf63b None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:19.452748 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d808f88-d02b-4f57-82e0-3ad1775cf63b None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:19.453443 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d808f88-d02b-4f57-82e0-3ad1775cf63b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:19.453746 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d808f88-d02b-4f57-82e0-3ad1775cf63b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:19.455109 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d808f88-d02b-4f57-82e0-3ad1775cf63b None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:19.464912 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a4f210-270f-429d-8cb5-0a97913bbb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:19.465071 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 452/903] 10.222.0.24 () {56 vars in 1126 bytes} [Thu Apr 7 06:07:19 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:19.465163 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4f210-270f-429d-8cb5-0a97913bbb13 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:19.465249 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d808f88-d02b-4f57-82e0-3ad1775cf63b None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:19.465333 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4f210-270f-429d-8cb5-0a97913bbb13 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:19.465333 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4f210-270f-429d-8cb5-0a97913bbb13 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:19.471932 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a4f210-270f-429d-8cb5-0a97913bbb13 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:19.473387 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a4f210-270f-429d-8cb5-0a97913bbb13 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:19.486511 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-25a4f210-270f-429d-8cb5-0a97913bbb13 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 07 06:07:19.487707 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 452/904] 10.222.0.24 () {56 vars in 1111 bytes} [Thu Apr 7 06:07:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:19.488493 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a4f210-270f-429d-8cb5-0a97913bbb13 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:19.566898 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d808f88-d02b-4f57-82e0-3ad1775cf63b None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:19.583333 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a4f210-270f-429d-8cb5-0a97913bbb13 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:19.600312 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b9b17-f7db-4d7f-9b78-bdfadf5a5651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:19.600983 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b9b17-f7db-4d7f-9b78-bdfadf5a5651 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:19.601269 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b9b17-f7db-4d7f-9b78-bdfadf5a5651 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:19.601547 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b9b17-f7db-4d7f-9b78-bdfadf5a5651 None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:19.602255 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b9b17-f7db-4d7f-9b78-bdfadf5a5651 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:19.602564 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b9b17-f7db-4d7f-9b78-bdfadf5a5651 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:19.603953 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b9b17-f7db-4d7f-9b78-bdfadf5a5651 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:19.608895 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 453/905] 10.222.0.24 () {56 vars in 1114 bytes} [Thu Apr 7 06:07:19 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:19.609698 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b9b17-f7db-4d7f-9b78-bdfadf5a5651 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:19.621696 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a101b70b-046f-44a3-9b8b-f0f654d40411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:19.622659 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101b70b-046f-44a3-9b8b-f0f654d40411 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:19.623236 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101b70b-046f-44a3-9b8b-f0f654d40411 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:19.623236 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101b70b-046f-44a3-9b8b-f0f654d40411 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:19.623928 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a101b70b-046f-44a3-9b8b-f0f654d40411 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:19.624240 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a101b70b-046f-44a3-9b8b-f0f654d40411 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:19.625584 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a101b70b-046f-44a3-9b8b-f0f654d40411 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:19.630904 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 453/906] 10.222.0.24 () {56 vars in 1126 bytes} [Thu Apr 7 06:07:19 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:19.631191 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a101b70b-046f-44a3-9b8b-f0f654d40411 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:19.710365 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b9b17-f7db-4d7f-9b78-bdfadf5a5651 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:19.726676 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a101b70b-046f-44a3-9b8b-f0f654d40411 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:19.744697 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c2c06-5013-4160-864c-8fa1c61b0c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:19.745360 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c2c06-5013-4160-864c-8fa1c61b0c76 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:19.745645 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c2c06-5013-4160-864c-8fa1c61b0c76 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:19.745923 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c2c06-5013-4160-864c-8fa1c61b0c76 None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:19.746711 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0c2c06-5013-4160-864c-8fa1c61b0c76 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:19.747020 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0c2c06-5013-4160-864c-8fa1c61b0c76 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:19.748480 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0c2c06-5013-4160-864c-8fa1c61b0c76 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:19.760492 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67465f75-c175-4d2b-8396-87e5a5e72697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:19.761138 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67465f75-c175-4d2b-8396-87e5a5e72697 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:19.761428 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67465f75-c175-4d2b-8396-87e5a5e72697 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:19.761707 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67465f75-c175-4d2b-8396-87e5a5e72697 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:19.762500 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67465f75-c175-4d2b-8396-87e5a5e72697 None admin] RBAC: Adding query filter params (interface=public, service_id=b97b85eea84b4cd08e20587847abd7d9, region_id=RegionOne) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:19.762817 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67465f75-c175-4d2b-8396-87e5a5e72697 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:19.764245 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67465f75-c175-4d2b-8396-87e5a5e72697 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:19.765599 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 454/907] 10.222.0.24 () {56 vars in 1148 bytes} [Thu Apr 7 06:07:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:19.766607 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c2c06-5013-4160-864c-8fa1c61b0c76 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:19.780925 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 454/908] 10.222.0.24 () {56 vars in 1251 bytes} [Thu Apr 7 06:07:19 2022] GET /identity/v3/endpoints?service_id=b97b85eea84b4cd08e20587847abd7d9&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:19.780925 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67465f75-c175-4d2b-8396-87e5a5e72697 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:19.872264 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c2c06-5013-4160-864c-8fa1c61b0c76 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:19.875537 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67465f75-c175-4d2b-8396-87e5a5e72697 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:19.906456 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa2749b-9fb7-4134-b6e6-7d1e35543622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:19.907384 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2749b-9fb7-4134-b6e6-7d1e35543622 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:19.907668 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2749b-9fb7-4134-b6e6-7d1e35543622 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:19.907982 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2749b-9fb7-4134-b6e6-7d1e35543622 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:19.908769 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa2749b-9fb7-4134-b6e6-7d1e35543622 None admin] RBAC: Adding query filter params (interface=public, service_id=8081617783d145989d44f3f897d733ab, region_id=RegionOne) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:19.909081 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa2749b-9fb7-4134-b6e6-7d1e35543622 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:19.910449 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa2749b-9fb7-4134-b6e6-7d1e35543622 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:19.919794 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc494c-df1f-446d-8979-29fc826df238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:19.919960 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 455/909] 10.222.0.24 () {56 vars in 1251 bytes} [Thu Apr 7 06:07:19 2022] GET /identity/v3/endpoints?service_id=8081617783d145989d44f3f897d733ab&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:19.920053 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc494c-df1f-446d-8979-29fc826df238 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:19.920163 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa2749b-9fb7-4134-b6e6-7d1e35543622 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:19.920249 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc494c-df1f-446d-8979-29fc826df238 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:19.920249 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc494c-df1f-446d-8979-29fc826df238 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:19.920249 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc494c-df1f-446d-8979-29fc826df238 None admin] RBAC: Adding query filter params (role.id=db6da2a870e5446690e2385bf7da6f59, scope.project.id=de88f2c333ae49cfa7fff7fa1ed0022c, user.id=f4435fb14c3844728531af63993f78c0) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:19.920249 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc494c-df1f-446d-8979-29fc826df238 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:19.920249 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc494c-df1f-446d-8979-29fc826df238 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:19.925236 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 455/910] 10.222.0.24 () {56 vars in 1374 bytes} [Thu Apr 7 06:07:19 2022] GET /identity/v3/role_assignments?user.id=f4435fb14c3844728531af63993f78c0&scope.project.id=de88f2c333ae49cfa7fff7fa1ed0022c&role.id=db6da2a870e5446690e2385bf7da6f59 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:19.926017 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc494c-df1f-446d-8979-29fc826df238 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:20.029691 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa2749b-9fb7-4134-b6e6-7d1e35543622 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:20.063513 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc494c-df1f-446d-8979-29fc826df238 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:20.065476 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e921e2-0221-4d1b-a12c-7a447c1d5a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:20.066414 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e921e2-0221-4d1b-a12c-7a447c1d5a1b None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:20.066768 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e921e2-0221-4d1b-a12c-7a447c1d5a1b None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:20.067121 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e921e2-0221-4d1b-a12c-7a447c1d5a1b None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:20.067964 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e921e2-0221-4d1b-a12c-7a447c1d5a1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:20.069539 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e921e2-0221-4d1b-a12c-7a447c1d5a1b None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:20.076330 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 456/911] 10.222.0.24 () {56 vars in 1087 bytes} [Thu Apr 7 06:07:19 2022] GET /identity/v3/services => generated 1497 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:07:20.108985 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f95916b-284b-4814-aed5-9a2b29b5e61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:20.110084 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95916b-284b-4814-aed5-9a2b29b5e61c None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:20.110558 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95916b-284b-4814-aed5-9a2b29b5e61c None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:20.111040 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95916b-284b-4814-aed5-9a2b29b5e61c None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:20.111992 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f95916b-284b-4814-aed5-9a2b29b5e61c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:20.113715 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f95916b-284b-4814-aed5-9a2b29b5e61c None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:20.121696 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 456/912] 10.222.0.24 () {56 vars in 1087 bytes} [Thu Apr 7 06:07:19 2022] GET /identity/v3/services => generated 1497 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:07:21.150824 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb9acc-67b9-40eb-8399-549350da26c1 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:21.151342 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb9acc-67b9-40eb-8399-549350da26c1 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:21.151417 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb9acc-67b9-40eb-8399-549350da26c1 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:21.153009 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 457/913] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:07:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:07:21.158541 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4071b-f81a-49a8-bd08-b439eb3ffd54 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:21.158937 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4071b-f81a-49a8-bd08-b439eb3ffd54 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:21.159116 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4071b-f81a-49a8-bd08-b439eb3ffd54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:21.176170 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-05a4071b-f81a-49a8-bd08-b439eb3ffd54 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:07:21.177366 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-05a4071b-f81a-49a8-bd08-b439eb3ffd54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:07:21.248428 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 457/914] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:07:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 07 06:07:21.272849 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb9acc-67b9-40eb-8399-549350da26c1 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:21.374990 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb9acc-67b9-40eb-8399-549350da26c1 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:21.407952 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9635ad-d13b-43c1-b267-21fc1c437115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:21.408695 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9635ad-d13b-43c1-b267-21fc1c437115 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:21.408982 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9635ad-d13b-43c1-b267-21fc1c437115 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:21.409258 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9635ad-d13b-43c1-b267-21fc1c437115 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:21.409908 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9635ad-d13b-43c1-b267-21fc1c437115 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:21.411284 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9635ad-d13b-43c1-b267-21fc1c437115 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:21.422995 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-7a9635ad-d13b-43c1-b267-21fc1c437115 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 07 06:07:21.424467 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 458/915] 10.222.0.24 () {56 vars in 1126 bytes} [Thu Apr 7 06:07:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:21.430362 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4071b-f81a-49a8-bd08-b439eb3ffd54 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:21.527452 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4071b-f81a-49a8-bd08-b439eb3ffd54 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:21.561539 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a3257-4ca9-4036-954a-36794682a46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:21.562220 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a3257-4ca9-4036-954a-36794682a46c None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:21.562505 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a3257-4ca9-4036-954a-36794682a46c None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:21.562784 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a3257-4ca9-4036-954a-36794682a46c None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:21.563494 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6a3257-4ca9-4036-954a-36794682a46c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:21.563827 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6a3257-4ca9-4036-954a-36794682a46c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:21.565186 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6a3257-4ca9-4036-954a-36794682a46c None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:21.570984 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 458/916] 10.222.0.24 () {56 vars in 1122 bytes} [Thu Apr 7 06:07:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:21.576608 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9635ad-d13b-43c1-b267-21fc1c437115 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:21.682740 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9635ad-d13b-43c1-b267-21fc1c437115 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:21.716129 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed3be53-e607-4bad-a35a-bf6427dba20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:21.716803 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed3be53-e607-4bad-a35a-bf6427dba20a None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:21.717087 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed3be53-e607-4bad-a35a-bf6427dba20a None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:21.717365 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed3be53-e607-4bad-a35a-bf6427dba20a None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:21.718076 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed3be53-e607-4bad-a35a-bf6427dba20a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:21.718389 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed3be53-e607-4bad-a35a-bf6427dba20a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:21.719794 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed3be53-e607-4bad-a35a-bf6427dba20a None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:21.725642 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 459/917] 10.222.0.24 () {56 vars in 1122 bytes} [Thu Apr 7 06:07:21 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:21.731231 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a3257-4ca9-4036-954a-36794682a46c None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:21.834220 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a3257-4ca9-4036-954a-36794682a46c None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:21.869645 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358035b5-bd0d-4242-a32b-95a183a2c67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:21.870312 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358035b5-bd0d-4242-a32b-95a183a2c67a None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:21.870602 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358035b5-bd0d-4242-a32b-95a183a2c67a None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:21.870883 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358035b5-bd0d-4242-a32b-95a183a2c67a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:21.871736 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358035b5-bd0d-4242-a32b-95a183a2c67a None admin] RBAC: Adding query filter params (interface=public, service_id=17b223a9f46c4cc89c10869f32da04b5, region_id=RegionOne) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:21.872140 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358035b5-bd0d-4242-a32b-95a183a2c67a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:21.873555 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358035b5-bd0d-4242-a32b-95a183a2c67a None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:21.879096 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 459/918] 10.222.0.24 () {56 vars in 1251 bytes} [Thu Apr 7 06:07:21 2022] GET /identity/v3/endpoints?service_id=17b223a9f46c4cc89c10869f32da04b5&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:21.884731 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed3be53-e607-4bad-a35a-bf6427dba20a None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:21.997785 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed3be53-e607-4bad-a35a-bf6427dba20a None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:22.031735 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa4e3b1-5667-4df3-bf20-f4344417643a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:22.032459 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4e3b1-5667-4df3-bf20-f4344417643a None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:22.032750 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4e3b1-5667-4df3-bf20-f4344417643a None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:22.033028 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4e3b1-5667-4df3-bf20-f4344417643a None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:22.033738 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa4e3b1-5667-4df3-bf20-f4344417643a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:22.035171 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa4e3b1-5667-4df3-bf20-f4344417643a None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:22.042540 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 460/919] 10.222.0.24 () {56 vars in 1087 bytes} [Thu Apr 7 06:07:21 2022] GET /identity/v3/services => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:07:22.345329 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57102c3c-b1da-4f4b-81f1-4e9d9f3fca00 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:22.346342 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57102c3c-b1da-4f4b-81f1-4e9d9f3fca00 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:22.346842 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57102c3c-b1da-4f4b-81f1-4e9d9f3fca00 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:22.348715 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 460/920] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:07:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:07:22.355483 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49e788-3ab6-48e6-a009-c98c409d3b80 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:22.356426 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49e788-3ab6-48e6-a009-c98c409d3b80 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:22.356921 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49e788-3ab6-48e6-a009-c98c409d3b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:22.377205 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-9e49e788-3ab6-48e6-a009-c98c409d3b80 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:07:22.378717 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-9e49e788-3ab6-48e6-a009-c98c409d3b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:07:22.419045 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed2180-18a9-4d5e-b1ba-9c0c98401e64 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:22.419391 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed2180-18a9-4d5e-b1ba-9c0c98401e64 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:22.419609 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed2180-18a9-4d5e-b1ba-9c0c98401e64 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:22.421228 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 461/921] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:07:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:07:22.426253 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30a945-f053-401b-85a1-a1416ebb318e None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:22.426544 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30a945-f053-401b-85a1-a1416ebb318e None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:22.426827 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30a945-f053-401b-85a1-a1416ebb318e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:22.447981 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-fe30a945-f053-401b-85a1-a1416ebb318e None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:07:22.455767 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-fe30a945-f053-401b-85a1-a1416ebb318e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:07:22.456079 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 461/922] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:07:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 07 06:07:22.472413 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e49e788-3ab6-48e6-a009-c98c409d3b80 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:22.517031 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 462/923] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:07:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 07 06:07:22.518357 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b180a895-e67b-4b6a-8d00-2c138198d357 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:22.518645 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b180a895-e67b-4b6a-8d00-2c138198d357 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:22.518916 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b180a895-e67b-4b6a-8d00-2c138198d357 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:22.523797 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 463/924] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:07:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:07:22.525269 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ccad58-7d06-4cf5-b136-85f6efe6514c None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:22.525799 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ccad58-7d06-4cf5-b136-85f6efe6514c None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:22.526260 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ccad58-7d06-4cf5-b136-85f6efe6514c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:22.542585 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-c6ccad58-7d06-4cf5-b136-85f6efe6514c None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:07:22.543819 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c6ccad58-7d06-4cf5-b136-85f6efe6514c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:07:22.578080 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e49e788-3ab6-48e6-a009-c98c409d3b80 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:22.607867 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 464/925] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:07:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 07 06:07:22.611277 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7e4018-8bf1-4ef8-99db-ec9d65e7fb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:22.612127 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e4018-8bf1-4ef8-99db-ec9d65e7fb96 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:22.612412 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e4018-8bf1-4ef8-99db-ec9d65e7fb96 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:22.612686 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e4018-8bf1-4ef8-99db-ec9d65e7fb96 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:22.613013 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ccad58-7d06-4cf5-b136-85f6efe6514c None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:22.623117 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7e4018-8bf1-4ef8-99db-ec9d65e7fb96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:07:22.631159 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-9a7e4018-8bf1-4ef8-99db-ec9d65e7fb96 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 07 06:07:22.632680 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 462/926] 10.222.0.24 () {56 vars in 1120 bytes} [Thu Apr 7 06:07:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 07 06:07:22.633455 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7e4018-8bf1-4ef8-99db-ec9d65e7fb96 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:22.721156 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ccad58-7d06-4cf5-b136-85f6efe6514c None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:22.737089 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7e4018-8bf1-4ef8-99db-ec9d65e7fb96 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:22.755515 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e081f-df30-4d19-b17d-267a1a509ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:22.756423 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e081f-df30-4d19-b17d-267a1a509ced None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:22.756720 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e081f-df30-4d19-b17d-267a1a509ced None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:22.757002 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e081f-df30-4d19-b17d-267a1a509ced None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:22.757669 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494e081f-df30-4d19-b17d-267a1a509ced None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:22.762436 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494e081f-df30-4d19-b17d-267a1a509ced None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:22.780749 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75662e54-3f03-4d07-9b99-db91e1e1df0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:22.781988 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75662e54-3f03-4d07-9b99-db91e1e1df0b None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:22.782485 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75662e54-3f03-4d07-9b99-db91e1e1df0b None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:22.782776 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75662e54-3f03-4d07-9b99-db91e1e1df0b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:22.783449 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75662e54-3f03-4d07-9b99-db91e1e1df0b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:22.784108 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-494e081f-df30-4d19-b17d-267a1a509ced None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 07 06:07:22.784900 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75662e54-3f03-4d07-9b99-db91e1e1df0b None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:22.791398 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 465/927] 10.222.0.24 () {56 vars in 1114 bytes} [Thu Apr 7 06:07:22 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:22.791398 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e081f-df30-4d19-b17d-267a1a509ced None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:22.801968 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-75662e54-3f03-4d07-9b99-db91e1e1df0b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 07 06:07:22.803435 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 463/928] 10.222.0.24 () {56 vars in 1132 bytes} [Thu Apr 7 06:07:22 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:22.805737 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75662e54-3f03-4d07-9b99-db91e1e1df0b None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:22.891901 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e081f-df30-4d19-b17d-267a1a509ced None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:22.906456 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75662e54-3f03-4d07-9b99-db91e1e1df0b None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:22.928930 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea607d-1faf-40d2-8c31-b2628198ec61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:22.929884 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea607d-1faf-40d2-8c31-b2628198ec61 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:22.930176 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea607d-1faf-40d2-8c31-b2628198ec61 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:22.930453 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea607d-1faf-40d2-8c31-b2628198ec61 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:22.931673 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ea607d-1faf-40d2-8c31-b2628198ec61 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:22.932020 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ea607d-1faf-40d2-8c31-b2628198ec61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:22.933822 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ea607d-1faf-40d2-8c31-b2628198ec61 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:22.941468 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb732536-aebe-4f7d-a4c6-1d280b4aa569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:22.942131 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb732536-aebe-4f7d-a4c6-1d280b4aa569 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:22.942418 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb732536-aebe-4f7d-a4c6-1d280b4aa569 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:22.942691 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb732536-aebe-4f7d-a4c6-1d280b4aa569 None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:22.948936 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 466/929] 10.222.0.24 () {56 vars in 1115 bytes} [Thu Apr 7 06:07:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:22.949100 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb732536-aebe-4f7d-a4c6-1d280b4aa569 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:22.949100 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb732536-aebe-4f7d-a4c6-1d280b4aa569 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:22.949237 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea607d-1faf-40d2-8c31-b2628198ec61 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:22.949315 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb732536-aebe-4f7d-a4c6-1d280b4aa569 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:22.950185 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 464/930] 10.222.0.24 () {56 vars in 1114 bytes} [Thu Apr 7 06:07:22 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:22.951378 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb732536-aebe-4f7d-a4c6-1d280b4aa569 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:23.048089 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea607d-1faf-40d2-8c31-b2628198ec61 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:23.051323 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb732536-aebe-4f7d-a4c6-1d280b4aa569 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:23.081180 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7609f647-8a84-4482-beb9-1a9d9ad26e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:23.082221 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609f647-8a84-4482-beb9-1a9d9ad26e30 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:23.082714 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609f647-8a84-4482-beb9-1a9d9ad26e30 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:23.083192 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc08507-0b8f-430a-b220-afb65a2b14ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:23.083309 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609f647-8a84-4482-beb9-1a9d9ad26e30 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:23.084629 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc08507-0b8f-430a-b220-afb65a2b14ef None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:23.084925 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc08507-0b8f-430a-b220-afb65a2b14ef None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:23.085204 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc08507-0b8f-430a-b220-afb65a2b14ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:23.086303 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7609f647-8a84-4482-beb9-1a9d9ad26e30 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:23.086303 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7609f647-8a84-4482-beb9-1a9d9ad26e30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:23.087664 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7609f647-8a84-4482-beb9-1a9d9ad26e30 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:23.098678 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 467/931] 10.222.0.24 () {56 vars in 1126 bytes} [Thu Apr 7 06:07:22 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:23.098678 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7609f647-8a84-4482-beb9-1a9d9ad26e30 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:23.103383 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc08507-0b8f-430a-b220-afb65a2b14ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:23.104902 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc08507-0b8f-430a-b220-afb65a2b14ef None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:23.121446 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-ddc08507-0b8f-430a-b220-afb65a2b14ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:07:23.127459 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 465/932] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:07:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:23.127459 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc08507-0b8f-430a-b220-afb65a2b14ef None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:23.197261 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7609f647-8a84-4482-beb9-1a9d9ad26e30 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:23.220755 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc08507-0b8f-430a-b220-afb65a2b14ef None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:23.231898 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672fafe5-7fd2-4e14-8ded-0f43033cded5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:23.232570 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672fafe5-7fd2-4e14-8ded-0f43033cded5 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:23.232853 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672fafe5-7fd2-4e14-8ded-0f43033cded5 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:23.233123 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672fafe5-7fd2-4e14-8ded-0f43033cded5 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:23.233831 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672fafe5-7fd2-4e14-8ded-0f43033cded5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:23.234132 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672fafe5-7fd2-4e14-8ded-0f43033cded5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:23.235488 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672fafe5-7fd2-4e14-8ded-0f43033cded5 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:23.241827 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 468/933] 10.222.0.24 () {56 vars in 1114 bytes} [Thu Apr 7 06:07:23 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:23.242778 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672fafe5-7fd2-4e14-8ded-0f43033cded5 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:23.261528 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747ebdf-9c24-4062-a2e3-456d56ef4a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:23.262194 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747ebdf-9c24-4062-a2e3-456d56ef4a2d None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:23.262472 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747ebdf-9c24-4062-a2e3-456d56ef4a2d None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:23.262740 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747ebdf-9c24-4062-a2e3-456d56ef4a2d None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:23.263445 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d747ebdf-9c24-4062-a2e3-456d56ef4a2d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:23.263774 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d747ebdf-9c24-4062-a2e3-456d56ef4a2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:23.265130 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d747ebdf-9c24-4062-a2e3-456d56ef4a2d None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:23.274383 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 466/934] 10.222.0.24 () {56 vars in 1126 bytes} [Thu Apr 7 06:07:23 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:23.274383 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747ebdf-9c24-4062-a2e3-456d56ef4a2d None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:23.350809 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672fafe5-7fd2-4e14-8ded-0f43033cded5 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:23.365467 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747ebdf-9c24-4062-a2e3-456d56ef4a2d None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:23.383635 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5809e8e1-487f-44a3-8150-b3fb65be59be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:23.384335 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809e8e1-487f-44a3-8150-b3fb65be59be None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:23.384621 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809e8e1-487f-44a3-8150-b3fb65be59be None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:23.384898 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809e8e1-487f-44a3-8150-b3fb65be59be None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:23.385619 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5809e8e1-487f-44a3-8150-b3fb65be59be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:23.385930 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5809e8e1-487f-44a3-8150-b3fb65be59be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:23.387283 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5809e8e1-487f-44a3-8150-b3fb65be59be None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:23.398220 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775e81b8-484d-4668-a4d9-5d4fd383593a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:23.398879 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775e81b8-484d-4668-a4d9-5d4fd383593a None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:23.399166 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775e81b8-484d-4668-a4d9-5d4fd383593a None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:23.399443 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775e81b8-484d-4668-a4d9-5d4fd383593a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:23.404523 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775e81b8-484d-4668-a4d9-5d4fd383593a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:23.404523 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775e81b8-484d-4668-a4d9-5d4fd383593a None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:23.404701 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 469/935] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:07:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:23.405116 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5809e8e1-487f-44a3-8150-b3fb65be59be None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:23.479710 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 467/936] 10.222.0.24 () {60 vars in 1144 bytes} [Thu Apr 7 06:07:23 2022] POST /identity/v3/endpoints => generated 346 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:07:23.480861 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775e81b8-484d-4668-a4d9-5d4fd383593a None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:23.502001 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5809e8e1-487f-44a3-8150-b3fb65be59be None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:23.544732 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7164e1f1-ec2e-4bae-99f1-99d45acb544d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:23.545655 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164e1f1-ec2e-4bae-99f1-99d45acb544d None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:23.546083 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164e1f1-ec2e-4bae-99f1-99d45acb544d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:23.546523 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164e1f1-ec2e-4bae-99f1-99d45acb544d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:23.547421 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7164e1f1-ec2e-4bae-99f1-99d45acb544d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:23.549096 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7164e1f1-ec2e-4bae-99f1-99d45acb544d None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:23.595421 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775e81b8-484d-4668-a4d9-5d4fd383593a None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:23.631699 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e30199b-0250-404b-899d-fdbe143a37ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:23.632577 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30199b-0250-404b-899d-fdbe143a37ca None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:23.632863 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30199b-0250-404b-899d-fdbe143a37ca None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:23.633139 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30199b-0250-404b-899d-fdbe143a37ca None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:23.641635 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e30199b-0250-404b-899d-fdbe143a37ca None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:23.643788 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e30199b-0250-404b-899d-fdbe143a37ca None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:23.656343 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 470/937] 10.222.0.24 () {60 vars in 1144 bytes} [Thu Apr 7 06:07:23 2022] POST /identity/v3/endpoints => generated 347 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:07:23.658070 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-5e30199b-0250-404b-899d-fdbe143a37ca None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 07 06:07:23.659716 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 468/938] 10.222.0.24 () {56 vars in 1117 bytes} [Thu Apr 7 06:07:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:23.677437 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7164e1f1-ec2e-4bae-99f1-99d45acb544d None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:23.805207 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7164e1f1-ec2e-4bae-99f1-99d45acb544d None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:23.843383 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc20db-c391-4734-9bfa-bd12751ab510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:23.844101 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc20db-c391-4734-9bfa-bd12751ab510 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:23.844386 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc20db-c391-4734-9bfa-bd12751ab510 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:23.844662 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc20db-c391-4734-9bfa-bd12751ab510 None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:23.845520 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fc20db-c391-4734-9bfa-bd12751ab510 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:23.845897 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fc20db-c391-4734-9bfa-bd12751ab510 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:23.847403 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fc20db-c391-4734-9bfa-bd12751ab510 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:23.866695 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 471/939] 10.222.0.24 () {56 vars in 1149 bytes} [Thu Apr 7 06:07:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:23.872232 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e30199b-0250-404b-899d-fdbe143a37ca None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:23.975104 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e30199b-0250-404b-899d-fdbe143a37ca None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:24.012753 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c42517b-57db-44a8-a1a7-fbbb4994b8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:24.013550 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42517b-57db-44a8-a1a7-fbbb4994b8d8 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:24.013831 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42517b-57db-44a8-a1a7-fbbb4994b8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:24.014128 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42517b-57db-44a8-a1a7-fbbb4994b8d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:24.025613 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c42517b-57db-44a8-a1a7-fbbb4994b8d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:24.027010 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c42517b-57db-44a8-a1a7-fbbb4994b8d8 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:24.044437 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-8c42517b-57db-44a8-a1a7-fbbb4994b8d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:07:24.046053 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 469/940] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:07:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:24.051849 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc20db-c391-4734-9bfa-bd12751ab510 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:24.150864 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc20db-c391-4734-9bfa-bd12751ab510 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:24.188251 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e69430a-0dbb-4795-9476-3557f2c0391b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:24.188918 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e69430a-0dbb-4795-9476-3557f2c0391b None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:24.189205 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e69430a-0dbb-4795-9476-3557f2c0391b None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:24.189484 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e69430a-0dbb-4795-9476-3557f2c0391b None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:24.190212 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e69430a-0dbb-4795-9476-3557f2c0391b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:24.190520 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e69430a-0dbb-4795-9476-3557f2c0391b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:24.191918 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e69430a-0dbb-4795-9476-3557f2c0391b None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:24.203674 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 472/941] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:07:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:24.209515 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c42517b-57db-44a8-a1a7-fbbb4994b8d8 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:24.310953 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c42517b-57db-44a8-a1a7-fbbb4994b8d8 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:24.344411 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6595beb1-cd1e-4200-8cfa-a6fa954b12dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:24.345250 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595beb1-cd1e-4200-8cfa-a6fa954b12dc None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:24.345534 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595beb1-cd1e-4200-8cfa-a6fa954b12dc None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:24.345809 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595beb1-cd1e-4200-8cfa-a6fa954b12dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:24.353059 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6595beb1-cd1e-4200-8cfa-a6fa954b12dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:24.354504 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6595beb1-cd1e-4200-8cfa-a6fa954b12dc None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:24.368010 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-6595beb1-cd1e-4200-8cfa-a6fa954b12dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 07 06:07:24.369489 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 470/942] 10.222.0.24 () {56 vars in 1111 bytes} [Thu Apr 7 06:07:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:24.375040 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e69430a-0dbb-4795-9476-3557f2c0391b None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:24.448273 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2088241-0ffc-4e8e-b222-066a121e47de None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:24.448622 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2088241-0ffc-4e8e-b222-066a121e47de None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:24.448820 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2088241-0ffc-4e8e-b222-066a121e47de None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:24.450429 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 471/943] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:07:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 07 06:07:24.455374 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a7e964-7e8b-4e24-ab09-bfbd0501dece None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:24.455659 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a7e964-7e8b-4e24-ab09-bfbd0501dece None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:24.455966 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a7e964-7e8b-4e24-ab09-bfbd0501dece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:24.473129 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-c1a7e964-7e8b-4e24-ab09-bfbd0501dece None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:07:24.474311 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-c1a7e964-7e8b-4e24-ab09-bfbd0501dece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:07:24.477232 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e69430a-0dbb-4795-9476-3557f2c0391b None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:24.511610 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c613f4c-6dac-4a3e-861b-22f455c78ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:24.512318 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c613f4c-6dac-4a3e-861b-22f455c78ae2 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:24.512608 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c613f4c-6dac-4a3e-861b-22f455c78ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:24.512888 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c613f4c-6dac-4a3e-861b-22f455c78ae2 None admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:24.513677 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c613f4c-6dac-4a3e-861b-22f455c78ae2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:24.513996 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c613f4c-6dac-4a3e-861b-22f455c78ae2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:24.515434 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c613f4c-6dac-4a3e-861b-22f455c78ae2 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:24.538976 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 473/944] 10.222.0.24 () {56 vars in 1148 bytes} [Thu Apr 7 06:07:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:24.545009 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c613f4c-6dac-4a3e-861b-22f455c78ae2 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:24.559820 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 472/945] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:07:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 07 06:07:24.575934 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a7e964-7e8b-4e24-ab09-bfbd0501dece None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:24.666482 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c613f4c-6dac-4a3e-861b-22f455c78ae2 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:24.678352 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a7e964-7e8b-4e24-ab09-bfbd0501dece None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:24.701595 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe826540-5fcc-4ac1-8981-a0e31cd79760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:24.702434 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe826540-5fcc-4ac1-8981-a0e31cd79760 None admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:24.702716 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe826540-5fcc-4ac1-8981-a0e31cd79760 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:24.702990 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe826540-5fcc-4ac1-8981-a0e31cd79760 None admin] PATH_INFO: `/v3/projects/de88f2c333ae49cfa7fff7fa1ed0022c/users/f4435fb14c3844728531af63993f78c0/roles/db6da2a870e5446690e2385bf7da6f59` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:24.707039 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe826540-5fcc-4ac1-8981-a0e31cd79760 None admin] RBAC: Authorizing `identity:create_grant(project_id=de88f2c333ae49cfa7fff7fa1ed0022c, user_id=f4435fb14c3844728531af63993f78c0, role_id=db6da2a870e5446690e2385bf7da6f59)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:24.708500 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe826540-5fcc-4ac1-8981-a0e31cd79760 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:24.714566 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b71fe-9f19-4cfa-b8e7-b46b635fd991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:24.715379 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b71fe-9f19-4cfa-b8e7-b46b635fd991 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:24.715659 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b71fe-9f19-4cfa-b8e7-b46b635fd991 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:24.715983 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b71fe-9f19-4cfa-b8e7-b46b635fd991 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:24.716642 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078b71fe-9f19-4cfa-b8e7-b46b635fd991 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:24.718006 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078b71fe-9f19-4cfa-b8e7-b46b635fd991 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:24.732242 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-078b71fe-9f19-4cfa-b8e7-b46b635fd991 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 07 06:07:24.733849 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 473/946] 10.222.0.24 () {56 vars in 1126 bytes} [Thu Apr 7 06:07:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 07 06:07:24.740771 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b71fe-9f19-4cfa-b8e7-b46b635fd991 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:24.796262 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 474/947] 10.222.0.24 () {58 vars in 1439 bytes} [Thu Apr 7 06:07:24 2022] PUT /identity/v3/projects/de88f2c333ae49cfa7fff7fa1ed0022c/users/f4435fb14c3844728531af63993f78c0/roles/db6da2a870e5446690e2385bf7da6f59 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:07:24.861393 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b71fe-9f19-4cfa-b8e7-b46b635fd991 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:24.900669 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1935805b-c697-4166-8687-6a895faf24c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:24.901663 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935805b-c697-4166-8687-6a895faf24c0 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:24.902152 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935805b-c697-4166-8687-6a895faf24c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:24.902610 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935805b-c697-4166-8687-6a895faf24c0 None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:24.903527 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1935805b-c697-4166-8687-6a895faf24c0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:24.904059 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1935805b-c697-4166-8687-6a895faf24c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:24.905642 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1935805b-c697-4166-8687-6a895faf24c0 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:24.911593 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 474/948] 10.222.0.24 () {56 vars in 1122 bytes} [Thu Apr 7 06:07:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:24.920850 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe826540-5fcc-4ac1-8981-a0e31cd79760 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:25.025813 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe826540-5fcc-4ac1-8981-a0e31cd79760 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:25.059702 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cde9f5-7cbb-4242-995a-310a5eb08945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:25.060395 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cde9f5-7cbb-4242-995a-310a5eb08945 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:25.060682 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cde9f5-7cbb-4242-995a-310a5eb08945 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:25.060961 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cde9f5-7cbb-4242-995a-310a5eb08945 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:25.061668 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cde9f5-7cbb-4242-995a-310a5eb08945 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:25.061974 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cde9f5-7cbb-4242-995a-310a5eb08945 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:25.063337 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cde9f5-7cbb-4242-995a-310a5eb08945 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:25.068531 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 475/949] 10.222.0.24 () {56 vars in 1122 bytes} [Thu Apr 7 06:07:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:25.074145 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1935805b-c697-4166-8687-6a895faf24c0 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:25.181743 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1935805b-c697-4166-8687-6a895faf24c0 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:25.217151 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f54a0-579c-42a1-94c4-98d31e7d549e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:25.218110 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f54a0-579c-42a1-94c4-98d31e7d549e None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:25.218575 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f54a0-579c-42a1-94c4-98d31e7d549e None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:25.219028 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f54a0-579c-42a1-94c4-98d31e7d549e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:25.220027 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4f54a0-579c-42a1-94c4-98d31e7d549e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:25.221579 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4f54a0-579c-42a1-94c4-98d31e7d549e None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:25.294610 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 475/950] 10.222.0.24 () {60 vars in 1144 bytes} [Thu Apr 7 06:07:25 2022] POST /identity/v3/endpoints => generated 349 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:07:25.937311 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945f59b-f5d8-4fed-ac15-82be33d9e795 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:25.937843 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945f59b-f5d8-4fed-ac15-82be33d9e795 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:25.937843 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945f59b-f5d8-4fed-ac15-82be33d9e795 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:25.939491 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 476/951] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:07:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:07:25.945033 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe723c-5fb6-439e-ba65-65cce3420a8b None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:25.945431 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe723c-5fb6-439e-ba65-65cce3420a8b None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:25.945599 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe723c-5fb6-439e-ba65-65cce3420a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:25.963062 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-9efe723c-5fb6-439e-ba65-65cce3420a8b None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:07:25.964270 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-9efe723c-5fb6-439e-ba65-65cce3420a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:07:26.047851 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 476/952] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:07:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 07 06:07:26.053207 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a169a5-3610-4e84-a942-aa381ed2b11f None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:26.053743 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a169a5-3610-4e84-a942-aa381ed2b11f None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:26.054244 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a169a5-3610-4e84-a942-aa381ed2b11f None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:26.056078 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 477/953] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:07:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:07:26.061283 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cfe159-366a-496e-b7c9-db112dae4638 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:26.061853 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cfe159-366a-496e-b7c9-db112dae4638 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:26.062327 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cfe159-366a-496e-b7c9-db112dae4638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:26.066961 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a169a5-3610-4e84-a942-aa381ed2b11f None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:26.079873 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-09cfe159-366a-496e-b7c9-db112dae4638 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:07:26.081071 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-09cfe159-366a-496e-b7c9-db112dae4638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:07:26.163842 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 477/954] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:07:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 07 06:07:26.187899 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a169a5-3610-4e84-a942-aa381ed2b11f None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:26.188213 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cfe159-366a-496e-b7c9-db112dae4638 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:26.229362 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e080418-c144-4b3f-9546-e333e240fc3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:26.230351 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e080418-c144-4b3f-9546-e333e240fc3e None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:26.230782 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e080418-c144-4b3f-9546-e333e240fc3e None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:26.231203 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e080418-c144-4b3f-9546-e333e240fc3e None admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:26.232433 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e080418-c144-4b3f-9546-e333e240fc3e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:26.233888 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e080418-c144-4b3f-9546-e333e240fc3e None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:26.236727 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.common [None req-6e080418-c144-4b3f-9546-e333e240fc3e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Apr 07 06:07:26.293334 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.sql.core [None req-6e080418-c144-4b3f-9546-e333e240fc3e None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Apr 07 06:07:26.293334 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Apr 07 06:07:26.293334 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [parameters: {'id': '8c4d9c13827f4e5c9eba0a5191f206cc', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Apr 07 06:07:26.293334 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80167) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 07 06:07:26.294927 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cfe159-366a-496e-b7c9-db112dae4638 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:26.303215 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-6e080418-c144-4b3f-9546-e333e240fc3e None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8c4d9c13827f4e5c9eba0a5191f206cc.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8c4d9c13827f4e5c9eba0a5191f206cc. Apr 07 06:07:26.304527 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 478/955] 10.222.0.24 () {60 vars in 1140 bytes} [Thu Apr 7 06:07:26 2022] POST /identity/v3/projects => generated 262 bytes in 238 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:26.311368 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e080418-c144-4b3f-9546-e333e240fc3e None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:26.331246 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d014a6f-5c6b-4c4f-99fb-330d834b998e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:26.332386 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d014a6f-5c6b-4c4f-99fb-330d834b998e None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:26.332903 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d014a6f-5c6b-4c4f-99fb-330d834b998e None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:26.333439 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d014a6f-5c6b-4c4f-99fb-330d834b998e None admin] PATH_INFO: `/v3/services/compute` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:26.334354 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d014a6f-5c6b-4c4f-99fb-330d834b998e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:26.336039 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d014a6f-5c6b-4c4f-99fb-330d834b998e None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:26.346995 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-9d014a6f-5c6b-4c4f-99fb-330d834b998e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 07 06:07:26.348835 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 478/956] 10.222.0.24 () {56 vars in 1111 bytes} [Thu Apr 7 06:07:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 07 06:07:26.356163 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d014a6f-5c6b-4c4f-99fb-330d834b998e None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:26.440193 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e080418-c144-4b3f-9546-e333e240fc3e None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:26.470463 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d014a6f-5c6b-4c4f-99fb-330d834b998e None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:26.476252 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd31b5-4b19-4f7f-a32c-59b9eb83129d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:26.477109 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd31b5-4b19-4f7f-a32c-59b9eb83129d None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:26.477445 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd31b5-4b19-4f7f-a32c-59b9eb83129d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:26.477723 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd31b5-4b19-4f7f-a32c-59b9eb83129d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:26.484614 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbd31b5-4b19-4f7f-a32c-59b9eb83129d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:26.486273 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbd31b5-4b19-4f7f-a32c-59b9eb83129d None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:26.500167 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-3dbd31b5-4b19-4f7f-a32c-59b9eb83129d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 07 06:07:26.506131 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 479/957] 10.222.0.24 () {56 vars in 1111 bytes} [Thu Apr 7 06:07:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 07 06:07:26.506991 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd31b5-4b19-4f7f-a32c-59b9eb83129d None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:26.507119 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c035e0-851f-4d7a-a762-f2bc7f040374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:26.508055 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c035e0-851f-4d7a-a762-f2bc7f040374 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:26.508534 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c035e0-851f-4d7a-a762-f2bc7f040374 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:26.509002 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c035e0-851f-4d7a-a762-f2bc7f040374 None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:26.509911 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c035e0-851f-4d7a-a762-f2bc7f040374 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:26.510411 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c035e0-851f-4d7a-a762-f2bc7f040374 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:26.511996 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c035e0-851f-4d7a-a762-f2bc7f040374 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:26.517411 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 479/958] 10.222.0.24 () {56 vars in 1112 bytes} [Thu Apr 7 06:07:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:26.527765 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c035e0-851f-4d7a-a762-f2bc7f040374 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:26.621594 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd31b5-4b19-4f7f-a32c-59b9eb83129d None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:26.641322 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c035e0-851f-4d7a-a762-f2bc7f040374 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:26.663837 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a703c3d-12f7-441c-9d6f-15a7ffdd6bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:26.664724 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a703c3d-12f7-441c-9d6f-15a7ffdd6bef None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:26.665146 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a703c3d-12f7-441c-9d6f-15a7ffdd6bef None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:26.665580 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a703c3d-12f7-441c-9d6f-15a7ffdd6bef None admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:26.666469 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a703c3d-12f7-441c-9d6f-15a7ffdd6bef None admin] RBAC: Adding query filter params (name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:26.667344 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a703c3d-12f7-441c-9d6f-15a7ffdd6bef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:26.669182 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a703c3d-12f7-441c-9d6f-15a7ffdd6bef None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:26.681610 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc08e7-8a46-4ac7-90f7-4d98f4511dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:26.682911 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc08e7-8a46-4ac7-90f7-4d98f4511dcf None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:26.683273 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc08e7-8a46-4ac7-90f7-4d98f4511dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:26.683622 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc08e7-8a46-4ac7-90f7-4d98f4511dcf None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:26.684557 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc08e7-8a46-4ac7-90f7-4d98f4511dcf None admin] RBAC: Adding query filter params (type=compute) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:26.684989 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc08e7-8a46-4ac7-90f7-4d98f4511dcf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:26.686484 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc08e7-8a46-4ac7-90f7-4d98f4511dcf None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:26.694379 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 480/960] 10.222.0.24 () {56 vars in 1112 bytes} [Thu Apr 7 06:07:26 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:26.707905 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 480/960] 10.222.0.24 () {56 vars in 1112 bytes} [Thu Apr 7 06:07:26 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:07:27.236803 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658f96f-940b-4abe-9802-8496cc9db76b None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:27.237827 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658f96f-940b-4abe-9802-8496cc9db76b None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:27.238334 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658f96f-940b-4abe-9802-8496cc9db76b None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:27.240960 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 481/961] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:07:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:07:27.246420 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e24f2-e635-4e36-b69b-e96b8696b63d None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:27.247214 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e24f2-e635-4e36-b69b-e96b8696b63d None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:27.247701 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e24f2-e635-4e36-b69b-e96b8696b63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:27.265546 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-676e24f2-e635-4e36-b69b-e96b8696b63d None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:07:27.267125 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-676e24f2-e635-4e36-b69b-e96b8696b63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:07:27.339890 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 481/962] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:07:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 07 06:07:27.360605 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658f96f-940b-4abe-9802-8496cc9db76b None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:27.465749 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658f96f-940b-4abe-9802-8496cc9db76b None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:27.500708 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b877101-9b63-4bb8-91a1-10ea94ff62e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:27.501456 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b877101-9b63-4bb8-91a1-10ea94ff62e2 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:27.501738 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b877101-9b63-4bb8-91a1-10ea94ff62e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:27.502013 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b877101-9b63-4bb8-91a1-10ea94ff62e2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:27.512710 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b877101-9b63-4bb8-91a1-10ea94ff62e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:07:27.520199 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-9b877101-9b63-4bb8-91a1-10ea94ff62e2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 07 06:07:27.522334 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 482/963] 10.222.0.24 () {56 vars in 1120 bytes} [Thu Apr 7 06:07:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:27.528282 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e24f2-e635-4e36-b69b-e96b8696b63d None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:27.627923 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e24f2-e635-4e36-b69b-e96b8696b63d None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:27.639883 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99aa8e-8f33-494e-a65d-c854efabff48 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:27.640497 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99aa8e-8f33-494e-a65d-c854efabff48 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:27.640988 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99aa8e-8f33-494e-a65d-c854efabff48 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:27.642805 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 483/964] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:07:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:07:27.648499 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb332ddb-3a79-4bb2-b968-39ced7642d16 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:27.649015 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb332ddb-3a79-4bb2-b968-39ced7642d16 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:27.649513 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb332ddb-3a79-4bb2-b968-39ced7642d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:27.664696 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7c98fc-5db1-4127-91fb-0674f788634d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:27.665369 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c98fc-5db1-4127-91fb-0674f788634d None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:27.665650 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c98fc-5db1-4127-91fb-0674f788634d None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:27.665923 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c98fc-5db1-4127-91fb-0674f788634d None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:27.666665 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7c98fc-5db1-4127-91fb-0674f788634d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:27.666969 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7c98fc-5db1-4127-91fb-0674f788634d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:27.667702 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-fb332ddb-3a79-4bb2-b968-39ced7642d16 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:07:27.668390 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7c98fc-5db1-4127-91fb-0674f788634d None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:27.669662 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-fb332ddb-3a79-4bb2-b968-39ced7642d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:07:27.680748 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 482/965] 10.222.0.24 () {56 vars in 1115 bytes} [Thu Apr 7 06:07:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:27.681802 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7c98fc-5db1-4127-91fb-0674f788634d None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:27.758037 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 484/966] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:07:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 07 06:07:27.778458 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb332ddb-3a79-4bb2-b968-39ced7642d16 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:27.809536 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7c98fc-5db1-4127-91fb-0674f788634d None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:27.845014 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898cf183-066d-4b29-afcb-94ddea8bb7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:27.845845 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898cf183-066d-4b29-afcb-94ddea8bb7d4 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:27.846100 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898cf183-066d-4b29-afcb-94ddea8bb7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:27.846376 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898cf183-066d-4b29-afcb-94ddea8bb7d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:27.857755 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898cf183-066d-4b29-afcb-94ddea8bb7d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:27.858977 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898cf183-066d-4b29-afcb-94ddea8bb7d4 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:27.877284 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-898cf183-066d-4b29-afcb-94ddea8bb7d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:07:27.883450 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 483/967] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:07:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:27.884549 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898cf183-066d-4b29-afcb-94ddea8bb7d4 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:27.897147 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb332ddb-3a79-4bb2-b968-39ced7642d16 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:27.932748 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6592a0bd-5d49-4e25-a635-9a6f6267c7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:27.933811 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6592a0bd-5d49-4e25-a635-9a6f6267c7c8 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:27.934281 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6592a0bd-5d49-4e25-a635-9a6f6267c7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:27.934733 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6592a0bd-5d49-4e25-a635-9a6f6267c7c8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:27.935588 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6592a0bd-5d49-4e25-a635-9a6f6267c7c8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:27.937147 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6592a0bd-5d49-4e25-a635-9a6f6267c7c8 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:27.949326 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-6592a0bd-5d49-4e25-a635-9a6f6267c7c8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 07 06:07:27.955732 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 485/968] 10.222.0.24 () {56 vars in 1126 bytes} [Thu Apr 7 06:07:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 07 06:07:27.956838 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6592a0bd-5d49-4e25-a635-9a6f6267c7c8 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:27.987180 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898cf183-066d-4b29-afcb-94ddea8bb7d4 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:28.022410 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8675ce05-b8d6-43ea-a2d5-c79517709fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:28.022888 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675ce05-b8d6-43ea-a2d5-c79517709fe8 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:28.023267 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675ce05-b8d6-43ea-a2d5-c79517709fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:28.023655 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675ce05-b8d6-43ea-a2d5-c79517709fe8 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:28.024439 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8675ce05-b8d6-43ea-a2d5-c79517709fe8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:28.024817 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8675ce05-b8d6-43ea-a2d5-c79517709fe8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:28.026270 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8675ce05-b8d6-43ea-a2d5-c79517709fe8 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:28.038975 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 484/969] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:07:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:07:28.044483 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8675ce05-b8d6-43ea-a2d5-c79517709fe8 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:28.061863 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6592a0bd-5d49-4e25-a635-9a6f6267c7c8 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:28.095204 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea0f9f-d43a-4f65-8977-a0c6a4d525f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:28.096208 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea0f9f-d43a-4f65-8977-a0c6a4d525f4 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:28.096695 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea0f9f-d43a-4f65-8977-a0c6a4d525f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:28.097188 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea0f9f-d43a-4f65-8977-a0c6a4d525f4 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:28.098095 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea0f9f-d43a-4f65-8977-a0c6a4d525f4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:28.098608 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea0f9f-d43a-4f65-8977-a0c6a4d525f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:28.100775 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea0f9f-d43a-4f65-8977-a0c6a4d525f4 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:28.110371 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 486/970] 10.222.0.24 () {56 vars in 1122 bytes} [Thu Apr 7 06:07:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:28.111863 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea0f9f-d43a-4f65-8977-a0c6a4d525f4 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:28.141687 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8675ce05-b8d6-43ea-a2d5-c79517709fe8 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:28.176193 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6218982-1f70-4fdd-9f0a-b7f523bcfb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:28.177006 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6218982-1f70-4fdd-9f0a-b7f523bcfb5f None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:28.177334 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6218982-1f70-4fdd-9f0a-b7f523bcfb5f None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:28.177600 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6218982-1f70-4fdd-9f0a-b7f523bcfb5f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:28.184813 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6218982-1f70-4fdd-9f0a-b7f523bcfb5f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:28.186262 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6218982-1f70-4fdd-9f0a-b7f523bcfb5f None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:28.200506 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-f6218982-1f70-4fdd-9f0a-b7f523bcfb5f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 07 06:07:28.206652 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 485/971] 10.222.0.24 () {56 vars in 1117 bytes} [Thu Apr 7 06:07:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:28.207505 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6218982-1f70-4fdd-9f0a-b7f523bcfb5f None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:28.213640 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea0f9f-d43a-4f65-8977-a0c6a4d525f4 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:28.248142 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd28455-3522-4bbb-b58a-a40716abde50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:28.249649 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd28455-3522-4bbb-b58a-a40716abde50 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:28.250183 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd28455-3522-4bbb-b58a-a40716abde50 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:28.250674 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd28455-3522-4bbb-b58a-a40716abde50 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:28.251580 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd28455-3522-4bbb-b58a-a40716abde50 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:28.252105 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd28455-3522-4bbb-b58a-a40716abde50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:28.253673 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd28455-3522-4bbb-b58a-a40716abde50 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:28.264486 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 487/972] 10.222.0.24 () {56 vars in 1122 bytes} [Thu Apr 7 06:07:28 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:07:28.265656 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd28455-3522-4bbb-b58a-a40716abde50 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:28.318905 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6218982-1f70-4fdd-9f0a-b7f523bcfb5f None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:28.353246 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb2967-0776-4867-b02c-25131ae26944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:28.353927 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb2967-0776-4867-b02c-25131ae26944 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:28.354215 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb2967-0776-4867-b02c-25131ae26944 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:28.354493 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb2967-0776-4867-b02c-25131ae26944 None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:28.355332 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bb2967-0776-4867-b02c-25131ae26944 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:28.355645 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bb2967-0776-4867-b02c-25131ae26944 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:28.357390 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bb2967-0776-4867-b02c-25131ae26944 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:28.379800 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 486/973] 10.222.0.24 () {56 vars in 1149 bytes} [Thu Apr 7 06:07:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:28.381857 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb2967-0776-4867-b02c-25131ae26944 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:28.388410 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd28455-3522-4bbb-b58a-a40716abde50 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:28.422425 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d8b7bc-9289-443c-ac8f-1b5dc2c747c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:28.423556 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8b7bc-9289-443c-ac8f-1b5dc2c747c2 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:28.423556 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8b7bc-9289-443c-ac8f-1b5dc2c747c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:28.423998 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8b7bc-9289-443c-ac8f-1b5dc2c747c2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:28.424905 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d8b7bc-9289-443c-ac8f-1b5dc2c747c2 None admin] RBAC: Adding query filter params (interface=admin, service_id=17b223a9f46c4cc89c10869f32da04b5, region_id=RegionOne) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:28.425334 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d8b7bc-9289-443c-ac8f-1b5dc2c747c2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:28.426802 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d8b7bc-9289-443c-ac8f-1b5dc2c747c2 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:28.436084 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 488/974] 10.222.0.24 () {56 vars in 1249 bytes} [Thu Apr 7 06:07:28 2022] GET /identity/v3/endpoints?service_id=17b223a9f46c4cc89c10869f32da04b5&interface=admin®ion_id=RegionOne => generated 193 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:28.437990 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d8b7bc-9289-443c-ac8f-1b5dc2c747c2 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:28.486887 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb2967-0776-4867-b02c-25131ae26944 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:28.522184 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e98a23e-7ce0-428f-ab5a-b64d064d0fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:28.523129 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98a23e-7ce0-428f-ab5a-b64d064d0fc0 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:28.523604 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98a23e-7ce0-428f-ab5a-b64d064d0fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:28.524056 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98a23e-7ce0-428f-ab5a-b64d064d0fc0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:28.539353 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d8b7bc-9289-443c-ac8f-1b5dc2c747c2 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:28.573830 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10452f74-c358-4cd9-8da8-36b9709f6171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:28.574548 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10452f74-c358-4cd9-8da8-36b9709f6171 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:28.574891 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10452f74-c358-4cd9-8da8-36b9709f6171 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:28.575252 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10452f74-c358-4cd9-8da8-36b9709f6171 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:28.576037 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10452f74-c358-4cd9-8da8-36b9709f6171 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:28.577485 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10452f74-c358-4cd9-8da8-36b9709f6171 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:28.592201 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 489/975] 10.222.0.24 () {56 vars in 1087 bytes} [Thu Apr 7 06:07:28 2022] GET /identity/v3/services => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 07 06:07:28.597072 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e98a23e-7ce0-428f-ab5a-b64d064d0fc0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:28.599006 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e98a23e-7ce0-428f-ab5a-b64d064d0fc0 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:28.714119 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 487/976] 10.222.0.24 () {58 vars in 1282 bytes} [Thu Apr 7 06:07:28 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 07 06:07:28.723815 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10452f74-c358-4cd9-8da8-36b9709f6171 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:28.848496 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10452f74-c358-4cd9-8da8-36b9709f6171 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:28.883179 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7cf22c-1075-46c4-b460-833c8bf60b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:28.884362 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7cf22c-1075-46c4-b460-833c8bf60b03 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:28.884854 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7cf22c-1075-46c4-b460-833c8bf60b03 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:28.885352 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7cf22c-1075-46c4-b460-833c8bf60b03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:28.896975 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7cf22c-1075-46c4-b460-833c8bf60b03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:28.898705 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7cf22c-1075-46c4-b460-833c8bf60b03 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:28.915502 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-2b7cf22c-1075-46c4-b460-833c8bf60b03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:07:28.917386 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 490/977] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:07:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:28.923177 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e98a23e-7ce0-428f-ab5a-b64d064d0fc0 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:29.026573 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e98a23e-7ce0-428f-ab5a-b64d064d0fc0 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:29.060869 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e0320-9aee-45fa-8584-704d7dc77626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:29.061537 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e0320-9aee-45fa-8584-704d7dc77626 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:29.061824 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e0320-9aee-45fa-8584-704d7dc77626 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:29.062102 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e0320-9aee-45fa-8584-704d7dc77626 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:29.062822 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8e0320-9aee-45fa-8584-704d7dc77626 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:29.063131 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8e0320-9aee-45fa-8584-704d7dc77626 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:29.064530 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8e0320-9aee-45fa-8584-704d7dc77626 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:29.076194 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 488/978] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:07:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:07:29.085538 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7cf22c-1075-46c4-b460-833c8bf60b03 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:29.086713 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6a1b0-bbeb-441f-9441-a4a2ee30f32d None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:29.087007 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6a1b0-bbeb-441f-9441-a4a2ee30f32d None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:29.087291 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6a1b0-bbeb-441f-9441-a4a2ee30f32d None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:29.089849 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 489/979] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:07:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 07 06:07:29.093796 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b0b08-cf06-4aa7-aebc-c03d6887657a None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:29.094087 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b0b08-cf06-4aa7-aebc-c03d6887657a None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:29.094369 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b0b08-cf06-4aa7-aebc-c03d6887657a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:29.111724 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-4d9b0b08-cf06-4aa7-aebc-c03d6887657a None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:07:29.113237 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-4d9b0b08-cf06-4aa7-aebc-c03d6887657a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:07:29.180299 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 490/980] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:07:29 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 07 06:07:29.181621 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a6972-9c18-4f1c-bf8d-3134f9d2d6f0 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:29.181912 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a6972-9c18-4f1c-bf8d-3134f9d2d6f0 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:29.182188 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a6972-9c18-4f1c-bf8d-3134f9d2d6f0 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:29.187482 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 491/981] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:07:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:07:29.188644 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd5fab-1abe-4716-992c-916f76fa4dd9 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:29.188924 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd5fab-1abe-4716-992c-916f76fa4dd9 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:29.189205 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd5fab-1abe-4716-992c-916f76fa4dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:29.206018 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7cf22c-1075-46c4-b460-833c8bf60b03 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:29.211833 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-cdcd5fab-1abe-4716-992c-916f76fa4dd9 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:07:29.213031 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-cdcd5fab-1abe-4716-992c-916f76fa4dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:07:29.238526 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e089212-c96a-4768-8a27-c53fd327a8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:29.239582 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e089212-c96a-4768-8a27-c53fd327a8db None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:29.240502 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e089212-c96a-4768-8a27-c53fd327a8db None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:29.240779 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e089212-c96a-4768-8a27-c53fd327a8db None admin] PATH_INFO: `/v3/projects/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:29.247232 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e089212-c96a-4768-8a27-c53fd327a8db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:29.248706 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e089212-c96a-4768-8a27-c53fd327a8db None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:29.261970 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-3e089212-c96a-4768-8a27-c53fd327a8db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 07 06:07:29.267641 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 491/982] 10.222.0.24 () {56 vars in 1111 bytes} [Thu Apr 7 06:07:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:29.267641 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e089212-c96a-4768-8a27-c53fd327a8db None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:29.291774 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 492/983] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:07:29 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 07 06:07:29.291774 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcd5fab-1abe-4716-992c-916f76fa4dd9 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:29.374530 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e089212-c96a-4768-8a27-c53fd327a8db None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:29.391011 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcd5fab-1abe-4716-992c-916f76fa4dd9 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:29.408546 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a9f81-4d29-47ab-ab6d-0d87b7f42d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:29.409221 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a9f81-4d29-47ab-ab6d-0d87b7f42d4d None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:29.409509 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a9f81-4d29-47ab-ab6d-0d87b7f42d4d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:29.409789 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a9f81-4d29-47ab-ab6d-0d87b7f42d4d None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:29.410516 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805a9f81-4d29-47ab-ab6d-0d87b7f42d4d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:29.412427 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805a9f81-4d29-47ab-ab6d-0d87b7f42d4d None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:29.424685 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f2b16d-c187-42c3-bf51-62448f66fde0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:29.430037 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2b16d-c187-42c3-bf51-62448f66fde0 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:29.430037 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2b16d-c187-42c3-bf51-62448f66fde0 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:29.430037 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2b16d-c187-42c3-bf51-62448f66fde0 None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:29.430037 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f2b16d-c187-42c3-bf51-62448f66fde0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:29.430037 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f2b16d-c187-42c3-bf51-62448f66fde0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:29.430037 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f2b16d-c187-42c3-bf51-62448f66fde0 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:29.440303 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 493/984] 10.222.0.24 () {56 vars in 1148 bytes} [Thu Apr 7 06:07:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:29.441106 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f2b16d-c187-42c3-bf51-62448f66fde0 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:29.484172 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 492/985] 10.222.0.24 () {60 vars in 1141 bytes} [Thu Apr 7 06:07:29 2022] POST /identity/v3/services => generated 242 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:07:29.485326 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a9f81-4d29-47ab-ab6d-0d87b7f42d4d None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:29.549724 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f2b16d-c187-42c3-bf51-62448f66fde0 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:29.600359 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2a55d-6feb-493f-b46d-a8a3b286f1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:29.601269 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2a55d-6feb-493f-b46d-a8a3b286f1e6 None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:29.601572 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2a55d-6feb-493f-b46d-a8a3b286f1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:29.601850 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2a55d-6feb-493f-b46d-a8a3b286f1e6 None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:29.602575 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc2a55d-6feb-493f-b46d-a8a3b286f1e6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:29.604897 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc2a55d-6feb-493f-b46d-a8a3b286f1e6 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:29.606414 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.common [None req-acc2a55d-6feb-493f-b46d-a8a3b286f1e6 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Apr 07 06:07:29.623815 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a9f81-4d29-47ab-ab6d-0d87b7f42d4d None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:29.660684 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a79fa-4076-4dcf-b30b-1b840accf699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:29.662264 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a79fa-4076-4dcf-b30b-1b840accf699 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:29.662737 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a79fa-4076-4dcf-b30b-1b840accf699 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:29.663192 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a79fa-4076-4dcf-b30b-1b840accf699 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:29.664318 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26a79fa-4076-4dcf-b30b-1b840accf699 None admin] RBAC: Adding query filter params (role.id=db6da2a870e5446690e2385bf7da6f59, scope.project.id=de88f2c333ae49cfa7fff7fa1ed0022c, user.id=f4435fb14c3844728531af63993f78c0) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:29.664908 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26a79fa-4076-4dcf-b30b-1b840accf699 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:29.666571 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26a79fa-4076-4dcf-b30b-1b840accf699 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:29.673123 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 493/986] 10.222.0.24 () {56 vars in 1374 bytes} [Thu Apr 7 06:07:29 2022] GET /identity/v3/role_assignments?user.id=f4435fb14c3844728531af63993f78c0&scope.project.id=de88f2c333ae49cfa7fff7fa1ed0022c&role.id=db6da2a870e5446690e2385bf7da6f59 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:29.678667 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.sql.core [None req-acc2a55d-6feb-493f-b46d-a8a3b286f1e6 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Apr 07 06:07:29.678667 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Apr 07 06:07:29.678667 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [parameters: {'user_id': '6c5804d62cbb47248a2f10a8b78825be', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Apr 07 06:07:29.678667 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80168) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 07 06:07:29.694644 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-acc2a55d-6feb-493f-b46d-a8a3b286f1e6 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Apr 07 06:07:29.696765 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 494/987] 10.222.0.24 () {60 vars in 1131 bytes} [Thu Apr 7 06:07:29 2022] POST /identity/v3/users => generated 160 bytes in 256 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:29.702990 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a79fa-4076-4dcf-b30b-1b840accf699 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:29.823119 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a79fa-4076-4dcf-b30b-1b840accf699 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:29.870227 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b55f6e-e1b4-4e09-9a5c-cad75667b960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:29.871426 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b55f6e-e1b4-4e09-9a5c-cad75667b960 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:29.871935 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b55f6e-e1b4-4e09-9a5c-cad75667b960 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:29.872404 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b55f6e-e1b4-4e09-9a5c-cad75667b960 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:29.881231 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b55f6e-e1b4-4e09-9a5c-cad75667b960 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:29.882956 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b55f6e-e1b4-4e09-9a5c-cad75667b960 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:29.896989 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-53b55f6e-e1b4-4e09-9a5c-cad75667b960 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 07 06:07:29.898760 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 494/988] 10.222.0.24 () {56 vars in 1099 bytes} [Thu Apr 7 06:07:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 07 06:07:29.905238 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2a55d-6feb-493f-b46d-a8a3b286f1e6 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:30.007149 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2a55d-6feb-493f-b46d-a8a3b286f1e6 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:30.041170 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d2f773-be3b-4812-8f0f-ea769ba21635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:30.042174 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2f773-be3b-4812-8f0f-ea769ba21635 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:30.042656 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2f773-be3b-4812-8f0f-ea769ba21635 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:30.043124 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2f773-be3b-4812-8f0f-ea769ba21635 None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:30.044141 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d2f773-be3b-4812-8f0f-ea769ba21635 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:30.044663 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d2f773-be3b-4812-8f0f-ea769ba21635 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:30.046475 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d2f773-be3b-4812-8f0f-ea769ba21635 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:30.084832 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 495/989] 10.222.0.24 () {56 vars in 1101 bytes} [Thu Apr 7 06:07:29 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:30.956290 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954de2a8-a187-4b40-8dab-a8dba94b6062 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:30.956832 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954de2a8-a187-4b40-8dab-a8dba94b6062 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:30.956832 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954de2a8-a187-4b40-8dab-a8dba94b6062 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:30.958356 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 495/990] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:07:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:07:30.963382 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524407a-4e14-4bd7-bde9-d8071907ffc8 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:30.963853 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524407a-4e14-4bd7-bde9-d8071907ffc8 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:30.963963 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524407a-4e14-4bd7-bde9-d8071907ffc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:30.980926 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-1524407a-4e14-4bd7-bde9-d8071907ffc8 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:07:30.982420 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-1524407a-4e14-4bd7-bde9-d8071907ffc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:07:31.045848 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 496/991] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:07:30 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 07 06:07:31.068992 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954de2a8-a187-4b40-8dab-a8dba94b6062 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:31.165452 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954de2a8-a187-4b40-8dab-a8dba94b6062 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:31.196560 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0802e01b-fa84-480c-b597-47173ba981e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:31.197368 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802e01b-fa84-480c-b597-47173ba981e3 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:31.197651 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802e01b-fa84-480c-b597-47173ba981e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:31.197926 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802e01b-fa84-480c-b597-47173ba981e3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:31.198574 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0802e01b-fa84-480c-b597-47173ba981e3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:31.199975 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0802e01b-fa84-480c-b597-47173ba981e3 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:31.211340 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-0802e01b-fa84-480c-b597-47173ba981e3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 07 06:07:31.212688 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 496/992] 10.222.0.24 () {56 vars in 1126 bytes} [Thu Apr 7 06:07:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:31.218407 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524407a-4e14-4bd7-bde9-d8071907ffc8 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:31.313493 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524407a-4e14-4bd7-bde9-d8071907ffc8 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:31.345857 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c206d-ea59-4c8d-b362-3f0a9a071f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:31.346529 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c206d-ea59-4c8d-b362-3f0a9a071f80 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:31.346813 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c206d-ea59-4c8d-b362-3f0a9a071f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:31.347089 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c206d-ea59-4c8d-b362-3f0a9a071f80 None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:31.347825 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064c206d-ea59-4c8d-b362-3f0a9a071f80 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:31.348138 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064c206d-ea59-4c8d-b362-3f0a9a071f80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:31.349870 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064c206d-ea59-4c8d-b362-3f0a9a071f80 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:31.359791 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 497/993] 10.222.0.24 () {56 vars in 1122 bytes} [Thu Apr 7 06:07:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:07:31.360628 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0802e01b-fa84-480c-b597-47173ba981e3 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:31.456380 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0802e01b-fa84-480c-b597-47173ba981e3 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:31.488374 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b56d2-fbcf-4f65-b8e5-25db7a2712d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:31.489305 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b56d2-fbcf-4f65-b8e5-25db7a2712d0 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:31.489591 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b56d2-fbcf-4f65-b8e5-25db7a2712d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:31.489895 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b56d2-fbcf-4f65-b8e5-25db7a2712d0 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:31.490601 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549b56d2-fbcf-4f65-b8e5-25db7a2712d0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:31.490906 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549b56d2-fbcf-4f65-b8e5-25db7a2712d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:31.492320 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549b56d2-fbcf-4f65-b8e5-25db7a2712d0 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:31.502389 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 497/994] 10.222.0.24 () {56 vars in 1122 bytes} [Thu Apr 7 06:07:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:07:31.503419 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c206d-ea59-4c8d-b362-3f0a9a071f80 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:31.602651 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c206d-ea59-4c8d-b362-3f0a9a071f80 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:31.635180 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a835f3-c596-435f-b361-497ba851f5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:31.635871 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a835f3-c596-435f-b361-497ba851f5c5 None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:31.636158 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a835f3-c596-435f-b361-497ba851f5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:31.636431 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a835f3-c596-435f-b361-497ba851f5c5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:31.637182 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a835f3-c596-435f-b361-497ba851f5c5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:31.638579 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a835f3-c596-435f-b361-497ba851f5c5 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:31.716710 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 498/995] 10.222.0.24 () {60 vars in 1144 bytes} [Thu Apr 7 06:07:31 2022] POST /identity/v3/endpoints => generated 325 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:07:31.888738 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106befca-0622-4496-9f70-8d7f314f92a4 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:31.888935 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106befca-0622-4496-9f70-8d7f314f92a4 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:31.889215 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106befca-0622-4496-9f70-8d7f314f92a4 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:31.890595 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 498/996] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:07:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:07:31.896465 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e480b9-bbff-4408-ad5a-41483abc6fef None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:31.896831 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e480b9-bbff-4408-ad5a-41483abc6fef None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:31.897180 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e480b9-bbff-4408-ad5a-41483abc6fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:31.914580 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-d6e480b9-bbff-4408-ad5a-41483abc6fef None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:07:31.916093 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d6e480b9-bbff-4408-ad5a-41483abc6fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:07:31.986667 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 499/997] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:07:31 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 07 06:07:32.010404 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106befca-0622-4496-9f70-8d7f314f92a4 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:32.029004 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0705859-4d49-4281-82d2-871c10098d22 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:32.029310 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0705859-4d49-4281-82d2-871c10098d22 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:32.029569 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0705859-4d49-4281-82d2-871c10098d22 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:32.031068 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 500/998] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:07:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 07 06:07:32.035648 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1a4af-957f-477e-b98d-d90701ac2be4 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:32.035958 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1a4af-957f-477e-b98d-d90701ac2be4 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:32.036235 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1a4af-957f-477e-b98d-d90701ac2be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:32.052831 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-18f1a4af-957f-477e-b98d-d90701ac2be4 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:07:32.054030 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-18f1a4af-957f-477e-b98d-d90701ac2be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:07:32.111531 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106befca-0622-4496-9f70-8d7f314f92a4 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:32.120379 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 501/999] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:07:32 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 07 06:07:32.142508 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f1a4af-957f-477e-b98d-d90701ac2be4 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:32.144316 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f69109e-746b-43dc-bf64-30094252d859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:32.145120 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f69109e-746b-43dc-bf64-30094252d859 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:32.145402 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f69109e-746b-43dc-bf64-30094252d859 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:32.145670 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f69109e-746b-43dc-bf64-30094252d859 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:32.146395 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f69109e-746b-43dc-bf64-30094252d859 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:32.147757 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f69109e-746b-43dc-bf64-30094252d859 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:32.158473 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-1f69109e-746b-43dc-bf64-30094252d859 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 07 06:07:32.159620 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 499/1000] 10.222.0.24 () {56 vars in 1111 bytes} [Thu Apr 7 06:07:32 2022] GET /identity/v3/services/compute => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:32.165819 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f69109e-746b-43dc-bf64-30094252d859 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:32.241305 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f1a4af-957f-477e-b98d-d90701ac2be4 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:32.261992 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f69109e-746b-43dc-bf64-30094252d859 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:32.282028 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b33ca1-03c2-4707-a0bb-b7f4a8441e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:32.282824 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b33ca1-03c2-4707-a0bb-b7f4a8441e38 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:32.283105 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b33ca1-03c2-4707-a0bb-b7f4a8441e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:32.283393 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b33ca1-03c2-4707-a0bb-b7f4a8441e38 None admin] PATH_INFO: `/v3/services/image` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:32.284056 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b33ca1-03c2-4707-a0bb-b7f4a8441e38 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:32.285453 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b33ca1-03c2-4707-a0bb-b7f4a8441e38 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:32.296201 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a1263c-56db-4bd6-8766-a4d282bf050b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:32.296448 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-a5b33ca1-03c2-4707-a0bb-b7f4a8441e38 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 07 06:07:32.296873 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1263c-56db-4bd6-8766-a4d282bf050b None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:32.297158 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1263c-56db-4bd6-8766-a4d282bf050b None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:32.297434 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1263c-56db-4bd6-8766-a4d282bf050b None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:32.304191 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 502/1001] 10.222.0.24 () {56 vars in 1105 bytes} [Thu Apr 7 06:07:32 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:32.304322 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a1263c-56db-4bd6-8766-a4d282bf050b None admin] RBAC: Adding query filter params (name=compute) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:32.304322 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a1263c-56db-4bd6-8766-a4d282bf050b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:32.304322 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a1263c-56db-4bd6-8766-a4d282bf050b None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:32.305281 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 500/1002] 10.222.0.24 () {56 vars in 1112 bytes} [Thu Apr 7 06:07:32 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:07:32.305392 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b33ca1-03c2-4707-a0bb-b7f4a8441e38 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:32.310893 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a1263c-56db-4bd6-8766-a4d282bf050b None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:32.404938 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a1263c-56db-4bd6-8766-a4d282bf050b None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:32.405496 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b33ca1-03c2-4707-a0bb-b7f4a8441e38 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:32.437533 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c06d27-a757-4bb7-83bd-8d78832ceba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:32.438191 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c06d27-a757-4bb7-83bd-8d78832ceba7 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:32.438478 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c06d27-a757-4bb7-83bd-8d78832ceba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:32.438753 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c06d27-a757-4bb7-83bd-8d78832ceba7 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:32.439456 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c06d27-a757-4bb7-83bd-8d78832ceba7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:32.439784 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c06d27-a757-4bb7-83bd-8d78832ceba7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:32.441220 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c06d27-a757-4bb7-83bd-8d78832ceba7 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:32.443318 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cbcf26-09ba-42f6-bc9c-0ef052086e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:32.444507 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cbcf26-09ba-42f6-bc9c-0ef052086e6b None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:32.444986 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cbcf26-09ba-42f6-bc9c-0ef052086e6b None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:32.445447 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cbcf26-09ba-42f6-bc9c-0ef052086e6b None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:32.445981 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 501/1003] 10.222.0.24 () {56 vars in 1112 bytes} [Thu Apr 7 06:07:32 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:07:32.446512 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cbcf26-09ba-42f6-bc9c-0ef052086e6b None admin] RBAC: Adding query filter params (name=image) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:32.446822 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cbcf26-09ba-42f6-bc9c-0ef052086e6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:32.448201 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cbcf26-09ba-42f6-bc9c-0ef052086e6b None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:32.451647 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c06d27-a757-4bb7-83bd-8d78832ceba7 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:32.454819 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 503/1004] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:07:32 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:32.460452 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cbcf26-09ba-42f6-bc9c-0ef052086e6b None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:32.549538 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c06d27-a757-4bb7-83bd-8d78832ceba7 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:32.562519 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cbcf26-09ba-42f6-bc9c-0ef052086e6b None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:32.582362 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa0f67-f355-4afb-b54b-a5faa1bb4ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:32.583031 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa0f67-f355-4afb-b54b-a5faa1bb4ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:32.583871 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa0f67-f355-4afb-b54b-a5faa1bb4ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:32.584159 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa0f67-f355-4afb-b54b-a5faa1bb4ab7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:32.584941 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aa0f67-f355-4afb-b54b-a5faa1bb4ab7 None admin] RBAC: Adding query filter params (interface=public, service_id=5b3632f40c894f0d94c9062b886867fc, region_id=RegionOne) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:32.585541 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aa0f67-f355-4afb-b54b-a5faa1bb4ab7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:32.586585 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aa0f67-f355-4afb-b54b-a5faa1bb4ab7 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:32.591502 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 502/1005] 10.222.0.24 () {56 vars in 1251 bytes} [Thu Apr 7 06:07:32 2022] GET /identity/v3/endpoints?service_id=5b3632f40c894f0d94c9062b886867fc&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:07:32.596929 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa0f67-f355-4afb-b54b-a5faa1bb4ab7 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:32.598299 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f5f9b-40a2-491d-8633-5b9fdbfeb1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:32.599203 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f5f9b-40a2-491d-8633-5b9fdbfeb1f2 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:32.599667 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f5f9b-40a2-491d-8633-5b9fdbfeb1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:32.600135 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f5f9b-40a2-491d-8633-5b9fdbfeb1f2 None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:32.600848 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5f5f9b-40a2-491d-8633-5b9fdbfeb1f2 None admin] RBAC: Adding query filter params (type=image) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:32.601167 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5f5f9b-40a2-491d-8633-5b9fdbfeb1f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:32.602538 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5f5f9b-40a2-491d-8633-5b9fdbfeb1f2 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:32.607709 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 504/1006] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:07:32 2022] GET /identity/v3/services?type=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:07:32.704292 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa0f67-f355-4afb-b54b-a5faa1bb4ab7 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:32.738967 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4956560f-e644-445b-b7cf-09e60882c66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:32.747332 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956560f-e644-445b-b7cf-09e60882c66f None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:32.747332 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956560f-e644-445b-b7cf-09e60882c66f None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:32.747332 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956560f-e644-445b-b7cf-09e60882c66f None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:32.747332 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4956560f-e644-445b-b7cf-09e60882c66f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:32.747332 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4956560f-e644-445b-b7cf-09e60882c66f None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:32.756111 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 503/1007] 10.222.0.24 () {56 vars in 1087 bytes} [Thu Apr 7 06:07:32 2022] GET /identity/v3/services => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:07:34.040537 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9411c90-71f1-4c10-a8d2-9920139cb038 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:34.041034 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9411c90-71f1-4c10-a8d2-9920139cb038 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:34.041113 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9411c90-71f1-4c10-a8d2-9920139cb038 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:34.042631 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 505/1008] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:07:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:07:34.047531 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968cd191-ff53-47f1-b243-9b2eb1003174 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:34.047962 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968cd191-ff53-47f1-b243-9b2eb1003174 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:34.048264 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968cd191-ff53-47f1-b243-9b2eb1003174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:34.064876 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-968cd191-ff53-47f1-b243-9b2eb1003174 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:07:34.066067 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-968cd191-ff53-47f1-b243-9b2eb1003174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:07:34.130054 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 504/1009] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:07:34 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 07 06:07:34.154582 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9411c90-71f1-4c10-a8d2-9920139cb038 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:34.252010 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9411c90-71f1-4c10-a8d2-9920139cb038 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:34.283707 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b1522-5722-4e4e-be08-b43ca97f4eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:34.284537 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b1522-5722-4e4e-be08-b43ca97f4eb0 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:34.284820 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b1522-5722-4e4e-be08-b43ca97f4eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:34.285094 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b1522-5722-4e4e-be08-b43ca97f4eb0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:34.286285 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944b1522-5722-4e4e-be08-b43ca97f4eb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:34.287795 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944b1522-5722-4e4e-be08-b43ca97f4eb0 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:34.291866 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 506/1010] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:07:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:34.295668 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968cd191-ff53-47f1-b243-9b2eb1003174 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:34.389645 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968cd191-ff53-47f1-b243-9b2eb1003174 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:34.421658 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32460a91-dc2c-4dd0-8c5d-270253521a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:34.422326 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32460a91-dc2c-4dd0-8c5d-270253521a66 None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:34.422610 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32460a91-dc2c-4dd0-8c5d-270253521a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:34.422884 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32460a91-dc2c-4dd0-8c5d-270253521a66 None admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:34.423593 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32460a91-dc2c-4dd0-8c5d-270253521a66 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:34.425043 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32460a91-dc2c-4dd0-8c5d-270253521a66 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:34.543864 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 505/1011] 10.222.0.24 () {60 vars in 1141 bytes} [Thu Apr 7 06:07:34 2022] POST /identity/v3/projects => generated 311 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:07:34.906449 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c3489e-8e3b-4269-98f3-a22d4130bb17 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:34.906644 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c3489e-8e3b-4269-98f3-a22d4130bb17 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:34.906929 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c3489e-8e3b-4269-98f3-a22d4130bb17 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:34.908434 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 507/1012] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:07:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:07:34.914533 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfaa6d6-e711-46e5-b44c-8fed3348177f None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:34.914828 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfaa6d6-e711-46e5-b44c-8fed3348177f None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:34.915109 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfaa6d6-e711-46e5-b44c-8fed3348177f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:34.931267 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-fcfaa6d6-e711-46e5-b44c-8fed3348177f None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:07:34.932457 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-fcfaa6d6-e711-46e5-b44c-8fed3348177f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:07:34.996037 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 506/1013] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:07:34 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 07 06:07:35.019258 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c3489e-8e3b-4269-98f3-a22d4130bb17 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:35.064497 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3411284b-c2c3-4550-b6a7-78b28c1b55cb None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:35.065034 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3411284b-c2c3-4550-b6a7-78b28c1b55cb None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:35.065115 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3411284b-c2c3-4550-b6a7-78b28c1b55cb None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:35.067398 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 507/1014] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:07:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 07 06:07:35.071787 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7a028-35d7-4e07-af24-e626e21df6ff None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:35.072093 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7a028-35d7-4e07-af24-e626e21df6ff None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:35.073325 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7a028-35d7-4e07-af24-e626e21df6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:35.088580 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-10f7a028-35d7-4e07-af24-e626e21df6ff None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:07:35.089731 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-10f7a028-35d7-4e07-af24-e626e21df6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:07:35.120555 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c3489e-8e3b-4269-98f3-a22d4130bb17 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:35.153606 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1130d-f4ea-48e9-874d-212f8e76ca9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:35.154264 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1130d-f4ea-48e9-874d-212f8e76ca9c None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:35.154547 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1130d-f4ea-48e9-874d-212f8e76ca9c None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:35.154819 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1130d-f4ea-48e9-874d-212f8e76ca9c None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:35.155541 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e1130d-f4ea-48e9-874d-212f8e76ca9c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:35.158944 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e1130d-f4ea-48e9-874d-212f8e76ca9c None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:35.163888 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 508/1015] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:07:35 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 07 06:07:35.180458 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7a028-35d7-4e07-af24-e626e21df6ff None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:35.263639 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 508/1016] 10.222.0.24 () {60 vars in 1141 bytes} [Thu Apr 7 06:07:35 2022] POST /identity/v3/services => generated 242 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:07:35.276016 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7a028-35d7-4e07-af24-e626e21df6ff None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:35.322094 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3e373-35a5-4449-9c4c-84b5ec8b29a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:35.323215 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3e373-35a5-4449-9c4c-84b5ec8b29a4 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:35.323511 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3e373-35a5-4449-9c4c-84b5ec8b29a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:35.323817 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3e373-35a5-4449-9c4c-84b5ec8b29a4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:35.324501 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d3e373-35a5-4449-9c4c-84b5ec8b29a4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:35.325937 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d3e373-35a5-4449-9c4c-84b5ec8b29a4 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:35.338542 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-13d3e373-35a5-4449-9c4c-84b5ec8b29a4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 07 06:07:35.340082 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 509/1017] 10.222.0.24 () {56 vars in 1111 bytes} [Thu Apr 7 06:07:35 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 07 06:07:35.345999 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1130d-f4ea-48e9-874d-212f8e76ca9c None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:35.452645 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1130d-f4ea-48e9-874d-212f8e76ca9c None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:35.487257 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764adcd5-cc3d-4da0-8ab8-c364021290c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:35.487995 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764adcd5-cc3d-4da0-8ab8-c364021290c3 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:35.488289 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764adcd5-cc3d-4da0-8ab8-c364021290c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:35.488568 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764adcd5-cc3d-4da0-8ab8-c364021290c3 None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:35.490080 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764adcd5-cc3d-4da0-8ab8-c364021290c3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:35.490397 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764adcd5-cc3d-4da0-8ab8-c364021290c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:35.491939 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764adcd5-cc3d-4da0-8ab8-c364021290c3 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:35.496877 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 509/1018] 10.222.0.24 () {56 vars in 1112 bytes} [Thu Apr 7 06:07:35 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:35.502604 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3e373-35a5-4449-9c4c-84b5ec8b29a4 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:35.597744 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3e373-35a5-4449-9c4c-84b5ec8b29a4 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:35.630001 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d022aa-366f-4f2c-a361-b1f5558ea580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:35.630732 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d022aa-366f-4f2c-a361-b1f5558ea580 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:35.631021 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d022aa-366f-4f2c-a361-b1f5558ea580 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:35.631301 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d022aa-366f-4f2c-a361-b1f5558ea580 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:35.632039 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d022aa-366f-4f2c-a361-b1f5558ea580 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:35.632352 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d022aa-366f-4f2c-a361-b1f5558ea580 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:35.633729 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d022aa-366f-4f2c-a361-b1f5558ea580 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:35.643242 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 510/1019] 10.222.0.24 () {56 vars in 1112 bytes} [Thu Apr 7 06:07:35 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:07:35.644633 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764adcd5-cc3d-4da0-8ab8-c364021290c3 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:35.747844 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764adcd5-cc3d-4da0-8ab8-c364021290c3 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:35.783711 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95d2af2-7511-4340-bde4-ef04c505d3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:35.784405 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d2af2-7511-4340-bde4-ef04c505d3c6 None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:35.784695 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d2af2-7511-4340-bde4-ef04c505d3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:35.784974 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d2af2-7511-4340-bde4-ef04c505d3c6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:35.787166 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95d2af2-7511-4340-bde4-ef04c505d3c6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:35.787695 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95d2af2-7511-4340-bde4-ef04c505d3c6 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:35.893581 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 510/1020] 10.222.0.24 () {60 vars in 1144 bytes} [Thu Apr 7 06:07:35 2022] POST /identity/v3/endpoints => generated 334 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:07:36.888188 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9c923-9ff7-4cfa-9b12-15dd332cca33 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:36.888731 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9c923-9ff7-4cfa-9b12-15dd332cca33 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:36.888731 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9c923-9ff7-4cfa-9b12-15dd332cca33 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:36.890253 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 511/1021] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:07:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:07:36.895187 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2eb4df-7877-41b6-88f6-f3ed03d98183 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:36.895582 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2eb4df-7877-41b6-88f6-f3ed03d98183 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:36.895816 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2eb4df-7877-41b6-88f6-f3ed03d98183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:36.912588 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-4a2eb4df-7877-41b6-88f6-f3ed03d98183 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:07:36.913769 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-4a2eb4df-7877-41b6-88f6-f3ed03d98183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:07:36.983041 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 511/1022] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:07:36 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 07 06:07:37.008222 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c9c923-9ff7-4cfa-9b12-15dd332cca33 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:37.108969 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c9c923-9ff7-4cfa-9b12-15dd332cca33 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:37.145929 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f885b0c-9359-4f3e-b197-ea3ddc8ee6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:37.146732 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f885b0c-9359-4f3e-b197-ea3ddc8ee6e5 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:37.147016 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f885b0c-9359-4f3e-b197-ea3ddc8ee6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:37.147292 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f885b0c-9359-4f3e-b197-ea3ddc8ee6e5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:37.148484 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f885b0c-9359-4f3e-b197-ea3ddc8ee6e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:37.149923 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f885b0c-9359-4f3e-b197-ea3ddc8ee6e5 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:37.156208 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 512/1023] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:07:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:37.157416 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2eb4df-7877-41b6-88f6-f3ed03d98183 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:37.254176 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2eb4df-7877-41b6-88f6-f3ed03d98183 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:37.286483 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c086ebd2-4f73-43b6-adf9-d7c4870d6b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:37.287152 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086ebd2-4f73-43b6-adf9-d7c4870d6b3a None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:37.287435 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086ebd2-4f73-43b6-adf9-d7c4870d6b3a None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:37.287707 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086ebd2-4f73-43b6-adf9-d7c4870d6b3a None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:37.288431 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c086ebd2-4f73-43b6-adf9-d7c4870d6b3a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:37.289853 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c086ebd2-4f73-43b6-adf9-d7c4870d6b3a None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:37.390274 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 512/1024] 10.222.0.24 () {60 vars in 1132 bytes} [Thu Apr 7 06:07:37 2022] POST /identity/v3/users => generated 285 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:07:37.601429 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5736f-fc00-4a64-b1e3-ea796e459a76 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:37.601722 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5736f-fc00-4a64-b1e3-ea796e459a76 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:37.602005 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5736f-fc00-4a64-b1e3-ea796e459a76 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:37.603386 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 513/1025] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:07:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:07:37.608619 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6b0be-8f3a-4c92-9eca-54d62a47b48e None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:37.608910 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6b0be-8f3a-4c92-9eca-54d62a47b48e None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:37.609189 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6b0be-8f3a-4c92-9eca-54d62a47b48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:37.626689 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-53a6b0be-8f3a-4c92-9eca-54d62a47b48e None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:07:37.627904 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-53a6b0be-8f3a-4c92-9eca-54d62a47b48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:07:37.695850 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 513/1026] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:07:37 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 07 06:07:37.718200 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a5736f-fc00-4a64-b1e3-ea796e459a76 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:37.819347 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a5736f-fc00-4a64-b1e3-ea796e459a76 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:37.851927 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a771d-90c8-4216-8e03-85b3e1ebd744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:37.852717 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a771d-90c8-4216-8e03-85b3e1ebd744 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:37.853002 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a771d-90c8-4216-8e03-85b3e1ebd744 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:37.853278 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a771d-90c8-4216-8e03-85b3e1ebd744 None admin] PATH_INFO: `/v3/services/image` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:37.853927 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a771d-90c8-4216-8e03-85b3e1ebd744 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:37.855279 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a771d-90c8-4216-8e03-85b3e1ebd744 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:37.866261 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-ce8a771d-90c8-4216-8e03-85b3e1ebd744 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 07 06:07:37.867643 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 514/1027] 10.222.0.24 () {56 vars in 1105 bytes} [Thu Apr 7 06:07:37 2022] GET /identity/v3/services/image => generated 86 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:37.873411 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a6b0be-8f3a-4c92-9eca-54d62a47b48e None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:37.970732 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a6b0be-8f3a-4c92-9eca-54d62a47b48e None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:38.003544 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa34247-20df-4215-a2eb-144136952528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:38.004247 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa34247-20df-4215-a2eb-144136952528 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:38.004539 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa34247-20df-4215-a2eb-144136952528 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:38.004821 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa34247-20df-4215-a2eb-144136952528 None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:38.005568 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa34247-20df-4215-a2eb-144136952528 None admin] RBAC: Adding query filter params (name=image) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:38.005882 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa34247-20df-4215-a2eb-144136952528 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:38.007268 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa34247-20df-4215-a2eb-144136952528 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:38.016578 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 514/1028] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:07:37 2022] GET /identity/v3/services?name=image => generated 122 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:07:38.017766 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a771d-90c8-4216-8e03-85b3e1ebd744 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:38.115134 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a771d-90c8-4216-8e03-85b3e1ebd744 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:38.147413 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd4f8c7-143c-4023-861c-c60c8fcad62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:38.148119 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4f8c7-143c-4023-861c-c60c8fcad62e None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:38.148404 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4f8c7-143c-4023-861c-c60c8fcad62e None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:38.148679 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4f8c7-143c-4023-861c-c60c8fcad62e None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:38.149390 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd4f8c7-143c-4023-861c-c60c8fcad62e None admin] RBAC: Adding query filter params (type=image) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:38.149697 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd4f8c7-143c-4023-861c-c60c8fcad62e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:38.151061 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd4f8c7-143c-4023-861c-c60c8fcad62e None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:38.160879 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 515/1029] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:07:38 2022] GET /identity/v3/services?type=image => generated 350 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:07:38.162653 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa34247-20df-4215-a2eb-144136952528 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:38.259641 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa34247-20df-4215-a2eb-144136952528 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:38.292777 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14943657-8613-48cb-b224-042893e8eba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:38.293697 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14943657-8613-48cb-b224-042893e8eba3 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:38.294138 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14943657-8613-48cb-b224-042893e8eba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:38.294568 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14943657-8613-48cb-b224-042893e8eba3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:38.295503 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14943657-8613-48cb-b224-042893e8eba3 None admin] RBAC: Adding query filter params (interface=public, service_id=1348f7ce4a7e4dfd8dc40250a4662ef7, region_id=RegionOne) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:38.295996 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14943657-8613-48cb-b224-042893e8eba3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:38.297521 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14943657-8613-48cb-b224-042893e8eba3 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:38.302907 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 515/1030] 10.222.0.24 () {56 vars in 1251 bytes} [Thu Apr 7 06:07:38 2022] GET /identity/v3/endpoints?service_id=1348f7ce4a7e4dfd8dc40250a4662ef7&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:38.307242 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a18430-9aac-4983-8035-94ceda43e89d None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:38.307538 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a18430-9aac-4983-8035-94ceda43e89d None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:38.307845 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a18430-9aac-4983-8035-94ceda43e89d None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:38.308354 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14943657-8613-48cb-b224-042893e8eba3 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:38.310116 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 516/1031] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:07:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:07:38.315359 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5320b-91f3-4c21-b106-1f636bb93ba1 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:38.315877 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5320b-91f3-4c21-b106-1f636bb93ba1 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:38.316294 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5320b-91f3-4c21-b106-1f636bb93ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:38.338147 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-99f5320b-91f3-4c21-b106-1f636bb93ba1 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:07:38.339576 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-99f5320b-91f3-4c21-b106-1f636bb93ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:07:38.404954 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14943657-8613-48cb-b224-042893e8eba3 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:38.408364 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 517/1032] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:07:38 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 07 06:07:38.434450 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f5320b-91f3-4c21-b106-1f636bb93ba1 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:38.443328 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec90b20e-9a6b-4b8e-9aab-356b93b958e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:38.444839 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90b20e-9a6b-4b8e-9aab-356b93b958e9 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:38.445303 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90b20e-9a6b-4b8e-9aab-356b93b958e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:38.446035 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90b20e-9a6b-4b8e-9aab-356b93b958e9 None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:38.447371 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec90b20e-9a6b-4b8e-9aab-356b93b958e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:38.449361 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec90b20e-9a6b-4b8e-9aab-356b93b958e9 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:38.458949 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 516/1033] 10.222.0.24 () {56 vars in 1087 bytes} [Thu Apr 7 06:07:38 2022] GET /identity/v3/services => generated 1957 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:07:38.546108 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f5320b-91f3-4c21-b106-1f636bb93ba1 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:38.581302 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95da22-c822-41f1-b26e-aca6578d75f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:38.582162 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95da22-c822-41f1-b26e-aca6578d75f3 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:38.582448 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95da22-c822-41f1-b26e-aca6578d75f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:38.582725 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95da22-c822-41f1-b26e-aca6578d75f3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:38.594923 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd95da22-c822-41f1-b26e-aca6578d75f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:07:38.602572 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-bd95da22-c822-41f1-b26e-aca6578d75f3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 07 06:07:38.604071 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 518/1034] 10.222.0.24 () {56 vars in 1120 bytes} [Thu Apr 7 06:07:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 07 06:07:38.609927 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec90b20e-9a6b-4b8e-9aab-356b93b958e9 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:38.709817 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec90b20e-9a6b-4b8e-9aab-356b93b958e9 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:38.741755 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c64c7c-586e-467f-9e52-281f79e22115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:38.742452 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c64c7c-586e-467f-9e52-281f79e22115 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:38.742731 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c64c7c-586e-467f-9e52-281f79e22115 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:38.743003 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c64c7c-586e-467f-9e52-281f79e22115 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:38.743754 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c64c7c-586e-467f-9e52-281f79e22115 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:38.747996 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c64c7c-586e-467f-9e52-281f79e22115 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:38.747996 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c64c7c-586e-467f-9e52-281f79e22115 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:38.758270 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 517/1035] 10.222.0.24 () {56 vars in 1115 bytes} [Thu Apr 7 06:07:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:38.762338 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95da22-c822-41f1-b26e-aca6578d75f3 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:38.865521 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95da22-c822-41f1-b26e-aca6578d75f3 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:38.897379 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a05c91-bb7b-4b07-9402-3764e3ad8e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:38.898490 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a05c91-bb7b-4b07-9402-3764e3ad8e56 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:38.898998 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a05c91-bb7b-4b07-9402-3764e3ad8e56 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:38.899469 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a05c91-bb7b-4b07-9402-3764e3ad8e56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:38.909673 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a05c91-bb7b-4b07-9402-3764e3ad8e56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:38.911910 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a05c91-bb7b-4b07-9402-3764e3ad8e56 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:38.927627 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-14a05c91-bb7b-4b07-9402-3764e3ad8e56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:07:38.929322 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 519/1036] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:07:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:38.934723 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c64c7c-586e-467f-9e52-281f79e22115 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:39.029218 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c64c7c-586e-467f-9e52-281f79e22115 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:39.061061 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311cd48f-363d-45da-a454-bd6a0711ad79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:39.061724 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311cd48f-363d-45da-a454-bd6a0711ad79 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:39.062011 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311cd48f-363d-45da-a454-bd6a0711ad79 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:39.062287 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311cd48f-363d-45da-a454-bd6a0711ad79 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:39.063006 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311cd48f-363d-45da-a454-bd6a0711ad79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:39.063312 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311cd48f-363d-45da-a454-bd6a0711ad79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:39.064728 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311cd48f-363d-45da-a454-bd6a0711ad79 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:39.077558 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 518/1037] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:07:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:39.082911 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a05c91-bb7b-4b07-9402-3764e3ad8e56 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:39.184743 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a05c91-bb7b-4b07-9402-3764e3ad8e56 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:39.217169 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70d384b-5f12-4f43-a2c8-2cd463c1a93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:39.217964 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d384b-5f12-4f43-a2c8-2cd463c1a93f None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:39.218248 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d384b-5f12-4f43-a2c8-2cd463c1a93f None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:39.218524 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d384b-5f12-4f43-a2c8-2cd463c1a93f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:39.226062 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70d384b-5f12-4f43-a2c8-2cd463c1a93f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:39.227498 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70d384b-5f12-4f43-a2c8-2cd463c1a93f None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:39.241363 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-c70d384b-5f12-4f43-a2c8-2cd463c1a93f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 07 06:07:39.242899 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 520/1038] 10.222.0.24 () {56 vars in 1093 bytes} [Thu Apr 7 06:07:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 07 06:07:39.248425 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311cd48f-363d-45da-a454-bd6a0711ad79 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:39.344824 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311cd48f-363d-45da-a454-bd6a0711ad79 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:39.377856 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be15d0d0-c795-4196-99e2-1f2ffd14445a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:39.378529 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15d0d0-c795-4196-99e2-1f2ffd14445a None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:39.378955 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15d0d0-c795-4196-99e2-1f2ffd14445a None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:39.379236 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15d0d0-c795-4196-99e2-1f2ffd14445a None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:39.380147 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be15d0d0-c795-4196-99e2-1f2ffd14445a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:39.380456 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be15d0d0-c795-4196-99e2-1f2ffd14445a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:39.381895 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be15d0d0-c795-4196-99e2-1f2ffd14445a None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:39.404152 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 519/1039] 10.222.0.24 () {56 vars in 1133 bytes} [Thu Apr 7 06:07:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:39.405911 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70d384b-5f12-4f43-a2c8-2cd463c1a93f None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:39.503943 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70d384b-5f12-4f43-a2c8-2cd463c1a93f None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:39.535991 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608e563-24b4-439f-92ac-115814bd2497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:39.536719 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608e563-24b4-439f-92ac-115814bd2497 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:39.537007 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608e563-24b4-439f-92ac-115814bd2497 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:39.537283 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608e563-24b4-439f-92ac-115814bd2497 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:39.603285 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8608e563-24b4-439f-92ac-115814bd2497 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:39.604882 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8608e563-24b4-439f-92ac-115814bd2497 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:39.705739 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 521/1040] 10.222.0.24 () {58 vars in 1282 bytes} [Thu Apr 7 06:07:39 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 07 06:07:39.711489 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be15d0d0-c795-4196-99e2-1f2ffd14445a None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:39.777204 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12854a09-fb9d-4223-8c3d-3342512001d5 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:39.778489 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12854a09-fb9d-4223-8c3d-3342512001d5 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:39.778489 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12854a09-fb9d-4223-8c3d-3342512001d5 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:39.779115 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 522/1041] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:07:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 07 06:07:39.783955 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c1dc8-9874-45a5-87c6-7e9a1d1b4af4 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:39.784251 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c1dc8-9874-45a5-87c6-7e9a1d1b4af4 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:39.784538 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c1dc8-9874-45a5-87c6-7e9a1d1b4af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:39.800939 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-c35c1dc8-9874-45a5-87c6-7e9a1d1b4af4 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:07:39.802684 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c35c1dc8-9874-45a5-87c6-7e9a1d1b4af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:07:39.819014 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be15d0d0-c795-4196-99e2-1f2ffd14445a None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:39.856070 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca33f027-830b-4376-9fe0-f1001dc41384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:39.857570 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33f027-830b-4376-9fe0-f1001dc41384 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:39.858308 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33f027-830b-4376-9fe0-f1001dc41384 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:39.858779 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33f027-830b-4376-9fe0-f1001dc41384 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:39.867479 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 523/1042] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:07:39 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 07 06:07:39.875290 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca33f027-830b-4376-9fe0-f1001dc41384 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:39.876771 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca33f027-830b-4376-9fe0-f1001dc41384 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:39.892102 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35c1dc8-9874-45a5-87c6-7e9a1d1b4af4 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:39.893670 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-ca33f027-830b-4376-9fe0-f1001dc41384 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:07:39.894885 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 520/1043] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:07:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:39.900763 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca33f027-830b-4376-9fe0-f1001dc41384 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:39.996581 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35c1dc8-9874-45a5-87c6-7e9a1d1b4af4 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:39.997790 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca33f027-830b-4376-9fe0-f1001dc41384 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:40.030120 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01958b97-19f9-4d8a-8a53-4fca952f4c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:40.030924 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01958b97-19f9-4d8a-8a53-4fca952f4c58 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:40.031211 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01958b97-19f9-4d8a-8a53-4fca952f4c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:40.031490 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01958b97-19f9-4d8a-8a53-4fca952f4c58 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:40.031664 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f50b15-828e-4920-bac8-aede8ef5c84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:40.032535 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f50b15-828e-4920-bac8-aede8ef5c84c None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:40.032826 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f50b15-828e-4920-bac8-aede8ef5c84c None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:40.033102 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f50b15-828e-4920-bac8-aede8ef5c84c None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:40.033825 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f50b15-828e-4920-bac8-aede8ef5c84c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:40.034143 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f50b15-828e-4920-bac8-aede8ef5c84c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:40.035505 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f50b15-828e-4920-bac8-aede8ef5c84c None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:40.041826 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01958b97-19f9-4d8a-8a53-4fca952f4c58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:07:40.051541 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 521/1044] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:07:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:40.052370 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-01958b97-19f9-4d8a-8a53-4fca952f4c58 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 07 06:07:40.052370 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 524/1045] 10.222.0.24 () {56 vars in 1096 bytes} [Thu Apr 7 06:07:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 07 06:07:40.056065 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01958b97-19f9-4d8a-8a53-4fca952f4c58 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:40.056598 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f50b15-828e-4920-bac8-aede8ef5c84c None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:40.153893 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01958b97-19f9-4d8a-8a53-4fca952f4c58 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:40.161636 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f50b15-828e-4920-bac8-aede8ef5c84c None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:40.187444 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497131c-41c6-48c3-b3ff-3b91cb6e6823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:40.188168 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497131c-41c6-48c3-b3ff-3b91cb6e6823 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:40.188457 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497131c-41c6-48c3-b3ff-3b91cb6e6823 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:40.188732 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497131c-41c6-48c3-b3ff-3b91cb6e6823 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:40.189481 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a497131c-41c6-48c3-b3ff-3b91cb6e6823 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:40.189792 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a497131c-41c6-48c3-b3ff-3b91cb6e6823 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:40.191176 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a497131c-41c6-48c3-b3ff-3b91cb6e6823 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:40.195491 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc89a46-52f6-43fc-aa34-c98dd6059174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:40.196327 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc89a46-52f6-43fc-aa34-c98dd6059174 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:40.196610 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc89a46-52f6-43fc-aa34-c98dd6059174 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:40.196887 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc89a46-52f6-43fc-aa34-c98dd6059174 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:40.200144 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 525/1046] 10.222.0.24 () {56 vars in 1099 bytes} [Thu Apr 7 06:07:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:07:40.203588 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc89a46-52f6-43fc-aa34-c98dd6059174 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:40.205118 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc89a46-52f6-43fc-aa34-c98dd6059174 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:40.205512 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497131c-41c6-48c3-b3ff-3b91cb6e6823 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:40.219235 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-afc89a46-52f6-43fc-aa34-c98dd6059174 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 07 06:07:40.220612 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 522/1047] 10.222.0.24 () {56 vars in 1111 bytes} [Thu Apr 7 06:07:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:40.226079 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc89a46-52f6-43fc-aa34-c98dd6059174 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:40.302825 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497131c-41c6-48c3-b3ff-3b91cb6e6823 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:40.321558 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc89a46-52f6-43fc-aa34-c98dd6059174 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:40.335326 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca868a80-ebbc-47e3-b4a9-b9b237864ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:40.336231 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca868a80-ebbc-47e3-b4a9-b9b237864ff4 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:40.336515 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca868a80-ebbc-47e3-b4a9-b9b237864ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:40.336789 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca868a80-ebbc-47e3-b4a9-b9b237864ff4 None admin] PATH_INFO: `/v3/users/e83959783919439aa58407000856ceb5` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:40.349938 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca868a80-ebbc-47e3-b4a9-b9b237864ff4 None admin] RBAC: Authorizing `identity:get_user(user_id=e83959783919439aa58407000856ceb5)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:40.351374 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca868a80-ebbc-47e3-b4a9-b9b237864ff4 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:40.357767 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 526/1048] 10.222.0.24 () {56 vars in 1177 bytes} [Thu Apr 7 06:07:40 2022] GET /identity/v3/users/e83959783919439aa58407000856ceb5 => generated 285 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:40.357893 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2932ed8c-3655-42c5-a1ce-17fd4bec850f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:40.357893 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932ed8c-3655-42c5-a1ce-17fd4bec850f None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:40.357893 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932ed8c-3655-42c5-a1ce-17fd4bec850f None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:40.357893 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932ed8c-3655-42c5-a1ce-17fd4bec850f None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:40.358215 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2932ed8c-3655-42c5-a1ce-17fd4bec850f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:40.358215 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2932ed8c-3655-42c5-a1ce-17fd4bec850f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:40.358614 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca868a80-ebbc-47e3-b4a9-b9b237864ff4 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:40.358717 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2932ed8c-3655-42c5-a1ce-17fd4bec850f None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:40.370969 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 523/1049] 10.222.0.24 () {56 vars in 1148 bytes} [Thu Apr 7 06:07:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:07:40.376510 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2932ed8c-3655-42c5-a1ce-17fd4bec850f None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:40.468659 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca868a80-ebbc-47e3-b4a9-b9b237864ff4 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:40.488605 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2932ed8c-3655-42c5-a1ce-17fd4bec850f None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:40.502806 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0708f3c3-c510-4fc7-9243-c320113387c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:40.503460 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0708f3c3-c510-4fc7-9243-c320113387c1 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:40.503767 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0708f3c3-c510-4fc7-9243-c320113387c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:40.504049 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0708f3c3-c510-4fc7-9243-c320113387c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:40.521960 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da34429-4dba-4310-9805-a9f3f88c2022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:40.522619 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da34429-4dba-4310-9805-a9f3f88c2022 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:40.522905 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da34429-4dba-4310-9805-a9f3f88c2022 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:40.523186 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da34429-4dba-4310-9805-a9f3f88c2022 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:40.524046 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da34429-4dba-4310-9805-a9f3f88c2022 None admin] RBAC: Adding query filter params (role.id=db6da2a870e5446690e2385bf7da6f59, scope.project.id=de88f2c333ae49cfa7fff7fa1ed0022c, user.id=02cd81f6620f410db450871fb29961f6) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:40.524367 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da34429-4dba-4310-9805-a9f3f88c2022 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:40.525794 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da34429-4dba-4310-9805-a9f3f88c2022 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:40.531203 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 524/1050] 10.222.0.24 () {56 vars in 1374 bytes} [Thu Apr 7 06:07:40 2022] GET /identity/v3/role_assignments?user.id=02cd81f6620f410db450871fb29961f6&scope.project.id=de88f2c333ae49cfa7fff7fa1ed0022c&role.id=db6da2a870e5446690e2385bf7da6f59 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:07:40.572393 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0708f3c3-c510-4fc7-9243-c320113387c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:40.573783 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0708f3c3-c510-4fc7-9243-c320113387c1 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:40.679997 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 527/1051] 10.222.0.24 () {58 vars in 1282 bytes} [Thu Apr 7 06:07:40 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 07 06:07:40.681330 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da34429-4dba-4310-9805-a9f3f88c2022 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:40.779368 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6138e-ba48-489a-900f-b7a5901613be None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:40.779663 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6138e-ba48-489a-900f-b7a5901613be None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:40.779978 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6138e-ba48-489a-900f-b7a5901613be None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:40.781350 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 528/1052] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:07:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 07 06:07:40.786330 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0fdaf-8807-493f-86a2-0af0feaa0141 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:40.786614 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0fdaf-8807-493f-86a2-0af0feaa0141 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:40.786889 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0fdaf-8807-493f-86a2-0af0feaa0141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:40.788793 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da34429-4dba-4310-9805-a9f3f88c2022 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:40.803330 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-e7b0fdaf-8807-493f-86a2-0af0feaa0141 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:07:40.804518 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e7b0fdaf-8807-493f-86a2-0af0feaa0141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:07:40.823536 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9f4c3-fe5c-4718-bee7-40236e893957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:40.824368 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9f4c3-fe5c-4718-bee7-40236e893957 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:40.824647 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9f4c3-fe5c-4718-bee7-40236e893957 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:40.824917 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9f4c3-fe5c-4718-bee7-40236e893957 None admin] PATH_INFO: `/v3/projects/ae9fcf4aa3d14c9586664d984a4e366b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:40.826076 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c9f4c3-fe5c-4718-bee7-40236e893957 None admin] RBAC: Authorizing `identity:get_project(project_id=ae9fcf4aa3d14c9586664d984a4e366b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:40.827496 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c9f4c3-fe5c-4718-bee7-40236e893957 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:40.829377 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 525/1053] 10.222.0.24 () {56 vars in 1186 bytes} [Thu Apr 7 06:07:40 2022] GET /identity/v3/projects/ae9fcf4aa3d14c9586664d984a4e366b => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:40.835601 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9f4c3-fe5c-4718-bee7-40236e893957 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:40.875543 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 529/1054] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:07:40 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 07 06:07:40.899461 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0fdaf-8807-493f-86a2-0af0feaa0141 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:40.936884 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9f4c3-fe5c-4718-bee7-40236e893957 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:40.969515 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a37ad7e-6ce0-4a4f-9427-dd86667e3d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:40.970173 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37ad7e-6ce0-4a4f-9427-dd86667e3d98 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:40.970462 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37ad7e-6ce0-4a4f-9427-dd86667e3d98 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:40.970741 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37ad7e-6ce0-4a4f-9427-dd86667e3d98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:40.971572 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a37ad7e-6ce0-4a4f-9427-dd86667e3d98 None admin] RBAC: Adding query filter params (role.id=0fab680bc76f4a73826e9beb59e8129b, scope.project.id=ae9fcf4aa3d14c9586664d984a4e366b, user.id=e83959783919439aa58407000856ceb5) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:40.971917 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a37ad7e-6ce0-4a4f-9427-dd86667e3d98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:40.973350 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a37ad7e-6ce0-4a4f-9427-dd86667e3d98 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:40.987783 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 526/1055] 10.222.0.24 () {56 vars in 1374 bytes} [Thu Apr 7 06:07:40 2022] GET /identity/v3/role_assignments?user.id=e83959783919439aa58407000856ceb5&scope.project.id=ae9fcf4aa3d14c9586664d984a4e366b&role.id=0fab680bc76f4a73826e9beb59e8129b => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:07:41.009224 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0fdaf-8807-493f-86a2-0af0feaa0141 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:41.044720 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a85a6-ec4a-4281-9c3b-77c16a509a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:41.045536 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a85a6-ec4a-4281-9c3b-77c16a509a74 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:41.045818 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a85a6-ec4a-4281-9c3b-77c16a509a74 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:41.046087 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a85a6-ec4a-4281-9c3b-77c16a509a74 None admin] PATH_INFO: `/v3/services/image` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:41.046745 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688a85a6-ec4a-4281-9c3b-77c16a509a74 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:41.048173 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688a85a6-ec4a-4281-9c3b-77c16a509a74 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:41.059871 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-688a85a6-ec4a-4281-9c3b-77c16a509a74 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 07 06:07:41.061137 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 530/1056] 10.222.0.24 () {56 vars in 1105 bytes} [Thu Apr 7 06:07:40 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:41.067388 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a37ad7e-6ce0-4a4f-9427-dd86667e3d98 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:41.171263 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a37ad7e-6ce0-4a4f-9427-dd86667e3d98 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:41.204216 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210f49a1-5407-46e6-8322-33920e3bc25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:41.205152 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f49a1-5407-46e6-8322-33920e3bc25e None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:41.205587 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f49a1-5407-46e6-8322-33920e3bc25e None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:41.206022 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f49a1-5407-46e6-8322-33920e3bc25e None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:41.206878 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210f49a1-5407-46e6-8322-33920e3bc25e None admin] RBAC: Adding query filter params (name=image) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:41.207352 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210f49a1-5407-46e6-8322-33920e3bc25e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:41.209466 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210f49a1-5407-46e6-8322-33920e3bc25e None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:41.214365 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 527/1057] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:07:41 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:41.220281 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a85a6-ec4a-4281-9c3b-77c16a509a74 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:41.315998 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a85a6-ec4a-4281-9c3b-77c16a509a74 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:41.347970 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a0532-409f-4b87-a473-cda8d8306c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:41.349175 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a0532-409f-4b87-a473-cda8d8306c83 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:41.349465 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a0532-409f-4b87-a473-cda8d8306c83 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:41.349743 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a0532-409f-4b87-a473-cda8d8306c83 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:41.350453 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358a0532-409f-4b87-a473-cda8d8306c83 None admin] RBAC: Adding query filter params (type=image) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:41.350762 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358a0532-409f-4b87-a473-cda8d8306c83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:41.352144 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358a0532-409f-4b87-a473-cda8d8306c83 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:41.361610 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 531/1058] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:07:41 2022] GET /identity/v3/services?type=image => generated 350 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:07:41.362541 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210f49a1-5407-46e6-8322-33920e3bc25e None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:41.457647 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210f49a1-5407-46e6-8322-33920e3bc25e None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:41.490410 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ca217a-59ef-483c-aafa-2d127cc17273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:41.491075 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca217a-59ef-483c-aafa-2d127cc17273 None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:41.491362 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca217a-59ef-483c-aafa-2d127cc17273 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:41.491638 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca217a-59ef-483c-aafa-2d127cc17273 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:41.492414 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ca217a-59ef-483c-aafa-2d127cc17273 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:41.493802 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ca217a-59ef-483c-aafa-2d127cc17273 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:41.615777 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 528/1059] 10.222.0.24 () {60 vars in 1144 bytes} [Thu Apr 7 06:07:41 2022] POST /identity/v3/endpoints => generated 327 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:07:42.813884 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f8b5b-cb5f-4847-9bbf-3d5e55f5221d None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:42.814429 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f8b5b-cb5f-4847-9bbf-3d5e55f5221d None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:42.814429 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f8b5b-cb5f-4847-9bbf-3d5e55f5221d None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:42.816063 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 532/1060] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:07:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:07:42.821704 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669ff9a-a92c-4eda-8ba0-392aa62489fd None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:42.822102 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669ff9a-a92c-4eda-8ba0-392aa62489fd None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:42.822309 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669ff9a-a92c-4eda-8ba0-392aa62489fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:42.839866 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-b669ff9a-a92c-4eda-8ba0-392aa62489fd None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:07:42.841051 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b669ff9a-a92c-4eda-8ba0-392aa62489fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:07:42.917527 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 529/1061] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:07:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 07 06:07:42.939656 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f8b5b-cb5f-4847-9bbf-3d5e55f5221d None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:43.037878 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f8b5b-cb5f-4847-9bbf-3d5e55f5221d None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:43.069134 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1351d94e-85fc-4441-aa63-862135f57e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:43.069947 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351d94e-85fc-4441-aa63-862135f57e87 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:43.070228 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351d94e-85fc-4441-aa63-862135f57e87 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:43.070501 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351d94e-85fc-4441-aa63-862135f57e87 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:43.080462 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1351d94e-85fc-4441-aa63-862135f57e87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:07:43.088293 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-1351d94e-85fc-4441-aa63-862135f57e87 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 07 06:07:43.089647 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 533/1062] 10.222.0.24 () {56 vars in 1120 bytes} [Thu Apr 7 06:07:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:43.096773 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669ff9a-a92c-4eda-8ba0-392aa62489fd None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:43.189817 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669ff9a-a92c-4eda-8ba0-392aa62489fd None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:43.221771 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee043b-2e09-450c-ae59-691cbc866826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:43.222437 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee043b-2e09-450c-ae59-691cbc866826 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:43.222718 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee043b-2e09-450c-ae59-691cbc866826 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:43.222988 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee043b-2e09-450c-ae59-691cbc866826 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:43.226277 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee043b-2e09-450c-ae59-691cbc866826 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:43.226592 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee043b-2e09-450c-ae59-691cbc866826 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:43.227990 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee043b-2e09-450c-ae59-691cbc866826 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:43.240898 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 530/1063] 10.222.0.24 () {56 vars in 1115 bytes} [Thu Apr 7 06:07:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:43.242161 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1351d94e-85fc-4441-aa63-862135f57e87 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:43.273654 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4187f8-2f36-4dee-9232-dc7da96474d4 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:43.273965 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4187f8-2f36-4dee-9232-dc7da96474d4 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:43.274215 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4187f8-2f36-4dee-9232-dc7da96474d4 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:43.275886 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 531/1064] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:07:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 07 06:07:43.280765 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be3e93-aa76-41e4-bef1-029f90672792 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:43.281049 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be3e93-aa76-41e4-bef1-029f90672792 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:43.281322 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be3e93-aa76-41e4-bef1-029f90672792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:43.297836 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-51be3e93-aa76-41e4-bef1-029f90672792 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:07:43.298932 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-51be3e93-aa76-41e4-bef1-029f90672792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:07:43.341537 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1351d94e-85fc-4441-aa63-862135f57e87 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:43.374062 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 532/1065] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:07:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 07 06:07:43.380403 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c8b8f-aa85-4beb-9b79-69e94b6e38ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:43.381426 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c8b8f-aa85-4beb-9b79-69e94b6e38ae None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:43.381899 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c8b8f-aa85-4beb-9b79-69e94b6e38ae None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:43.382353 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c8b8f-aa85-4beb-9b79-69e94b6e38ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:43.392396 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556c8b8f-aa85-4beb-9b79-69e94b6e38ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:43.394052 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556c8b8f-aa85-4beb-9b79-69e94b6e38ae None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:43.396665 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be3e93-aa76-41e4-bef1-029f90672792 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:43.411847 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-556c8b8f-aa85-4beb-9b79-69e94b6e38ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:07:43.417784 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 534/1066] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:07:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:43.418450 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c8b8f-aa85-4beb-9b79-69e94b6e38ae None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:43.490990 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be3e93-aa76-41e4-bef1-029f90672792 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:43.524808 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed49d82-b199-43f4-8cac-21d3f738012c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:43.525003 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c8b8f-aa85-4beb-9b79-69e94b6e38ae None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:43.525602 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed49d82-b199-43f4-8cac-21d3f738012c None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:43.525883 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed49d82-b199-43f4-8cac-21d3f738012c None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:43.526156 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed49d82-b199-43f4-8cac-21d3f738012c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:43.535914 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed49d82-b199-43f4-8cac-21d3f738012c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:07:43.542795 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-8ed49d82-b199-43f4-8cac-21d3f738012c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 07 06:07:43.544383 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 533/1067] 10.222.0.24 () {56 vars in 1096 bytes} [Thu Apr 7 06:07:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 07 06:07:43.551910 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed49d82-b199-43f4-8cac-21d3f738012c None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:43.564029 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bb866b-e598-43ec-b563-9b8ae78f41f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:43.564773 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb866b-e598-43ec-b563-9b8ae78f41f4 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:43.565057 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb866b-e598-43ec-b563-9b8ae78f41f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:43.565331 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb866b-e598-43ec-b563-9b8ae78f41f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:43.566068 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bb866b-e598-43ec-b563-9b8ae78f41f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:43.566375 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bb866b-e598-43ec-b563-9b8ae78f41f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:43.568397 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bb866b-e598-43ec-b563-9b8ae78f41f4 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:43.581531 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 535/1068] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:07:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:07:43.586738 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bb866b-e598-43ec-b563-9b8ae78f41f4 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:43.652175 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed49d82-b199-43f4-8cac-21d3f738012c None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:43.682922 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bb866b-e598-43ec-b563-9b8ae78f41f4 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:43.684813 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4204fce-9d93-47a6-8d0d-a789842d4b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:43.685514 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4204fce-9d93-47a6-8d0d-a789842d4b30 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:43.685801 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4204fce-9d93-47a6-8d0d-a789842d4b30 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:43.686077 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4204fce-9d93-47a6-8d0d-a789842d4b30 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:43.686831 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4204fce-9d93-47a6-8d0d-a789842d4b30 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:43.687140 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4204fce-9d93-47a6-8d0d-a789842d4b30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:43.688581 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4204fce-9d93-47a6-8d0d-a789842d4b30 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:43.696622 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 534/1069] 10.222.0.24 () {56 vars in 1099 bytes} [Thu Apr 7 06:07:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:07:43.702177 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4204fce-9d93-47a6-8d0d-a789842d4b30 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:43.721229 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a9461-fc4f-4ad9-8867-e52d836c5797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:43.722027 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a9461-fc4f-4ad9-8867-e52d836c5797 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:43.722312 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a9461-fc4f-4ad9-8867-e52d836c5797 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:43.722588 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a9461-fc4f-4ad9-8867-e52d836c5797 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:43.730201 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a9461-fc4f-4ad9-8867-e52d836c5797 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:43.731627 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a9461-fc4f-4ad9-8867-e52d836c5797 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:43.745574 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-672a9461-fc4f-4ad9-8867-e52d836c5797 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 07 06:07:43.747170 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 536/1070] 10.222.0.24 () {56 vars in 1093 bytes} [Thu Apr 7 06:07:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 07 06:07:43.752642 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a9461-fc4f-4ad9-8867-e52d836c5797 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:43.804111 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4204fce-9d93-47a6-8d0d-a789842d4b30 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:43.837655 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145f6f5-2182-4246-809f-81316b8e41e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:43.838525 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145f6f5-2182-4246-809f-81316b8e41e4 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:43.838806 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145f6f5-2182-4246-809f-81316b8e41e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:43.839079 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145f6f5-2182-4246-809f-81316b8e41e4 None admin] PATH_INFO: `/v3/users/e83959783919439aa58407000856ceb5` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:43.840336 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0145f6f5-2182-4246-809f-81316b8e41e4 None admin] RBAC: Authorizing `identity:get_user(user_id=e83959783919439aa58407000856ceb5)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:43.841777 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0145f6f5-2182-4246-809f-81316b8e41e4 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:43.843441 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 535/1071] 10.222.0.24 () {56 vars in 1177 bytes} [Thu Apr 7 06:07:43 2022] GET /identity/v3/users/e83959783919439aa58407000856ceb5 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:07:43.849057 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145f6f5-2182-4246-809f-81316b8e41e4 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:43.858455 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a9461-fc4f-4ad9-8867-e52d836c5797 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:43.892689 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de726a3-7755-46af-9b64-ceab620eb537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:43.893373 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de726a3-7755-46af-9b64-ceab620eb537 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:43.893660 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de726a3-7755-46af-9b64-ceab620eb537 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:43.893953 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de726a3-7755-46af-9b64-ceab620eb537 None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:43.894802 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de726a3-7755-46af-9b64-ceab620eb537 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:43.895097 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de726a3-7755-46af-9b64-ceab620eb537 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:43.897068 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de726a3-7755-46af-9b64-ceab620eb537 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:43.913985 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 537/1072] 10.222.0.24 () {56 vars in 1133 bytes} [Thu Apr 7 06:07:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:07:43.919843 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de726a3-7755-46af-9b64-ceab620eb537 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:43.949812 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145f6f5-2182-4246-809f-81316b8e41e4 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:44.048090 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71caf78-cd74-4ddb-9fba-410d7bcad4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:44.048939 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71caf78-cd74-4ddb-9fba-410d7bcad4e5 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:44.049226 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71caf78-cd74-4ddb-9fba-410d7bcad4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:44.049499 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71caf78-cd74-4ddb-9fba-410d7bcad4e5 None admin] PATH_INFO: `/v3/projects/ae9fcf4aa3d14c9586664d984a4e366b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:44.050666 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71caf78-cd74-4ddb-9fba-410d7bcad4e5 None admin] RBAC: Authorizing `identity:get_project(project_id=ae9fcf4aa3d14c9586664d984a4e366b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:44.052645 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71caf78-cd74-4ddb-9fba-410d7bcad4e5 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:44.054400 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 536/1073] 10.222.0.24 () {56 vars in 1186 bytes} [Thu Apr 7 06:07:43 2022] GET /identity/v3/projects/ae9fcf4aa3d14c9586664d984a4e366b => generated 311 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:07:44.055535 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd297142-f73d-4004-a2dc-397a05d05051 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:44.055844 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd297142-f73d-4004-a2dc-397a05d05051 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:44.056126 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd297142-f73d-4004-a2dc-397a05d05051 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:44.057348 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 537/1074] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:07:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:07:44.060573 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd297142-f73d-4004-a2dc-397a05d05051 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:44.081029 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de726a3-7755-46af-9b64-ceab620eb537 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:44.185343 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9936bb4a-12ce-4713-b7b9-32412e202215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:44.186136 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9936bb4a-12ce-4713-b7b9-32412e202215 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:44.186420 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9936bb4a-12ce-4713-b7b9-32412e202215 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:44.186690 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9936bb4a-12ce-4713-b7b9-32412e202215 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:44.196784 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9936bb4a-12ce-4713-b7b9-32412e202215 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:44.198324 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9936bb4a-12ce-4713-b7b9-32412e202215 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:44.214560 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-9936bb4a-12ce-4713-b7b9-32412e202215 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:07:44.215757 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 538/1075] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:07:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:44.220774 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857820e-5669-4402-8892-22fb1d09037f None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:44.220774 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857820e-5669-4402-8892-22fb1d09037f None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:44.220774 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857820e-5669-4402-8892-22fb1d09037f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:44.233346 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-c857820e-5669-4402-8892-22fb1d09037f None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:07:44.234526 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c857820e-5669-4402-8892-22fb1d09037f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:07:44.252610 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd297142-f73d-4004-a2dc-397a05d05051 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:44.284128 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f86fe0b-1ad0-4945-9d26-f78fa2ea9315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:44.285022 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86fe0b-1ad0-4945-9d26-f78fa2ea9315 None admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:44.285305 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86fe0b-1ad0-4945-9d26-f78fa2ea9315 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:44.285578 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86fe0b-1ad0-4945-9d26-f78fa2ea9315 None admin] PATH_INFO: `/v3/projects/ae9fcf4aa3d14c9586664d984a4e366b/users/e83959783919439aa58407000856ceb5/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:44.288090 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f86fe0b-1ad0-4945-9d26-f78fa2ea9315 None admin] RBAC: Authorizing `identity:create_grant(project_id=ae9fcf4aa3d14c9586664d984a4e366b, user_id=e83959783919439aa58407000856ceb5, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:44.289525 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f86fe0b-1ad0-4945-9d26-f78fa2ea9315 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:44.297733 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 539/1076] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:07:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 07 06:07:44.298600 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857820e-5669-4402-8892-22fb1d09037f None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:44.374846 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 538/1077] 10.222.0.24 () {58 vars in 1439 bytes} [Thu Apr 7 06:07:44 2022] PUT /identity/v3/projects/ae9fcf4aa3d14c9586664d984a4e366b/users/e83959783919439aa58407000856ceb5/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:07:44.375602 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f86fe0b-1ad0-4945-9d26-f78fa2ea9315 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:44.394321 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857820e-5669-4402-8892-22fb1d09037f None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:44.431620 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07feaba8-1979-49ff-ae08-1d988b9ad903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:44.432349 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07feaba8-1979-49ff-ae08-1d988b9ad903 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:44.432638 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07feaba8-1979-49ff-ae08-1d988b9ad903 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:44.432917 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07feaba8-1979-49ff-ae08-1d988b9ad903 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:44.433672 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07feaba8-1979-49ff-ae08-1d988b9ad903 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:44.433984 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07feaba8-1979-49ff-ae08-1d988b9ad903 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:44.435453 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07feaba8-1979-49ff-ae08-1d988b9ad903 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:44.452631 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 540/1078] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:07:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:44.453501 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07feaba8-1979-49ff-ae08-1d988b9ad903 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:44.482311 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f86fe0b-1ad0-4945-9d26-f78fa2ea9315 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:44.519588 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e185f069-785f-4c2c-b6bd-4fa485c45d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:44.520848 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185f069-785f-4c2c-b6bd-4fa485c45d11 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:44.521144 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185f069-785f-4c2c-b6bd-4fa485c45d11 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:44.521500 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185f069-785f-4c2c-b6bd-4fa485c45d11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:44.556816 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07feaba8-1979-49ff-ae08-1d988b9ad903 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:44.590833 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad6def7-b76b-4263-99b0-561f8625cdd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:44.591638 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6def7-b76b-4263-99b0-561f8625cdd7 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:44.591953 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6def7-b76b-4263-99b0-561f8625cdd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:44.592232 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6def7-b76b-4263-99b0-561f8625cdd7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:44.593305 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e185f069-785f-4c2c-b6bd-4fa485c45d11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:44.594914 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e185f069-785f-4c2c-b6bd-4fa485c45d11 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:44.599450 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad6def7-b76b-4263-99b0-561f8625cdd7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:44.600914 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad6def7-b76b-4263-99b0-561f8625cdd7 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:44.614611 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-8ad6def7-b76b-4263-99b0-561f8625cdd7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 07 06:07:44.615993 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 541/1079] 10.222.0.24 () {56 vars in 1111 bytes} [Thu Apr 7 06:07:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 07 06:07:44.621393 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad6def7-b76b-4263-99b0-561f8625cdd7 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:44.694892 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 539/1080] 10.222.0.24 () {58 vars in 1282 bytes} [Thu Apr 7 06:07:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 07 06:07:44.701858 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e185f069-785f-4c2c-b6bd-4fa485c45d11 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:44.724338 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad6def7-b76b-4263-99b0-561f8625cdd7 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:44.757135 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a128a-6477-4122-8684-ce025afeb5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:44.758144 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a128a-6477-4122-8684-ce025afeb5c6 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:44.758645 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a128a-6477-4122-8684-ce025afeb5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:44.759127 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a128a-6477-4122-8684-ce025afeb5c6 None admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:44.760160 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633a128a-6477-4122-8684-ce025afeb5c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:44.760702 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633a128a-6477-4122-8684-ce025afeb5c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:44.762326 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633a128a-6477-4122-8684-ce025afeb5c6 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:44.779401 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 542/1081] 10.222.0.24 () {56 vars in 1148 bytes} [Thu Apr 7 06:07:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:07:44.780611 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a128a-6477-4122-8684-ce025afeb5c6 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:44.810589 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e185f069-785f-4c2c-b6bd-4fa485c45d11 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:44.844431 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7216cd-8ed0-4e97-9372-ce722498ea24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:44.845031 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7216cd-8ed0-4e97-9372-ce722498ea24 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:44.845277 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7216cd-8ed0-4e97-9372-ce722498ea24 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:44.845531 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7216cd-8ed0-4e97-9372-ce722498ea24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:44.855989 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7216cd-8ed0-4e97-9372-ce722498ea24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:44.857470 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7216cd-8ed0-4e97-9372-ce722498ea24 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:44.874099 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-be7216cd-8ed0-4e97-9372-ce722498ea24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:07:44.880529 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 540/1082] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:07:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 07 06:07:44.880681 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a128a-6477-4122-8684-ce025afeb5c6 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:44.881590 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7216cd-8ed0-4e97-9372-ce722498ea24 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:44.913279 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d41b7a-8f19-44e7-899a-bd8e65152fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:44.914447 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d41b7a-8f19-44e7-899a-bd8e65152fcc None admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:44.914736 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d41b7a-8f19-44e7-899a-bd8e65152fcc None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:44.915015 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d41b7a-8f19-44e7-899a-bd8e65152fcc None admin] PATH_INFO: `/v3/projects/de88f2c333ae49cfa7fff7fa1ed0022c/users/02cd81f6620f410db450871fb29961f6/roles/db6da2a870e5446690e2385bf7da6f59` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:44.917273 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d41b7a-8f19-44e7-899a-bd8e65152fcc None admin] RBAC: Authorizing `identity:create_grant(project_id=de88f2c333ae49cfa7fff7fa1ed0022c, user_id=02cd81f6620f410db450871fb29961f6, role_id=db6da2a870e5446690e2385bf7da6f59)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:44.918691 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d41b7a-8f19-44e7-899a-bd8e65152fcc None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:44.981805 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7216cd-8ed0-4e97-9372-ce722498ea24 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:44.996528 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 543/1083] 10.222.0.24 () {58 vars in 1439 bytes} [Thu Apr 7 06:07:44 2022] PUT /identity/v3/projects/de88f2c333ae49cfa7fff7fa1ed0022c/users/02cd81f6620f410db450871fb29961f6/roles/db6da2a870e5446690e2385bf7da6f59 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:07:45.017399 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33600596-83e7-44eb-bf19-8937d2f8134c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:45.018134 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33600596-83e7-44eb-bf19-8937d2f8134c None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:45.018424 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33600596-83e7-44eb-bf19-8937d2f8134c None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:45.018698 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33600596-83e7-44eb-bf19-8937d2f8134c None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:45.019447 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33600596-83e7-44eb-bf19-8937d2f8134c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:45.019781 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33600596-83e7-44eb-bf19-8937d2f8134c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:45.021769 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33600596-83e7-44eb-bf19-8937d2f8134c None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:45.034530 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 541/1084] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:07:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:46.670379 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c1bbe-d78e-46f9-910b-a1c638ee0330 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:46.670920 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c1bbe-d78e-46f9-910b-a1c638ee0330 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:46.670920 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c1bbe-d78e-46f9-910b-a1c638ee0330 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:46.672340 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 544/1085] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:07:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:07:46.678330 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d7024-a38d-4496-8ca4-51a8f4140378 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:46.678750 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d7024-a38d-4496-8ca4-51a8f4140378 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:46.678888 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d7024-a38d-4496-8ca4-51a8f4140378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:46.694944 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-1b7d7024-a38d-4496-8ca4-51a8f4140378 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:07:46.696137 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-1b7d7024-a38d-4496-8ca4-51a8f4140378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:07:46.758871 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 542/1086] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:07:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 07 06:07:46.783330 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c1bbe-d78e-46f9-910b-a1c638ee0330 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:46.879538 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c1bbe-d78e-46f9-910b-a1c638ee0330 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:46.913531 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef573b-de49-4910-999f-d69b42102ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:46.914327 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef573b-de49-4910-999f-d69b42102ec2 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:46.914613 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef573b-de49-4910-999f-d69b42102ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:46.914893 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef573b-de49-4910-999f-d69b42102ec2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:46.926962 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef573b-de49-4910-999f-d69b42102ec2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:07:46.933980 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-49ef573b-de49-4910-999f-d69b42102ec2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 07 06:07:46.935281 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 545/1087] 10.222.0.24 () {56 vars in 1096 bytes} [Thu Apr 7 06:07:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:46.941563 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d7024-a38d-4496-8ca4-51a8f4140378 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:47.035545 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d7024-a38d-4496-8ca4-51a8f4140378 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:47.067868 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb497d51-8e16-4ff3-b213-80fd883bf30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:47.068539 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb497d51-8e16-4ff3-b213-80fd883bf30d None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:47.068826 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb497d51-8e16-4ff3-b213-80fd883bf30d None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:47.069105 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb497d51-8e16-4ff3-b213-80fd883bf30d None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:47.069851 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb497d51-8e16-4ff3-b213-80fd883bf30d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:47.070163 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb497d51-8e16-4ff3-b213-80fd883bf30d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:47.071527 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb497d51-8e16-4ff3-b213-80fd883bf30d None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:47.079300 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 543/1088] 10.222.0.24 () {56 vars in 1099 bytes} [Thu Apr 7 06:07:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:47.085870 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef573b-de49-4910-999f-d69b42102ec2 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:47.181328 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef573b-de49-4910-999f-d69b42102ec2 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:47.213767 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d63aae8-9482-43df-8fe2-81946d7f597d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:47.214631 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d63aae8-9482-43df-8fe2-81946d7f597d None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:47.214910 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d63aae8-9482-43df-8fe2-81946d7f597d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:47.215183 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d63aae8-9482-43df-8fe2-81946d7f597d None admin] PATH_INFO: `/v3/users/e83959783919439aa58407000856ceb5` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:47.216377 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d63aae8-9482-43df-8fe2-81946d7f597d None admin] RBAC: Authorizing `identity:get_user(user_id=e83959783919439aa58407000856ceb5)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:47.217813 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d63aae8-9482-43df-8fe2-81946d7f597d None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:47.219438 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 546/1089] 10.222.0.24 () {56 vars in 1177 bytes} [Thu Apr 7 06:07:47 2022] GET /identity/v3/users/e83959783919439aa58407000856ceb5 => generated 285 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:47.225158 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb497d51-8e16-4ff3-b213-80fd883bf30d None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:47.300368 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f3e95-382d-40d1-8a33-6f6654b6f989 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:47.300659 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f3e95-382d-40d1-8a33-6f6654b6f989 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:47.300941 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f3e95-382d-40d1-8a33-6f6654b6f989 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:47.302369 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 547/1090] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:07:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 07 06:07:47.307282 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170d7f1-904b-4afd-b71a-ad30885dfdd3 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:47.307574 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170d7f1-904b-4afd-b71a-ad30885dfdd3 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:47.307886 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170d7f1-904b-4afd-b71a-ad30885dfdd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:47.318910 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb497d51-8e16-4ff3-b213-80fd883bf30d None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:47.324331 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-6170d7f1-904b-4afd-b71a-ad30885dfdd3 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:07:47.325509 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-6170d7f1-904b-4afd-b71a-ad30885dfdd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:07:47.350418 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4077dd-6e7d-4f0a-b5f0-6dc819b494fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:47.351082 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4077dd-6e7d-4f0a-b5f0-6dc819b494fe None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:47.351350 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4077dd-6e7d-4f0a-b5f0-6dc819b494fe None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:47.351623 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4077dd-6e7d-4f0a-b5f0-6dc819b494fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:47.396611 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 548/1091] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:07:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 07 06:07:47.416787 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4077dd-6e7d-4f0a-b5f0-6dc819b494fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:47.418236 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4077dd-6e7d-4f0a-b5f0-6dc819b494fe None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:47.421327 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170d7f1-904b-4afd-b71a-ad30885dfdd3 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:47.510725 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 544/1092] 10.222.0.24 () {58 vars in 1282 bytes} [Thu Apr 7 06:07:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 07 06:07:47.513075 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170d7f1-904b-4afd-b71a-ad30885dfdd3 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:47.516601 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4077dd-6e7d-4f0a-b5f0-6dc819b494fe None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:47.544645 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cce1ee4-5f71-4d55-bc86-63b5bb21a4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:47.545451 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce1ee4-5f71-4d55-bc86-63b5bb21a4af None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:47.545735 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce1ee4-5f71-4d55-bc86-63b5bb21a4af None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:47.546008 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce1ee4-5f71-4d55-bc86-63b5bb21a4af None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:47.556008 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cce1ee4-5f71-4d55-bc86-63b5bb21a4af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:07:47.563343 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-8cce1ee4-5f71-4d55-bc86-63b5bb21a4af None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 07 06:07:47.564672 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 549/1093] 10.222.0.24 () {56 vars in 1120 bytes} [Thu Apr 7 06:07:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 07 06:07:47.570962 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cce1ee4-5f71-4d55-bc86-63b5bb21a4af None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:47.607430 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4077dd-6e7d-4f0a-b5f0-6dc819b494fe None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:47.640561 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab32b35-4b15-438a-8572-684151511aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:47.641422 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab32b35-4b15-438a-8572-684151511aed None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:47.641702 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab32b35-4b15-438a-8572-684151511aed None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:47.641977 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab32b35-4b15-438a-8572-684151511aed None admin] PATH_INFO: `/v3/projects/ae9fcf4aa3d14c9586664d984a4e366b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:47.643150 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab32b35-4b15-438a-8572-684151511aed None admin] RBAC: Authorizing `identity:get_project(project_id=ae9fcf4aa3d14c9586664d984a4e366b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:47.644623 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab32b35-4b15-438a-8572-684151511aed None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:47.646488 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 545/1094] 10.222.0.24 () {56 vars in 1186 bytes} [Thu Apr 7 06:07:47 2022] GET /identity/v3/projects/ae9fcf4aa3d14c9586664d984a4e366b => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:47.652244 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab32b35-4b15-438a-8572-684151511aed None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:47.662695 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cce1ee4-5f71-4d55-bc86-63b5bb21a4af None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:47.694458 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28a11b-f9e9-4161-a900-fdc83f391d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:47.695115 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28a11b-f9e9-4161-a900-fdc83f391d57 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:47.695403 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28a11b-f9e9-4161-a900-fdc83f391d57 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:47.695675 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28a11b-f9e9-4161-a900-fdc83f391d57 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:47.696436 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a28a11b-f9e9-4161-a900-fdc83f391d57 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:47.696741 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a28a11b-f9e9-4161-a900-fdc83f391d57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:47.698075 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a28a11b-f9e9-4161-a900-fdc83f391d57 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:47.705539 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 550/1095] 10.222.0.24 () {56 vars in 1115 bytes} [Thu Apr 7 06:07:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:07:47.711105 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28a11b-f9e9-4161-a900-fdc83f391d57 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:47.744938 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab32b35-4b15-438a-8572-684151511aed None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:47.778126 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53980ea1-c233-4cae-b08c-42ef5aacff1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:47.778778 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53980ea1-c233-4cae-b08c-42ef5aacff1f None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:47.779065 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53980ea1-c233-4cae-b08c-42ef5aacff1f None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:47.779337 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53980ea1-c233-4cae-b08c-42ef5aacff1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:47.780199 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53980ea1-c233-4cae-b08c-42ef5aacff1f None admin] RBAC: Adding query filter params (role.id=0fab680bc76f4a73826e9beb59e8129b, scope.project.id=ae9fcf4aa3d14c9586664d984a4e366b, user.id=e83959783919439aa58407000856ceb5) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:47.780508 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53980ea1-c233-4cae-b08c-42ef5aacff1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:47.781928 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53980ea1-c233-4cae-b08c-42ef5aacff1f None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:47.787534 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 546/1096] 10.222.0.24 () {56 vars in 1374 bytes} [Thu Apr 7 06:07:47 2022] GET /identity/v3/role_assignments?user.id=e83959783919439aa58407000856ceb5&scope.project.id=ae9fcf4aa3d14c9586664d984a4e366b&role.id=0fab680bc76f4a73826e9beb59e8129b => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:07:47.806525 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28a11b-f9e9-4161-a900-fdc83f391d57 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:47.841353 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb90511-5732-4905-8394-53974b80a39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:47.842172 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb90511-5732-4905-8394-53974b80a39e None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:47.842457 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb90511-5732-4905-8394-53974b80a39e None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:47.842730 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb90511-5732-4905-8394-53974b80a39e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:47.854993 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb90511-5732-4905-8394-53974b80a39e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:47.856492 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb90511-5732-4905-8394-53974b80a39e None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:47.874330 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-bbb90511-5732-4905-8394-53974b80a39e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:07:47.875717 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 551/1097] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:07:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 07 06:07:47.881644 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53980ea1-c233-4cae-b08c-42ef5aacff1f None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:47.986653 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53980ea1-c233-4cae-b08c-42ef5aacff1f None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:48.019967 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb74b4-00f7-4f49-b0a8-1291a1eb92da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:48.021288 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb74b4-00f7-4f49-b0a8-1291a1eb92da None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:48.021522 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb74b4-00f7-4f49-b0a8-1291a1eb92da None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:48.021793 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb74b4-00f7-4f49-b0a8-1291a1eb92da None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:48.022513 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fb74b4-00f7-4f49-b0a8-1291a1eb92da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:48.022817 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fb74b4-00f7-4f49-b0a8-1291a1eb92da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:48.024202 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fb74b4-00f7-4f49-b0a8-1291a1eb92da None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:48.035119 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 547/1098] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:07:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:48.040869 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb90511-5732-4905-8394-53974b80a39e None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:48.136514 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb90511-5732-4905-8394-53974b80a39e None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:48.168180 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838c5e6-8996-4157-ae20-78436df3c24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:48.168963 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838c5e6-8996-4157-ae20-78436df3c24c None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:48.169245 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838c5e6-8996-4157-ae20-78436df3c24c None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:48.169516 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838c5e6-8996-4157-ae20-78436df3c24c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:48.177476 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e838c5e6-8996-4157-ae20-78436df3c24c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:48.178996 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e838c5e6-8996-4157-ae20-78436df3c24c None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:48.191682 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-e838c5e6-8996-4157-ae20-78436df3c24c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 07 06:07:48.192973 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 552/1099] 10.222.0.24 () {56 vars in 1093 bytes} [Thu Apr 7 06:07:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:48.198809 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb74b4-00f7-4f49-b0a8-1291a1eb92da None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:48.293603 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb74b4-00f7-4f49-b0a8-1291a1eb92da None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:48.324591 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df89133-fde9-4b34-a527-f115f4d3b06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:48.325253 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df89133-fde9-4b34-a527-f115f4d3b06f None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:48.325539 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df89133-fde9-4b34-a527-f115f4d3b06f None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:48.325813 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df89133-fde9-4b34-a527-f115f4d3b06f None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:48.326636 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df89133-fde9-4b34-a527-f115f4d3b06f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:48.326943 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df89133-fde9-4b34-a527-f115f4d3b06f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:48.328396 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df89133-fde9-4b34-a527-f115f4d3b06f None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:48.345094 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 548/1100] 10.222.0.24 () {56 vars in 1133 bytes} [Thu Apr 7 06:07:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:48.350793 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838c5e6-8996-4157-ae20-78436df3c24c None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:48.443349 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838c5e6-8996-4157-ae20-78436df3c24c None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:48.474361 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c7918d-a94a-4213-a8a8-973292999653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:48.475007 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7918d-a94a-4213-a8a8-973292999653 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:48.475291 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7918d-a94a-4213-a8a8-973292999653 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:48.475568 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7918d-a94a-4213-a8a8-973292999653 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:48.538245 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c7918d-a94a-4213-a8a8-973292999653 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:48.539678 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c7918d-a94a-4213-a8a8-973292999653 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:48.631519 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 553/1101] 10.222.0.24 () {58 vars in 1282 bytes} [Thu Apr 7 06:07:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 07 06:07:48.637071 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df89133-fde9-4b34-a527-f115f4d3b06f None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:48.729542 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df89133-fde9-4b34-a527-f115f4d3b06f None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:48.762692 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01783c1-90f0-4aff-9a3a-9d9e99aa795d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:48.763495 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01783c1-90f0-4aff-9a3a-9d9e99aa795d None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:48.763820 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01783c1-90f0-4aff-9a3a-9d9e99aa795d None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:48.764103 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01783c1-90f0-4aff-9a3a-9d9e99aa795d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:48.774919 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01783c1-90f0-4aff-9a3a-9d9e99aa795d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:48.776410 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01783c1-90f0-4aff-9a3a-9d9e99aa795d None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:48.792614 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-b01783c1-90f0-4aff-9a3a-9d9e99aa795d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:07:48.793805 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 549/1102] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:07:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:48.799377 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c7918d-a94a-4213-a8a8-973292999653 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:48.891644 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c7918d-a94a-4213-a8a8-973292999653 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:48.923903 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1966e2-f083-44df-85eb-b6af47df8e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:48.924583 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1966e2-f083-44df-85eb-b6af47df8e1f None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:48.924864 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1966e2-f083-44df-85eb-b6af47df8e1f None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:48.925135 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1966e2-f083-44df-85eb-b6af47df8e1f None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:48.925864 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1966e2-f083-44df-85eb-b6af47df8e1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:48.926167 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1966e2-f083-44df-85eb-b6af47df8e1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:48.928407 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1966e2-f083-44df-85eb-b6af47df8e1f None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:48.941643 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 554/1103] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:07:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:48.947913 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01783c1-90f0-4aff-9a3a-9d9e99aa795d None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:49.043536 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01783c1-90f0-4aff-9a3a-9d9e99aa795d None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:49.077098 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699e8411-6236-4c84-b166-68cb9b25e47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:49.077874 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e8411-6236-4c84-b166-68cb9b25e47f None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:49.078157 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e8411-6236-4c84-b166-68cb9b25e47f None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:49.078425 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e8411-6236-4c84-b166-68cb9b25e47f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:49.084792 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699e8411-6236-4c84-b166-68cb9b25e47f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:49.086227 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699e8411-6236-4c84-b166-68cb9b25e47f None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:49.098630 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-699e8411-6236-4c84-b166-68cb9b25e47f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 07 06:07:49.099794 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 550/1104] 10.222.0.24 () {56 vars in 1111 bytes} [Thu Apr 7 06:07:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:07:49.105615 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1966e2-f083-44df-85eb-b6af47df8e1f None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:49.198682 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1966e2-f083-44df-85eb-b6af47df8e1f None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:49.229457 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88696bb5-631a-48c9-8b4d-d1dc2e15c20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:49.230102 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88696bb5-631a-48c9-8b4d-d1dc2e15c20b None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:49.230383 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88696bb5-631a-48c9-8b4d-d1dc2e15c20b None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:49.230653 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88696bb5-631a-48c9-8b4d-d1dc2e15c20b None admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:49.231426 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88696bb5-631a-48c9-8b4d-d1dc2e15c20b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:49.231727 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88696bb5-631a-48c9-8b4d-d1dc2e15c20b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:49.233175 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88696bb5-631a-48c9-8b4d-d1dc2e15c20b None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:49.245215 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 555/1105] 10.222.0.24 () {56 vars in 1148 bytes} [Thu Apr 7 06:07:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:49.251237 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699e8411-6236-4c84-b166-68cb9b25e47f None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:49.347471 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699e8411-6236-4c84-b166-68cb9b25e47f None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:49.380694 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b6771-adac-41da-9525-e377844cf7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:49.381343 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b6771-adac-41da-9525-e377844cf7f6 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:49.381628 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b6771-adac-41da-9525-e377844cf7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:49.381903 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b6771-adac-41da-9525-e377844cf7f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:49.382732 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b6771-adac-41da-9525-e377844cf7f6 None admin] RBAC: Adding query filter params (role.id=db6da2a870e5446690e2385bf7da6f59, scope.project.id=de88f2c333ae49cfa7fff7fa1ed0022c, user.id=02cd81f6620f410db450871fb29961f6) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:49.383048 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b6771-adac-41da-9525-e377844cf7f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:49.384514 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b6771-adac-41da-9525-e377844cf7f6 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:49.390183 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 551/1106] 10.222.0.24 () {56 vars in 1374 bytes} [Thu Apr 7 06:07:49 2022] GET /identity/v3/role_assignments?user.id=02cd81f6620f410db450871fb29961f6&scope.project.id=de88f2c333ae49cfa7fff7fa1ed0022c&role.id=db6da2a870e5446690e2385bf7da6f59 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:50.094776 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad0a1a-8c54-4cc2-a5ce-fbb5cac7be8b None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:50.095318 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad0a1a-8c54-4cc2-a5ce-fbb5cac7be8b None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:50.095318 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad0a1a-8c54-4cc2-a5ce-fbb5cac7be8b None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:50.096736 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 556/1107] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:07:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:07:50.103075 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46a1e2-f1a1-438d-b239-d7e3f1c94f0a None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:50.103489 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46a1e2-f1a1-438d-b239-d7e3f1c94f0a None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:50.103662 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46a1e2-f1a1-438d-b239-d7e3f1c94f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:50.120873 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-3e46a1e2-f1a1-438d-b239-d7e3f1c94f0a None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:07:50.122082 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-3e46a1e2-f1a1-438d-b239-d7e3f1c94f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:07:50.186070 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 552/1108] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:07:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 07 06:07:50.213233 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad0a1a-8c54-4cc2-a5ce-fbb5cac7be8b None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:50.308703 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad0a1a-8c54-4cc2-a5ce-fbb5cac7be8b None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:50.340513 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f1f5c-4cf7-43ed-8fd4-de9ad10b1ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:50.341295 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f1f5c-4cf7-43ed-8fd4-de9ad10b1ff8 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:50.341576 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f1f5c-4cf7-43ed-8fd4-de9ad10b1ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:50.341847 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f1f5c-4cf7-43ed-8fd4-de9ad10b1ff8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:50.342994 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3f1f5c-4cf7-43ed-8fd4-de9ad10b1ff8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:50.344456 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3f1f5c-4cf7-43ed-8fd4-de9ad10b1ff8 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:50.346109 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 557/1109] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:07:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:50.351819 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46a1e2-f1a1-438d-b239-d7e3f1c94f0a None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:50.444270 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46a1e2-f1a1-438d-b239-d7e3f1c94f0a None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:50.476539 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91411460-e9f4-4b62-b7e7-726b1831b3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:50.477201 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91411460-e9f4-4b62-b7e7-726b1831b3d9 None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:50.477486 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91411460-e9f4-4b62-b7e7-726b1831b3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:50.477759 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91411460-e9f4-4b62-b7e7-726b1831b3d9 None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:50.478469 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91411460-e9f4-4b62-b7e7-726b1831b3d9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:50.479915 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91411460-e9f4-4b62-b7e7-726b1831b3d9 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:50.550900 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 553/1110] 10.222.0.24 () {60 vars in 1132 bytes} [Thu Apr 7 06:07:50 2022] POST /identity/v3/users => generated 286 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:07:52.836722 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e460c41-269e-4608-b3bc-93c4e6ecd15c None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:52.837238 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e460c41-269e-4608-b3bc-93c4e6ecd15c None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:52.837338 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e460c41-269e-4608-b3bc-93c4e6ecd15c None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:52.838640 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 558/1111] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:07:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:07:52.843824 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466fc1b-1716-4f4e-a00b-517cccf1a48f None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:52.844201 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466fc1b-1716-4f4e-a00b-517cccf1a48f None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:52.844391 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466fc1b-1716-4f4e-a00b-517cccf1a48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:52.860466 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-4466fc1b-1716-4f4e-a00b-517cccf1a48f None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:07:52.861639 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-4466fc1b-1716-4f4e-a00b-517cccf1a48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:07:52.923817 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 554/1112] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:07:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 07 06:07:52.948898 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e460c41-269e-4608-b3bc-93c4e6ecd15c None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:53.044013 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e460c41-269e-4608-b3bc-93c4e6ecd15c None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:53.076509 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb60edd-a904-4776-b587-7fdae6a3109c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:53.077352 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb60edd-a904-4776-b587-7fdae6a3109c None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:53.077638 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb60edd-a904-4776-b587-7fdae6a3109c None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:53.077914 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb60edd-a904-4776-b587-7fdae6a3109c None admin] PATH_INFO: `/v3/roles/7ad9776ea3b0430cb02c4599d037c8be` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:53.079366 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb60edd-a904-4776-b587-7fdae6a3109c None admin] RBAC: Authorizing `identity:get_role(role_id=7ad9776ea3b0430cb02c4599d037c8be)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:53.080752 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb60edd-a904-4776-b587-7fdae6a3109c None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:53.082110 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 559/1113] 10.222.0.24 () {56 vars in 1177 bytes} [Thu Apr 7 06:07:52 2022] GET /identity/v3/roles/7ad9776ea3b0430cb02c4599d037c8be => generated 223 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:53.088045 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4466fc1b-1716-4f4e-a00b-517cccf1a48f None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:53.181382 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4466fc1b-1716-4f4e-a00b-517cccf1a48f None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:53.212877 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7027a2df-cc92-4b97-a8d3-ef5fb0a39616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:53.213767 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7027a2df-cc92-4b97-a8d3-ef5fb0a39616 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:53.214049 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7027a2df-cc92-4b97-a8d3-ef5fb0a39616 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:53.214320 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7027a2df-cc92-4b97-a8d3-ef5fb0a39616 None admin] PATH_INFO: `/v3/users/3b5c093663934fbf9e6461df82949713` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:53.227130 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7027a2df-cc92-4b97-a8d3-ef5fb0a39616 None admin] RBAC: Authorizing `identity:get_user(user_id=3b5c093663934fbf9e6461df82949713)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:53.228586 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7027a2df-cc92-4b97-a8d3-ef5fb0a39616 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:53.230215 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 555/1114] 10.222.0.24 () {56 vars in 1177 bytes} [Thu Apr 7 06:07:53 2022] GET /identity/v3/users/3b5c093663934fbf9e6461df82949713 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:53.235916 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb60edd-a904-4776-b587-7fdae6a3109c None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:53.327570 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb60edd-a904-4776-b587-7fdae6a3109c None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:53.358880 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc75d29-1130-4644-a012-17a184d83ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:53.359512 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc75d29-1130-4644-a012-17a184d83ce8 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:53.359825 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc75d29-1130-4644-a012-17a184d83ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:53.360105 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc75d29-1130-4644-a012-17a184d83ce8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:53.422650 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc75d29-1130-4644-a012-17a184d83ce8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:53.424104 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc75d29-1130-4644-a012-17a184d83ce8 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:53.514333 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 560/1115] 10.222.0.24 () {58 vars in 1282 bytes} [Thu Apr 7 06:07:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 07 06:07:53.520690 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7027a2df-cc92-4b97-a8d3-ef5fb0a39616 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:53.613490 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7027a2df-cc92-4b97-a8d3-ef5fb0a39616 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:53.644506 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3856bb4-cfa8-4d2d-abc1-c90e37a4f675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:53.645884 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3856bb4-cfa8-4d2d-abc1-c90e37a4f675 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:53.646164 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3856bb4-cfa8-4d2d-abc1-c90e37a4f675 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:53.646436 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3856bb4-cfa8-4d2d-abc1-c90e37a4f675 None admin] PATH_INFO: `/v3/projects/ae9fcf4aa3d14c9586664d984a4e366b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:53.647595 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3856bb4-cfa8-4d2d-abc1-c90e37a4f675 None admin] RBAC: Authorizing `identity:get_project(project_id=ae9fcf4aa3d14c9586664d984a4e366b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:53.649040 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3856bb4-cfa8-4d2d-abc1-c90e37a4f675 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:53.650689 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 556/1116] 10.222.0.24 () {56 vars in 1186 bytes} [Thu Apr 7 06:07:53 2022] GET /identity/v3/projects/ae9fcf4aa3d14c9586664d984a4e366b => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:53.656565 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc75d29-1130-4644-a012-17a184d83ce8 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:53.747097 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc75d29-1130-4644-a012-17a184d83ce8 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:53.778668 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f238c-42a7-4ccf-b0fd-04da8bb07488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:53.779321 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f238c-42a7-4ccf-b0fd-04da8bb07488 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:53.779602 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f238c-42a7-4ccf-b0fd-04da8bb07488 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:53.779917 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f238c-42a7-4ccf-b0fd-04da8bb07488 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:53.780739 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f238c-42a7-4ccf-b0fd-04da8bb07488 None admin] RBAC: Adding query filter params (role.id=7ad9776ea3b0430cb02c4599d037c8be, scope.project.id=ae9fcf4aa3d14c9586664d984a4e366b, user.id=3b5c093663934fbf9e6461df82949713) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:53.781048 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f238c-42a7-4ccf-b0fd-04da8bb07488 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:53.782465 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f238c-42a7-4ccf-b0fd-04da8bb07488 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:53.787747 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 561/1117] 10.222.0.24 () {56 vars in 1374 bytes} [Thu Apr 7 06:07:53 2022] GET /identity/v3/role_assignments?user.id=3b5c093663934fbf9e6461df82949713&scope.project.id=ae9fcf4aa3d14c9586664d984a4e366b&role.id=7ad9776ea3b0430cb02c4599d037c8be => generated 259 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:56.021445 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8482d7e-113c-477f-a814-4364b8398461 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:56.021977 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8482d7e-113c-477f-a814-4364b8398461 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:56.021977 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8482d7e-113c-477f-a814-4364b8398461 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:56.023284 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 557/1118] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:07:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:07:56.028863 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe85d278-6fe7-4913-a044-5a678f55fc22 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:56.029253 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe85d278-6fe7-4913-a044-5a678f55fc22 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:56.029436 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe85d278-6fe7-4913-a044-5a678f55fc22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:56.046181 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-fe85d278-6fe7-4913-a044-5a678f55fc22 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:07:56.047354 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-fe85d278-6fe7-4913-a044-5a678f55fc22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:07:56.110501 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 562/1119] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:07:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 07 06:07:56.133484 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8482d7e-113c-477f-a814-4364b8398461 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:56.227343 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8482d7e-113c-477f-a814-4364b8398461 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:56.258683 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf2e53a-58c5-4f7d-bc2e-69fabbac62f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:56.259508 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2e53a-58c5-4f7d-bc2e-69fabbac62f3 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:56.259814 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2e53a-58c5-4f7d-bc2e-69fabbac62f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:56.260085 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2e53a-58c5-4f7d-bc2e-69fabbac62f3 None admin] PATH_INFO: `/v3/roles/7ad9776ea3b0430cb02c4599d037c8be` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:56.261531 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf2e53a-58c5-4f7d-bc2e-69fabbac62f3 None admin] RBAC: Authorizing `identity:get_role(role_id=7ad9776ea3b0430cb02c4599d037c8be)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:56.262878 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf2e53a-58c5-4f7d-bc2e-69fabbac62f3 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:56.264252 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 558/1120] 10.222.0.24 () {56 vars in 1177 bytes} [Thu Apr 7 06:07:56 2022] GET /identity/v3/roles/7ad9776ea3b0430cb02c4599d037c8be => generated 223 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:56.270597 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe85d278-6fe7-4913-a044-5a678f55fc22 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:56.362860 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe85d278-6fe7-4913-a044-5a678f55fc22 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:56.394544 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2fb60b-5146-4b5b-a335-9da9de5b6045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:56.395983 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2fb60b-5146-4b5b-a335-9da9de5b6045 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:56.396265 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2fb60b-5146-4b5b-a335-9da9de5b6045 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:56.396539 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2fb60b-5146-4b5b-a335-9da9de5b6045 None admin] PATH_INFO: `/v3/users/3b5c093663934fbf9e6461df82949713` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:56.397706 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2fb60b-5146-4b5b-a335-9da9de5b6045 None admin] RBAC: Authorizing `identity:get_user(user_id=3b5c093663934fbf9e6461df82949713)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:56.399138 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2fb60b-5146-4b5b-a335-9da9de5b6045 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:56.400763 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 563/1121] 10.222.0.24 () {56 vars in 1177 bytes} [Thu Apr 7 06:07:56 2022] GET /identity/v3/users/3b5c093663934fbf9e6461df82949713 => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:56.406474 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf2e53a-58c5-4f7d-bc2e-69fabbac62f3 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:56.500397 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf2e53a-58c5-4f7d-bc2e-69fabbac62f3 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:56.532286 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e70a2-1823-4b60-972f-cb4b009d3d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:56.533126 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e70a2-1823-4b60-972f-cb4b009d3d1c None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:56.533409 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e70a2-1823-4b60-972f-cb4b009d3d1c None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:56.533684 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e70a2-1823-4b60-972f-cb4b009d3d1c None admin] PATH_INFO: `/v3/projects/ae9fcf4aa3d14c9586664d984a4e366b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:56.534844 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846e70a2-1823-4b60-972f-cb4b009d3d1c None admin] RBAC: Authorizing `identity:get_project(project_id=ae9fcf4aa3d14c9586664d984a4e366b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:56.536856 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846e70a2-1823-4b60-972f-cb4b009d3d1c None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:56.538526 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 559/1122] 10.222.0.24 () {56 vars in 1186 bytes} [Thu Apr 7 06:07:56 2022] GET /identity/v3/projects/ae9fcf4aa3d14c9586664d984a4e366b => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:56.545648 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2fb60b-5146-4b5b-a335-9da9de5b6045 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:56.637481 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2fb60b-5146-4b5b-a335-9da9de5b6045 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:56.669323 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d044c92-b5ee-4aff-a11e-c5501c8de863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:56.670196 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d044c92-b5ee-4aff-a11e-c5501c8de863 None admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:56.670477 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d044c92-b5ee-4aff-a11e-c5501c8de863 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:56.670750 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d044c92-b5ee-4aff-a11e-c5501c8de863 None admin] PATH_INFO: `/v3/projects/ae9fcf4aa3d14c9586664d984a4e366b/users/3b5c093663934fbf9e6461df82949713/roles/7ad9776ea3b0430cb02c4599d037c8be` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:56.672919 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d044c92-b5ee-4aff-a11e-c5501c8de863 None admin] RBAC: Authorizing `identity:create_grant(project_id=ae9fcf4aa3d14c9586664d984a4e366b, user_id=3b5c093663934fbf9e6461df82949713, role_id=7ad9776ea3b0430cb02c4599d037c8be)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:56.674353 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d044c92-b5ee-4aff-a11e-c5501c8de863 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:56.774574 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 564/1123] 10.222.0.24 () {58 vars in 1439 bytes} [Thu Apr 7 06:07:56 2022] PUT /identity/v3/projects/ae9fcf4aa3d14c9586664d984a4e366b/users/3b5c093663934fbf9e6461df82949713/roles/7ad9776ea3b0430cb02c4599d037c8be => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:07:59.022996 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f78556-2758-46e6-a2da-bac929b8f1a9 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:59.023494 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f78556-2758-46e6-a2da-bac929b8f1a9 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:59.023494 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f78556-2758-46e6-a2da-bac929b8f1a9 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:59.024896 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 560/1124] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:07:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:07:59.030041 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06061cbd-7072-494a-bfa3-1bd192a9db24 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:59.030457 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06061cbd-7072-494a-bfa3-1bd192a9db24 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:59.030596 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06061cbd-7072-494a-bfa3-1bd192a9db24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:59.047329 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-06061cbd-7072-494a-bfa3-1bd192a9db24 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:07:59.048522 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-06061cbd-7072-494a-bfa3-1bd192a9db24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:07:59.111284 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 565/1125] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:07:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 07 06:07:59.135800 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f78556-2758-46e6-a2da-bac929b8f1a9 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:59.228663 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f78556-2758-46e6-a2da-bac929b8f1a9 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:59.260006 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f57c86a-1dd7-4cab-b809-86950419031b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:59.260833 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57c86a-1dd7-4cab-b809-86950419031b None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:59.261112 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57c86a-1dd7-4cab-b809-86950419031b None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:59.261380 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57c86a-1dd7-4cab-b809-86950419031b None admin] PATH_INFO: `/v3/roles/7ad9776ea3b0430cb02c4599d037c8be` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:59.262823 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f57c86a-1dd7-4cab-b809-86950419031b None admin] RBAC: Authorizing `identity:get_role(role_id=7ad9776ea3b0430cb02c4599d037c8be)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:59.264208 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f57c86a-1dd7-4cab-b809-86950419031b None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:59.265531 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 561/1126] 10.222.0.24 () {56 vars in 1177 bytes} [Thu Apr 7 06:07:59 2022] GET /identity/v3/roles/7ad9776ea3b0430cb02c4599d037c8be => generated 223 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:59.271163 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06061cbd-7072-494a-bfa3-1bd192a9db24 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:59.362600 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06061cbd-7072-494a-bfa3-1bd192a9db24 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:59.394640 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d9c0e0-eb04-4c77-8dc8-2974a7d4f88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:59.395491 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d9c0e0-eb04-4c77-8dc8-2974a7d4f88f None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:59.395804 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d9c0e0-eb04-4c77-8dc8-2974a7d4f88f None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:59.396084 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d9c0e0-eb04-4c77-8dc8-2974a7d4f88f None admin] PATH_INFO: `/v3/users/3b5c093663934fbf9e6461df82949713` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:59.397252 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d9c0e0-eb04-4c77-8dc8-2974a7d4f88f None admin] RBAC: Authorizing `identity:get_user(user_id=3b5c093663934fbf9e6461df82949713)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:59.398660 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d9c0e0-eb04-4c77-8dc8-2974a7d4f88f None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:59.400273 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 566/1127] 10.222.0.24 () {56 vars in 1177 bytes} [Thu Apr 7 06:07:59 2022] GET /identity/v3/users/3b5c093663934fbf9e6461df82949713 => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:59.405661 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f57c86a-1dd7-4cab-b809-86950419031b None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:59.500985 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f57c86a-1dd7-4cab-b809-86950419031b None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:59.532412 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecec03b0-da3c-46fa-aa11-8f1b40982232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:59.533047 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec03b0-da3c-46fa-aa11-8f1b40982232 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:59.533332 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec03b0-da3c-46fa-aa11-8f1b40982232 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:59.533606 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec03b0-da3c-46fa-aa11-8f1b40982232 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:59.595194 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecec03b0-da3c-46fa-aa11-8f1b40982232 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:59.596658 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecec03b0-da3c-46fa-aa11-8f1b40982232 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:59.688709 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 562/1128] 10.222.0.24 () {58 vars in 1282 bytes} [Thu Apr 7 06:07:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 07 06:07:59.695036 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d9c0e0-eb04-4c77-8dc8-2974a7d4f88f None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:59.787337 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d9c0e0-eb04-4c77-8dc8-2974a7d4f88f None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:59.819670 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681f31c-d445-48c0-9088-7564587999b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:59.820542 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681f31c-d445-48c0-9088-7564587999b7 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:59.820822 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681f31c-d445-48c0-9088-7564587999b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:59.821090 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681f31c-d445-48c0-9088-7564587999b7 None admin] PATH_INFO: `/v3/projects/ae9fcf4aa3d14c9586664d984a4e366b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:59.822250 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4681f31c-d445-48c0-9088-7564587999b7 None admin] RBAC: Authorizing `identity:get_project(project_id=ae9fcf4aa3d14c9586664d984a4e366b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:59.823665 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4681f31c-d445-48c0-9088-7564587999b7 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:59.825359 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 567/1129] 10.222.0.24 () {56 vars in 1186 bytes} [Thu Apr 7 06:07:59 2022] GET /identity/v3/projects/ae9fcf4aa3d14c9586664d984a4e366b => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:07:59.831361 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecec03b0-da3c-46fa-aa11-8f1b40982232 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:07:59.923866 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecec03b0-da3c-46fa-aa11-8f1b40982232 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:07:59.955247 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881e0f6-9928-44b9-828b-89a9a28648ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:07:59.955850 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881e0f6-9928-44b9-828b-89a9a28648ba None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:07:59.956139 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881e0f6-9928-44b9-828b-89a9a28648ba None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:07:59.956415 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881e0f6-9928-44b9-828b-89a9a28648ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:07:59.957293 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881e0f6-9928-44b9-828b-89a9a28648ba None admin] RBAC: Adding query filter params (role.id=7ad9776ea3b0430cb02c4599d037c8be, scope.project.id=ae9fcf4aa3d14c9586664d984a4e366b, user.id=3b5c093663934fbf9e6461df82949713) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:07:59.957612 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881e0f6-9928-44b9-828b-89a9a28648ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:07:59.959033 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881e0f6-9928-44b9-828b-89a9a28648ba None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:07:59.964529 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 563/1130] 10.222.0.24 () {56 vars in 1374 bytes} [Thu Apr 7 06:07:59 2022] GET /identity/v3/role_assignments?user.id=3b5c093663934fbf9e6461df82949713&scope.project.id=ae9fcf4aa3d14c9586664d984a4e366b&role.id=7ad9776ea3b0430cb02c4599d037c8be => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:08:02.234495 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a7e65-3034-4eeb-98fc-9bbaa26dfa8a None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:02.235046 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a7e65-3034-4eeb-98fc-9bbaa26dfa8a None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:02.235046 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a7e65-3034-4eeb-98fc-9bbaa26dfa8a None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:02.236443 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 568/1131] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:08:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:08:02.241942 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52e51f-2add-4f64-b603-1eb235dfb938 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:02.242359 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52e51f-2add-4f64-b603-1eb235dfb938 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:02.242494 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52e51f-2add-4f64-b603-1eb235dfb938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:02.258948 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-7b52e51f-2add-4f64-b603-1eb235dfb938 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:08:02.260133 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-7b52e51f-2add-4f64-b603-1eb235dfb938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:08:02.322916 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 564/1132] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:08:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 07 06:08:02.347161 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a7e65-3034-4eeb-98fc-9bbaa26dfa8a None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:08:02.440367 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a7e65-3034-4eeb-98fc-9bbaa26dfa8a None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:08:02.472258 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f3d05-ba85-48a6-a59e-6933a69c4882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:08:02.473563 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f3d05-ba85-48a6-a59e-6933a69c4882 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:02.473840 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f3d05-ba85-48a6-a59e-6933a69c4882 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:02.474105 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f3d05-ba85-48a6-a59e-6933a69c4882 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:02.475258 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f3d05-ba85-48a6-a59e-6933a69c4882 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:08:02.476692 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f3d05-ba85-48a6-a59e-6933a69c4882 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:08:02.478252 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 569/1133] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:08:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:08:02.483766 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b52e51f-2add-4f64-b603-1eb235dfb938 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:08:02.576476 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b52e51f-2add-4f64-b603-1eb235dfb938 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:08:02.608837 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a001bc-2b19-4910-b4e1-8d3feb93e276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:08:02.609492 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a001bc-2b19-4910-b4e1-8d3feb93e276 None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:02.609781 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a001bc-2b19-4910-b4e1-8d3feb93e276 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:02.610060 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a001bc-2b19-4910-b4e1-8d3feb93e276 None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:02.610764 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a001bc-2b19-4910-b4e1-8d3feb93e276 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:08:02.612236 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a001bc-2b19-4910-b4e1-8d3feb93e276 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:08:02.721280 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 565/1134] 10.222.0.24 () {60 vars in 1141 bytes} [Thu Apr 7 06:08:02 2022] POST /identity/v3/projects => generated 311 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:08:05.025851 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58507d9c-17d0-4828-bd2e-1dfdfb8c8b2c None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:05.026345 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58507d9c-17d0-4828-bd2e-1dfdfb8c8b2c None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:05.026345 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58507d9c-17d0-4828-bd2e-1dfdfb8c8b2c None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:05.027527 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 570/1135] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:08:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:08:05.032921 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e10dc6-57d0-4769-a79a-b22ffb018648 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:05.033633 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e10dc6-57d0-4769-a79a-b22ffb018648 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:05.033633 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e10dc6-57d0-4769-a79a-b22ffb018648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:05.050188 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-18e10dc6-57d0-4769-a79a-b22ffb018648 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:08:05.051362 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-18e10dc6-57d0-4769-a79a-b22ffb018648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:08:05.114396 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 566/1136] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:08:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 07 06:08:05.140225 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58507d9c-17d0-4828-bd2e-1dfdfb8c8b2c None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:08:05.235083 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58507d9c-17d0-4828-bd2e-1dfdfb8c8b2c None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:08:05.266779 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c852581-dd53-43ed-9c99-451b6335a9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:08:05.267558 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c852581-dd53-43ed-9c99-451b6335a9c3 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:05.267870 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c852581-dd53-43ed-9c99-451b6335a9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:05.268145 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c852581-dd53-43ed-9c99-451b6335a9c3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:05.269381 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c852581-dd53-43ed-9c99-451b6335a9c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:08:05.270805 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c852581-dd53-43ed-9c99-451b6335a9c3 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:08:05.272426 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 571/1137] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:08:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:08:05.277928 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e10dc6-57d0-4769-a79a-b22ffb018648 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:08:05.370390 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e10dc6-57d0-4769-a79a-b22ffb018648 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:08:05.401538 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4cbad2-ddbc-4d05-8c25-43a7f7396845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:08:05.402193 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cbad2-ddbc-4d05-8c25-43a7f7396845 None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:05.402477 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cbad2-ddbc-4d05-8c25-43a7f7396845 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:05.402751 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cbad2-ddbc-4d05-8c25-43a7f7396845 None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:05.403457 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4cbad2-ddbc-4d05-8c25-43a7f7396845 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:08:05.404919 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4cbad2-ddbc-4d05-8c25-43a7f7396845 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:08:05.516147 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 567/1138] 10.222.0.24 () {60 vars in 1132 bytes} [Thu Apr 7 06:08:05 2022] POST /identity/v3/users => generated 286 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:08:07.821597 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f64cff-4d4a-40e3-8960-b63dfd8b9ec9 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:07.822120 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f64cff-4d4a-40e3-8960-b63dfd8b9ec9 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:07.822218 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f64cff-4d4a-40e3-8960-b63dfd8b9ec9 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:07.823524 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 572/1139] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:08:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:08:07.828511 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d1417-37fb-4259-b661-50279362955b None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:07.828937 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d1417-37fb-4259-b661-50279362955b None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:07.829046 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d1417-37fb-4259-b661-50279362955b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:07.845168 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-c75d1417-37fb-4259-b661-50279362955b None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:08:07.846320 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-c75d1417-37fb-4259-b661-50279362955b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:08:07.908483 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 568/1140] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:08:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 07 06:08:07.932827 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f64cff-4d4a-40e3-8960-b63dfd8b9ec9 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:08:08.038848 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f64cff-4d4a-40e3-8960-b63dfd8b9ec9 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:08:08.071478 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73849d50-2180-448a-9e91-cd66dfb329b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:08:08.072298 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73849d50-2180-448a-9e91-cd66dfb329b6 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:08.072587 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73849d50-2180-448a-9e91-cd66dfb329b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:08.072862 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73849d50-2180-448a-9e91-cd66dfb329b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:08.082387 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73849d50-2180-448a-9e91-cd66dfb329b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:08:08.089186 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-73849d50-2180-448a-9e91-cd66dfb329b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 07 06:08:08.090361 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 573/1141] 10.222.0.24 () {56 vars in 1096 bytes} [Thu Apr 7 06:08:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:08:08.096609 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d1417-37fb-4259-b661-50279362955b None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:08:08.316026 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d1417-37fb-4259-b661-50279362955b None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:08:08.346607 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ea99f-3b47-4445-a522-00cccf415489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:08:08.347825 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ea99f-3b47-4445-a522-00cccf415489 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:08.348130 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ea99f-3b47-4445-a522-00cccf415489 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:08.348401 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ea99f-3b47-4445-a522-00cccf415489 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:08.349204 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ea99f-3b47-4445-a522-00cccf415489 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:08:08.349511 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ea99f-3b47-4445-a522-00cccf415489 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:08:08.350866 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ea99f-3b47-4445-a522-00cccf415489 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:08:08.358425 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 569/1142] 10.222.0.24 () {56 vars in 1099 bytes} [Thu Apr 7 06:08:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:08:08.365096 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73849d50-2180-448a-9e91-cd66dfb329b6 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:08:08.457920 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73849d50-2180-448a-9e91-cd66dfb329b6 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:08:08.489718 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9021dea-c3a3-4767-8d03-8629af428359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:08:08.490568 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9021dea-c3a3-4767-8d03-8629af428359 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:08.490854 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9021dea-c3a3-4767-8d03-8629af428359 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:08.491131 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9021dea-c3a3-4767-8d03-8629af428359 None admin] PATH_INFO: `/v3/users/9d5221a235c644abb48654a9b99325c9` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:08.503506 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9021dea-c3a3-4767-8d03-8629af428359 None admin] RBAC: Authorizing `identity:get_user(user_id=9d5221a235c644abb48654a9b99325c9)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:08:08.504977 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9021dea-c3a3-4767-8d03-8629af428359 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:08:08.506585 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 574/1143] 10.222.0.24 () {56 vars in 1177 bytes} [Thu Apr 7 06:08:08 2022] GET /identity/v3/users/9d5221a235c644abb48654a9b99325c9 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:08:08.512125 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ea99f-3b47-4445-a522-00cccf415489 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:08:08.604290 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ea99f-3b47-4445-a522-00cccf415489 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:08:08.634976 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9265fc59-0e67-4d08-9dba-1f15c5a5919a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:08:08.635607 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265fc59-0e67-4d08-9dba-1f15c5a5919a None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:08.635922 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265fc59-0e67-4d08-9dba-1f15c5a5919a None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:08.636197 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265fc59-0e67-4d08-9dba-1f15c5a5919a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:08.697918 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9265fc59-0e67-4d08-9dba-1f15c5a5919a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:08:08.699353 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9265fc59-0e67-4d08-9dba-1f15c5a5919a None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:08:08.791338 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 570/1144] 10.222.0.24 () {58 vars in 1282 bytes} [Thu Apr 7 06:08:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 07 06:08:08.797209 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9021dea-c3a3-4767-8d03-8629af428359 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:08:08.887039 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9021dea-c3a3-4767-8d03-8629af428359 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:08:08.917936 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7516b4-fd4f-421e-aff6-053f3187766d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:08:08.918775 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7516b4-fd4f-421e-aff6-053f3187766d None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:08.919051 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7516b4-fd4f-421e-aff6-053f3187766d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:08.919322 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7516b4-fd4f-421e-aff6-053f3187766d None admin] PATH_INFO: `/v3/projects/61c370acf22d48379883c6ed7c9c5a25` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:08.920511 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7516b4-fd4f-421e-aff6-053f3187766d None admin] RBAC: Authorizing `identity:get_project(project_id=61c370acf22d48379883c6ed7c9c5a25)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:08:08.921920 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7516b4-fd4f-421e-aff6-053f3187766d None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:08:08.923583 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 575/1145] 10.222.0.24 () {56 vars in 1186 bytes} [Thu Apr 7 06:08:08 2022] GET /identity/v3/projects/61c370acf22d48379883c6ed7c9c5a25 => generated 311 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:08:08.929549 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9265fc59-0e67-4d08-9dba-1f15c5a5919a None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:08:09.024296 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9265fc59-0e67-4d08-9dba-1f15c5a5919a None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:08:09.056498 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812593e2-a195-4dd9-82e7-da1a132b843d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:08:09.057997 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812593e2-a195-4dd9-82e7-da1a132b843d None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:09.058284 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812593e2-a195-4dd9-82e7-da1a132b843d None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:09.058561 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812593e2-a195-4dd9-82e7-da1a132b843d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:09.059386 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812593e2-a195-4dd9-82e7-da1a132b843d None admin] RBAC: Adding query filter params (role.id=0fab680bc76f4a73826e9beb59e8129b, scope.project.id=61c370acf22d48379883c6ed7c9c5a25, user.id=9d5221a235c644abb48654a9b99325c9) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:08:09.059699 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812593e2-a195-4dd9-82e7-da1a132b843d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:08:09.061147 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812593e2-a195-4dd9-82e7-da1a132b843d None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:08:09.067050 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 571/1146] 10.222.0.24 () {56 vars in 1374 bytes} [Thu Apr 7 06:08:08 2022] GET /identity/v3/role_assignments?user.id=9d5221a235c644abb48654a9b99325c9&scope.project.id=61c370acf22d48379883c6ed7c9c5a25&role.id=0fab680bc76f4a73826e9beb59e8129b => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:08:11.323416 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd7cce-3835-48e6-91fa-ce49afd2367c None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:11.324014 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd7cce-3835-48e6-91fa-ce49afd2367c None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:11.324014 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd7cce-3835-48e6-91fa-ce49afd2367c None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:11.325354 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 576/1147] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:08:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:08:11.330544 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f92b4f-e635-448d-b4a0-bc877c6fcf84 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:11.330941 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f92b4f-e635-448d-b4a0-bc877c6fcf84 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:11.331106 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f92b4f-e635-448d-b4a0-bc877c6fcf84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:11.347669 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-73f92b4f-e635-448d-b4a0-bc877c6fcf84 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:08:11.348870 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-73f92b4f-e635-448d-b4a0-bc877c6fcf84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:08:11.410904 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 572/1148] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:08:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 07 06:08:11.433197 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd7cce-3835-48e6-91fa-ce49afd2367c None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:08:11.527167 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd7cce-3835-48e6-91fa-ce49afd2367c None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:08:11.558364 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d269febc-0d94-4d30-aaaa-52ae382eaf32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:08:11.559131 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269febc-0d94-4d30-aaaa-52ae382eaf32 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:11.559413 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269febc-0d94-4d30-aaaa-52ae382eaf32 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:11.559686 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269febc-0d94-4d30-aaaa-52ae382eaf32 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:11.569128 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d269febc-0d94-4d30-aaaa-52ae382eaf32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:08:11.575906 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-d269febc-0d94-4d30-aaaa-52ae382eaf32 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 07 06:08:11.577013 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 577/1149] 10.222.0.24 () {56 vars in 1096 bytes} [Thu Apr 7 06:08:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:08:11.584748 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f92b4f-e635-448d-b4a0-bc877c6fcf84 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:08:11.679329 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f92b4f-e635-448d-b4a0-bc877c6fcf84 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:08:11.710464 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c79434-6b3b-46ae-bf5e-d10df6d65124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:08:11.711123 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c79434-6b3b-46ae-bf5e-d10df6d65124 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:11.711408 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c79434-6b3b-46ae-bf5e-d10df6d65124 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:11.711678 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c79434-6b3b-46ae-bf5e-d10df6d65124 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:11.712449 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c79434-6b3b-46ae-bf5e-d10df6d65124 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:08:11.712746 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c79434-6b3b-46ae-bf5e-d10df6d65124 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:08:11.714092 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c79434-6b3b-46ae-bf5e-d10df6d65124 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:08:11.721601 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 573/1150] 10.222.0.24 () {56 vars in 1099 bytes} [Thu Apr 7 06:08:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:08:11.728131 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d269febc-0d94-4d30-aaaa-52ae382eaf32 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:08:11.821616 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d269febc-0d94-4d30-aaaa-52ae382eaf32 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:08:11.853263 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47deb880-e20c-4469-ad39-d2d4074e2422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:08:11.854068 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47deb880-e20c-4469-ad39-d2d4074e2422 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:11.854351 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47deb880-e20c-4469-ad39-d2d4074e2422 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:11.854627 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47deb880-e20c-4469-ad39-d2d4074e2422 None admin] PATH_INFO: `/v3/users/9d5221a235c644abb48654a9b99325c9` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:11.855814 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47deb880-e20c-4469-ad39-d2d4074e2422 None admin] RBAC: Authorizing `identity:get_user(user_id=9d5221a235c644abb48654a9b99325c9)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:08:11.857229 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47deb880-e20c-4469-ad39-d2d4074e2422 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:08:11.858828 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 578/1151] 10.222.0.24 () {56 vars in 1177 bytes} [Thu Apr 7 06:08:11 2022] GET /identity/v3/users/9d5221a235c644abb48654a9b99325c9 => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:08:11.864793 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c79434-6b3b-46ae-bf5e-d10df6d65124 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:08:11.957817 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c79434-6b3b-46ae-bf5e-d10df6d65124 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:08:11.988028 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf487237-c36c-476b-9156-aade9ec7e01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:08:11.989118 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf487237-c36c-476b-9156-aade9ec7e01b None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:11.989396 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf487237-c36c-476b-9156-aade9ec7e01b None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:11.989666 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf487237-c36c-476b-9156-aade9ec7e01b None admin] PATH_INFO: `/v3/projects/61c370acf22d48379883c6ed7c9c5a25` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:11.990816 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf487237-c36c-476b-9156-aade9ec7e01b None admin] RBAC: Authorizing `identity:get_project(project_id=61c370acf22d48379883c6ed7c9c5a25)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:08:11.992245 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf487237-c36c-476b-9156-aade9ec7e01b None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:08:11.993924 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 574/1152] 10.222.0.24 () {56 vars in 1186 bytes} [Thu Apr 7 06:08:11 2022] GET /identity/v3/projects/61c370acf22d48379883c6ed7c9c5a25 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:08:11.999592 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47deb880-e20c-4469-ad39-d2d4074e2422 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:08:12.092752 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47deb880-e20c-4469-ad39-d2d4074e2422 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:08:12.123404 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082af12a-30d9-4b46-9442-0348d93fa1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:08:12.124246 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082af12a-30d9-4b46-9442-0348d93fa1b1 None admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:12.124532 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082af12a-30d9-4b46-9442-0348d93fa1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:12.124809 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082af12a-30d9-4b46-9442-0348d93fa1b1 None admin] PATH_INFO: `/v3/projects/61c370acf22d48379883c6ed7c9c5a25/users/9d5221a235c644abb48654a9b99325c9/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:12.126725 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082af12a-30d9-4b46-9442-0348d93fa1b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=61c370acf22d48379883c6ed7c9c5a25, user_id=9d5221a235c644abb48654a9b99325c9, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:08:12.128156 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082af12a-30d9-4b46-9442-0348d93fa1b1 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:08:12.235659 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 579/1153] 10.222.0.24 () {58 vars in 1439 bytes} [Thu Apr 7 06:08:11 2022] PUT /identity/v3/projects/61c370acf22d48379883c6ed7c9c5a25/users/9d5221a235c644abb48654a9b99325c9/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:08:14.474583 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f73a44-0fd8-4c6d-8aa8-fa74f92c58c8 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:14.475152 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f73a44-0fd8-4c6d-8aa8-fa74f92c58c8 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:14.475249 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f73a44-0fd8-4c6d-8aa8-fa74f92c58c8 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:14.476606 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 575/1154] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:08:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:08:14.481854 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ce7cf-7f69-4a7c-9209-580a6609e033 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:14.482255 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ce7cf-7f69-4a7c-9209-580a6609e033 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:14.482409 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ce7cf-7f69-4a7c-9209-580a6609e033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:14.499223 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-5c9ce7cf-7f69-4a7c-9209-580a6609e033 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:08:14.500423 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-5c9ce7cf-7f69-4a7c-9209-580a6609e033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:08:14.561491 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 580/1155] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:08:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 07 06:08:14.586149 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f73a44-0fd8-4c6d-8aa8-fa74f92c58c8 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:08:14.680368 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f73a44-0fd8-4c6d-8aa8-fa74f92c58c8 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:08:14.711555 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0264c2e4-6c09-4943-a99d-20db1d1e8b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:08:14.712375 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0264c2e4-6c09-4943-a99d-20db1d1e8b2b None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:14.712662 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0264c2e4-6c09-4943-a99d-20db1d1e8b2b None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:14.712938 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0264c2e4-6c09-4943-a99d-20db1d1e8b2b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:14.722921 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0264c2e4-6c09-4943-a99d-20db1d1e8b2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:08:14.729750 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-0264c2e4-6c09-4943-a99d-20db1d1e8b2b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 07 06:08:14.730859 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 576/1156] 10.222.0.24 () {56 vars in 1096 bytes} [Thu Apr 7 06:08:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:08:14.736865 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ce7cf-7f69-4a7c-9209-580a6609e033 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:08:14.830739 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ce7cf-7f69-4a7c-9209-580a6609e033 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:08:14.862391 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed2091-0f35-4a76-94bb-c157e40f2654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:08:14.863923 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed2091-0f35-4a76-94bb-c157e40f2654 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:14.864211 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed2091-0f35-4a76-94bb-c157e40f2654 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:14.864485 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed2091-0f35-4a76-94bb-c157e40f2654 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:14.865227 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ed2091-0f35-4a76-94bb-c157e40f2654 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:08:14.865535 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ed2091-0f35-4a76-94bb-c157e40f2654 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:08:14.866888 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ed2091-0f35-4a76-94bb-c157e40f2654 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:08:14.874497 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 581/1157] 10.222.0.24 () {56 vars in 1099 bytes} [Thu Apr 7 06:08:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:08:14.880232 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0264c2e4-6c09-4943-a99d-20db1d1e8b2b None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:08:14.972671 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0264c2e4-6c09-4943-a99d-20db1d1e8b2b None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:08:15.004135 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d6f39f-4c7a-48a5-b03e-9ba11c345987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:08:15.004932 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6f39f-4c7a-48a5-b03e-9ba11c345987 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:15.005222 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6f39f-4c7a-48a5-b03e-9ba11c345987 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:15.005496 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6f39f-4c7a-48a5-b03e-9ba11c345987 None admin] PATH_INFO: `/v3/users/9d5221a235c644abb48654a9b99325c9` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:15.006657 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d6f39f-4c7a-48a5-b03e-9ba11c345987 None admin] RBAC: Authorizing `identity:get_user(user_id=9d5221a235c644abb48654a9b99325c9)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:08:15.008108 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d6f39f-4c7a-48a5-b03e-9ba11c345987 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:08:15.009704 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 577/1158] 10.222.0.24 () {56 vars in 1177 bytes} [Thu Apr 7 06:08:14 2022] GET /identity/v3/users/9d5221a235c644abb48654a9b99325c9 => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:08:15.015393 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed2091-0f35-4a76-94bb-c157e40f2654 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:08:15.110823 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed2091-0f35-4a76-94bb-c157e40f2654 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:08:15.142467 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b14725-7511-4f9b-af8d-3b1787b27a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:08:15.143131 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b14725-7511-4f9b-af8d-3b1787b27a7b None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:15.143414 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b14725-7511-4f9b-af8d-3b1787b27a7b None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:15.143705 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b14725-7511-4f9b-af8d-3b1787b27a7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:15.208286 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b14725-7511-4f9b-af8d-3b1787b27a7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:08:15.209725 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b14725-7511-4f9b-af8d-3b1787b27a7b None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:08:15.299953 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 582/1159] 10.222.0.24 () {58 vars in 1282 bytes} [Thu Apr 7 06:08:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 07 06:08:15.306370 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d6f39f-4c7a-48a5-b03e-9ba11c345987 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:08:15.399128 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d6f39f-4c7a-48a5-b03e-9ba11c345987 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:08:15.430013 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077f17de-ebed-4edb-9f8a-ae956e666c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:08:15.430849 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f17de-ebed-4edb-9f8a-ae956e666c06 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:15.431139 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f17de-ebed-4edb-9f8a-ae956e666c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:15.431415 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f17de-ebed-4edb-9f8a-ae956e666c06 None admin] PATH_INFO: `/v3/projects/61c370acf22d48379883c6ed7c9c5a25` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:15.432599 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077f17de-ebed-4edb-9f8a-ae956e666c06 None admin] RBAC: Authorizing `identity:get_project(project_id=61c370acf22d48379883c6ed7c9c5a25)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:08:15.434014 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077f17de-ebed-4edb-9f8a-ae956e666c06 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:08:15.435676 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 578/1160] 10.222.0.24 () {56 vars in 1186 bytes} [Thu Apr 7 06:08:15 2022] GET /identity/v3/projects/61c370acf22d48379883c6ed7c9c5a25 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:08:15.441960 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b14725-7511-4f9b-af8d-3b1787b27a7b None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:08:15.532684 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b14725-7511-4f9b-af8d-3b1787b27a7b None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:08:15.564071 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb423f8-387e-4ac3-843e-7227d98dac19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:08:15.564652 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb423f8-387e-4ac3-843e-7227d98dac19 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:15.564936 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb423f8-387e-4ac3-843e-7227d98dac19 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:15.565217 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb423f8-387e-4ac3-843e-7227d98dac19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:15.566637 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb423f8-387e-4ac3-843e-7227d98dac19 None admin] RBAC: Adding query filter params (role.id=0fab680bc76f4a73826e9beb59e8129b, scope.project.id=61c370acf22d48379883c6ed7c9c5a25, user.id=9d5221a235c644abb48654a9b99325c9) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:08:15.566948 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb423f8-387e-4ac3-843e-7227d98dac19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:08:15.568386 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb423f8-387e-4ac3-843e-7227d98dac19 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:08:15.573823 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 583/1161] 10.222.0.24 () {56 vars in 1374 bytes} [Thu Apr 7 06:08:15 2022] GET /identity/v3/role_assignments?user.id=9d5221a235c644abb48654a9b99325c9&scope.project.id=61c370acf22d48379883c6ed7c9c5a25&role.id=0fab680bc76f4a73826e9beb59e8129b => generated 608 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:08:17.853388 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0f439-e945-4619-849c-7edb6183e75f None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:17.853868 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0f439-e945-4619-849c-7edb6183e75f None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:17.853973 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0f439-e945-4619-849c-7edb6183e75f None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:17.855299 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 579/1162] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:08:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:08:17.860375 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8426d36f-09c8-437f-a0eb-ee694b65213d None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:17.860763 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8426d36f-09c8-437f-a0eb-ee694b65213d None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:17.860929 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8426d36f-09c8-437f-a0eb-ee694b65213d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:17.877178 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-8426d36f-09c8-437f-a0eb-ee694b65213d None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:08:17.878822 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-8426d36f-09c8-437f-a0eb-ee694b65213d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:08:17.939918 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 584/1163] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:08:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 07 06:08:17.962686 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c0f439-e945-4619-849c-7edb6183e75f None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:08:18.057054 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c0f439-e945-4619-849c-7edb6183e75f None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:08:18.087641 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b457b25c-7afb-4ec7-9679-9a5e14cb41bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:08:18.088291 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b457b25c-7afb-4ec7-9679-9a5e14cb41bc None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:18.088573 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b457b25c-7afb-4ec7-9679-9a5e14cb41bc None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:18.088842 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b457b25c-7afb-4ec7-9679-9a5e14cb41bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:18.150661 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b457b25c-7afb-4ec7-9679-9a5e14cb41bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:08:18.152105 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b457b25c-7afb-4ec7-9679-9a5e14cb41bc None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:08:18.241552 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 580/1164] 10.222.0.24 () {58 vars in 1282 bytes} [Thu Apr 7 06:08:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 07 06:08:18.250711 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8426d36f-09c8-437f-a0eb-ee694b65213d None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:08:18.344802 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8426d36f-09c8-437f-a0eb-ee694b65213d None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:08:18.376687 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd5db2a-fb34-40a5-bd5d-ed4c7398063e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:08:18.377480 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5db2a-fb34-40a5-bd5d-ed4c7398063e None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:18.377763 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5db2a-fb34-40a5-bd5d-ed4c7398063e None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:18.378635 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5db2a-fb34-40a5-bd5d-ed4c7398063e None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:18.385037 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd5db2a-fb34-40a5-bd5d-ed4c7398063e None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:08:18.386462 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd5db2a-fb34-40a5-bd5d-ed4c7398063e None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:08:18.399171 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-9fd5db2a-fb34-40a5-bd5d-ed4c7398063e None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Apr 07 06:08:18.400361 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 585/1165] 10.222.0.24 () {56 vars in 1117 bytes} [Thu Apr 7 06:08:18 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:08:18.406260 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b457b25c-7afb-4ec7-9679-9a5e14cb41bc None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:08:18.496673 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b457b25c-7afb-4ec7-9679-9a5e14cb41bc None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:08:18.527772 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a883a79-5c3c-407f-885b-67b2a055ba6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:08:18.528422 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a883a79-5c3c-407f-885b-67b2a055ba6a None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:18.528703 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a883a79-5c3c-407f-885b-67b2a055ba6a None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:18.528975 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a883a79-5c3c-407f-885b-67b2a055ba6a None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:18.529684 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a883a79-5c3c-407f-885b-67b2a055ba6a None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:08:18.529986 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a883a79-5c3c-407f-885b-67b2a055ba6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:08:18.531320 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a883a79-5c3c-407f-885b-67b2a055ba6a None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:08:18.538011 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 581/1166] 10.222.0.24 () {56 vars in 1115 bytes} [Thu Apr 7 06:08:18 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:08:20.764484 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ecbc6-252e-4b4e-b9fe-a958711de65c None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:20.765019 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ecbc6-252e-4b4e-b9fe-a958711de65c None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:20.765019 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ecbc6-252e-4b4e-b9fe-a958711de65c None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:20.766402 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 586/1167] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:08:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:08:20.772026 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8bf50f-5208-41c6-8ab4-6cb63f6a1979 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:20.772387 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8bf50f-5208-41c6-8ab4-6cb63f6a1979 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:20.772579 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8bf50f-5208-41c6-8ab4-6cb63f6a1979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:20.789207 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-cf8bf50f-5208-41c6-8ab4-6cb63f6a1979 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:08:20.790367 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-cf8bf50f-5208-41c6-8ab4-6cb63f6a1979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:08:20.853478 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 582/1168] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:08:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 07 06:08:20.876802 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ecbc6-252e-4b4e-b9fe-a958711de65c None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:08:20.970236 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ecbc6-252e-4b4e-b9fe-a958711de65c None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:08:21.001134 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d93f9-8f77-40bb-ae4b-6dd3c5edab01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:08:21.001773 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d93f9-8f77-40bb-ae4b-6dd3c5edab01 None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:21.002054 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d93f9-8f77-40bb-ae4b-6dd3c5edab01 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:21.002324 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d93f9-8f77-40bb-ae4b-6dd3c5edab01 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:21.003562 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4d93f9-8f77-40bb-ae4b-6dd3c5edab01 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:08:21.004929 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4d93f9-8f77-40bb-ae4b-6dd3c5edab01 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:08:21.074257 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 587/1169] 10.222.0.24 () {60 vars in 1138 bytes} [Thu Apr 7 06:08:20 2022] POST /identity/v3/domains => generated 267 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:08:23.358024 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab66b8-3ddf-4077-9066-742f991db883 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:23.358553 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab66b8-3ddf-4077-9066-742f991db883 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:23.358553 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab66b8-3ddf-4077-9066-742f991db883 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:23.359961 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 583/1170] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:08:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:08:23.365942 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b02c0e-84f6-433d-b145-60db20f87294 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:23.366337 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b02c0e-84f6-433d-b145-60db20f87294 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:23.366505 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b02c0e-84f6-433d-b145-60db20f87294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:23.382541 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-59b02c0e-84f6-433d-b145-60db20f87294 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:08:23.383710 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-59b02c0e-84f6-433d-b145-60db20f87294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:08:23.448494 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 588/1171] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:08:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 07 06:08:23.473036 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab66b8-3ddf-4077-9066-742f991db883 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:08:23.566390 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab66b8-3ddf-4077-9066-742f991db883 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:08:23.597367 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af723def-9951-492e-85df-c7c62a6ea58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:08:23.598203 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af723def-9951-492e-85df-c7c62a6ea58d None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:23.598488 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af723def-9951-492e-85df-c7c62a6ea58d None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:23.598760 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af723def-9951-492e-85df-c7c62a6ea58d None admin] PATH_INFO: `/v3/domains/dfd649ab15694cd9ad7cf455e5bea57d` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:23.608471 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af723def-9951-492e-85df-c7c62a6ea58d None admin] RBAC: Authorizing `identity:get_domain(domain_id=dfd649ab15694cd9ad7cf455e5bea57d)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:08:23.609850 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af723def-9951-492e-85df-c7c62a6ea58d None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:08:23.611416 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 584/1172] 10.222.0.24 () {56 vars in 1183 bytes} [Thu Apr 7 06:08:23 2022] GET /identity/v3/domains/dfd649ab15694cd9ad7cf455e5bea57d => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:08:23.617744 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b02c0e-84f6-433d-b145-60db20f87294 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:08:23.709504 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b02c0e-84f6-433d-b145-60db20f87294 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:08:23.741841 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6800fde7-12d3-499d-b114-94b0f091e4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:08:23.742493 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800fde7-12d3-499d-b114-94b0f091e4f6 None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:23.742778 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800fde7-12d3-499d-b114-94b0f091e4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:23.743055 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800fde7-12d3-499d-b114-94b0f091e4f6 None admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:23.743835 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6800fde7-12d3-499d-b114-94b0f091e4f6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:08:23.745194 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6800fde7-12d3-499d-b114-94b0f091e4f6 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:08:23.842728 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 589/1173] 10.222.0.24 () {60 vars in 1141 bytes} [Thu Apr 7 06:08:23 2022] POST /identity/v3/projects => generated 361 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:08:26.132604 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86459f-d7a4-4cd4-91b3-4d4f1bd8250b None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:26.133168 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86459f-d7a4-4cd4-91b3-4d4f1bd8250b None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:26.133168 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86459f-d7a4-4cd4-91b3-4d4f1bd8250b None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:26.134524 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 585/1174] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:08:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:08:26.139528 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326bd27-773c-4f97-aadf-99cdbfb7085e None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:26.139921 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326bd27-773c-4f97-aadf-99cdbfb7085e None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:26.140113 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326bd27-773c-4f97-aadf-99cdbfb7085e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:26.156634 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-b326bd27-773c-4f97-aadf-99cdbfb7085e None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:08:26.157786 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b326bd27-773c-4f97-aadf-99cdbfb7085e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:08:26.218736 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 590/1175] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:08:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 07 06:08:26.243824 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c86459f-d7a4-4cd4-91b3-4d4f1bd8250b None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:08:26.337517 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c86459f-d7a4-4cd4-91b3-4d4f1bd8250b None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:08:26.368418 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfc94cb-9c6c-4547-998b-8f327ce3dcc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:08:26.369252 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc94cb-9c6c-4547-998b-8f327ce3dcc8 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:26.369532 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc94cb-9c6c-4547-998b-8f327ce3dcc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:26.369801 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc94cb-9c6c-4547-998b-8f327ce3dcc8 None admin] PATH_INFO: `/v3/domains/dfd649ab15694cd9ad7cf455e5bea57d` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:26.370946 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfc94cb-9c6c-4547-998b-8f327ce3dcc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=dfd649ab15694cd9ad7cf455e5bea57d)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:08:26.372387 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfc94cb-9c6c-4547-998b-8f327ce3dcc8 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:08:26.373940 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 586/1176] 10.222.0.24 () {56 vars in 1183 bytes} [Thu Apr 7 06:08:26 2022] GET /identity/v3/domains/dfd649ab15694cd9ad7cf455e5bea57d => generated 267 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:08:26.379794 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b326bd27-773c-4f97-aadf-99cdbfb7085e None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:08:26.469882 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b326bd27-773c-4f97-aadf-99cdbfb7085e None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:08:26.501059 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c101c113-f28b-46b8-ae18-0c10129aeb0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:08:26.501706 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101c113-f28b-46b8-ae18-0c10129aeb0d None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:26.501987 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101c113-f28b-46b8-ae18-0c10129aeb0d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:26.502259 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101c113-f28b-46b8-ae18-0c10129aeb0d None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:26.503553 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c101c113-f28b-46b8-ae18-0c10129aeb0d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:08:26.504978 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c101c113-f28b-46b8-ae18-0c10129aeb0d None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:08:26.607224 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 591/1177] 10.222.0.24 () {60 vars in 1132 bytes} [Thu Apr 7 06:08:26 2022] POST /identity/v3/users => generated 311 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:08:28.924135 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d3153-df8f-4fa5-85cc-972a63ff55af None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:28.927109 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d3153-df8f-4fa5-85cc-972a63ff55af None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:28.927109 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d3153-df8f-4fa5-85cc-972a63ff55af None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:28.927109 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 587/1178] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:08:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:08:28.931838 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d830bcac-d66d-463b-8f29-29b4a9e798ce None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:28.932219 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d830bcac-d66d-463b-8f29-29b4a9e798ce None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:28.932403 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d830bcac-d66d-463b-8f29-29b4a9e798ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:28.949074 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-d830bcac-d66d-463b-8f29-29b4a9e798ce None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:08:28.950235 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d830bcac-d66d-463b-8f29-29b4a9e798ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:08:29.012392 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 592/1179] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:08:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 07 06:08:29.036917 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8d3153-df8f-4fa5-85cc-972a63ff55af None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:08:29.134224 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8d3153-df8f-4fa5-85cc-972a63ff55af None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:08:29.165575 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e2800-8b14-45ec-9533-d0909aa922bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:08:29.166356 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e2800-8b14-45ec-9533-d0909aa922bb None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:29.166642 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e2800-8b14-45ec-9533-d0909aa922bb None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:29.166919 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e2800-8b14-45ec-9533-d0909aa922bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:29.176922 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2e2800-8b14-45ec-9533-d0909aa922bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:08:29.183713 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-7a2e2800-8b14-45ec-9533-d0909aa922bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 07 06:08:29.184893 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 588/1180] 10.222.0.24 () {56 vars in 1096 bytes} [Thu Apr 7 06:08:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:08:29.191392 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d830bcac-d66d-463b-8f29-29b4a9e798ce None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:08:29.284571 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d830bcac-d66d-463b-8f29-29b4a9e798ce None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:08:29.316153 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b87618-dae7-4444-b2fd-1513e71789e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:08:29.316760 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b87618-dae7-4444-b2fd-1513e71789e4 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:29.317051 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b87618-dae7-4444-b2fd-1513e71789e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:29.317323 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b87618-dae7-4444-b2fd-1513e71789e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:29.318067 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b87618-dae7-4444-b2fd-1513e71789e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:08:29.318372 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b87618-dae7-4444-b2fd-1513e71789e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:08:29.319723 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b87618-dae7-4444-b2fd-1513e71789e4 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:08:29.327268 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 593/1181] 10.222.0.24 () {56 vars in 1099 bytes} [Thu Apr 7 06:08:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:08:29.333602 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e2800-8b14-45ec-9533-d0909aa922bb None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:08:29.425036 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e2800-8b14-45ec-9533-d0909aa922bb None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:08:29.456838 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cab696-37cb-4260-bef9-7b72f5303710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:08:29.457685 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cab696-37cb-4260-bef9-7b72f5303710 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:29.457968 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cab696-37cb-4260-bef9-7b72f5303710 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:29.458241 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cab696-37cb-4260-bef9-7b72f5303710 None admin] PATH_INFO: `/v3/users/78cfaec69c4e412b9cfb8bb35e1c6224` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:29.470391 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cab696-37cb-4260-bef9-7b72f5303710 None admin] RBAC: Authorizing `identity:get_user(user_id=78cfaec69c4e412b9cfb8bb35e1c6224)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:08:29.471867 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cab696-37cb-4260-bef9-7b72f5303710 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:08:29.473469 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 589/1182] 10.222.0.24 () {56 vars in 1177 bytes} [Thu Apr 7 06:08:29 2022] GET /identity/v3/users/78cfaec69c4e412b9cfb8bb35e1c6224 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:08:29.478978 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b87618-dae7-4444-b2fd-1513e71789e4 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:08:29.572478 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b87618-dae7-4444-b2fd-1513e71789e4 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:08:29.603201 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f107e-46cb-4493-8fea-3854e886e09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:08:29.603858 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f107e-46cb-4493-8fea-3854e886e09d None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:29.604145 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f107e-46cb-4493-8fea-3854e886e09d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:29.604421 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f107e-46cb-4493-8fea-3854e886e09d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:29.667476 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78f107e-46cb-4493-8fea-3854e886e09d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:08:29.668933 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78f107e-46cb-4493-8fea-3854e886e09d None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:08:29.759524 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 594/1183] 10.222.0.24 () {58 vars in 1282 bytes} [Thu Apr 7 06:08:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 07 06:08:29.765405 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cab696-37cb-4260-bef9-7b72f5303710 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:08:29.858318 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cab696-37cb-4260-bef9-7b72f5303710 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:08:29.890352 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b7884d-b332-4827-8e98-3f6e5d9925a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:08:29.891199 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7884d-b332-4827-8e98-3f6e5d9925a5 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:29.891484 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7884d-b332-4827-8e98-3f6e5d9925a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:29.891781 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7884d-b332-4827-8e98-3f6e5d9925a5 None admin] PATH_INFO: `/v3/projects/d1ce1531c1e64d7e9739530e7dad5db9` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:29.892946 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b7884d-b332-4827-8e98-3f6e5d9925a5 None admin] RBAC: Authorizing `identity:get_project(project_id=d1ce1531c1e64d7e9739530e7dad5db9)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:08:29.894952 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b7884d-b332-4827-8e98-3f6e5d9925a5 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:08:29.896665 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 590/1184] 10.222.0.24 () {56 vars in 1186 bytes} [Thu Apr 7 06:08:29 2022] GET /identity/v3/projects/d1ce1531c1e64d7e9739530e7dad5db9 => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:08:29.902448 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f107e-46cb-4493-8fea-3854e886e09d None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:08:29.993925 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f107e-46cb-4493-8fea-3854e886e09d None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:08:30.025473 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a84d527-8313-4d3d-8077-ad40f4db7a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:08:30.026118 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84d527-8313-4d3d-8077-ad40f4db7a19 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:30.026402 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84d527-8313-4d3d-8077-ad40f4db7a19 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:30.026677 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84d527-8313-4d3d-8077-ad40f4db7a19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:30.027509 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a84d527-8313-4d3d-8077-ad40f4db7a19 None admin] RBAC: Adding query filter params (role.id=0fab680bc76f4a73826e9beb59e8129b, scope.project.id=d1ce1531c1e64d7e9739530e7dad5db9, user.id=78cfaec69c4e412b9cfb8bb35e1c6224) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:08:30.027835 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a84d527-8313-4d3d-8077-ad40f4db7a19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:08:30.029257 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a84d527-8313-4d3d-8077-ad40f4db7a19 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:08:30.034864 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 595/1185] 10.222.0.24 () {56 vars in 1374 bytes} [Thu Apr 7 06:08:29 2022] GET /identity/v3/role_assignments?user.id=78cfaec69c4e412b9cfb8bb35e1c6224&scope.project.id=d1ce1531c1e64d7e9739530e7dad5db9&role.id=0fab680bc76f4a73826e9beb59e8129b => generated 259 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:08:32.276039 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc83875-d12e-4252-8715-4d69ed9840d2 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:32.276570 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc83875-d12e-4252-8715-4d69ed9840d2 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:32.276681 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc83875-d12e-4252-8715-4d69ed9840d2 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:32.277973 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 591/1186] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:08:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:08:32.283387 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e367d0b-9c28-4a8c-bb60-c70018f649c1 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:32.284361 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e367d0b-9c28-4a8c-bb60-c70018f649c1 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:32.284505 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e367d0b-9c28-4a8c-bb60-c70018f649c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:32.303626 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-7e367d0b-9c28-4a8c-bb60-c70018f649c1 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:08:32.303626 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-7e367d0b-9c28-4a8c-bb60-c70018f649c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:08:32.365287 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 596/1187] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:08:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 07 06:08:32.387826 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc83875-d12e-4252-8715-4d69ed9840d2 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:08:32.482160 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc83875-d12e-4252-8715-4d69ed9840d2 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:08:32.513384 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78740b3c-1ff6-43ca-8ca5-1519311f1094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:08:32.514154 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78740b3c-1ff6-43ca-8ca5-1519311f1094 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:32.514440 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78740b3c-1ff6-43ca-8ca5-1519311f1094 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:32.514711 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78740b3c-1ff6-43ca-8ca5-1519311f1094 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:32.524729 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78740b3c-1ff6-43ca-8ca5-1519311f1094 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:08:32.531513 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-78740b3c-1ff6-43ca-8ca5-1519311f1094 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 07 06:08:32.532692 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 592/1188] 10.222.0.24 () {56 vars in 1096 bytes} [Thu Apr 7 06:08:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:08:32.539965 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e367d0b-9c28-4a8c-bb60-c70018f649c1 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:08:32.631605 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e367d0b-9c28-4a8c-bb60-c70018f649c1 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:08:32.663593 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af48d3f6-75d0-483f-92db-6eba15b7cc85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:08:32.664271 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48d3f6-75d0-483f-92db-6eba15b7cc85 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:32.664558 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48d3f6-75d0-483f-92db-6eba15b7cc85 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:32.664833 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48d3f6-75d0-483f-92db-6eba15b7cc85 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:32.665571 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af48d3f6-75d0-483f-92db-6eba15b7cc85 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:08:32.665875 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af48d3f6-75d0-483f-92db-6eba15b7cc85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:08:32.667222 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af48d3f6-75d0-483f-92db-6eba15b7cc85 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:08:32.674788 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 597/1189] 10.222.0.24 () {56 vars in 1099 bytes} [Thu Apr 7 06:08:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:08:32.680452 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78740b3c-1ff6-43ca-8ca5-1519311f1094 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:08:32.774953 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78740b3c-1ff6-43ca-8ca5-1519311f1094 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:08:32.806952 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3928779-5869-4040-920b-870575795307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:08:32.807781 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3928779-5869-4040-920b-870575795307 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:32.808070 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3928779-5869-4040-920b-870575795307 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:32.808347 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3928779-5869-4040-920b-870575795307 None admin] PATH_INFO: `/v3/users/78cfaec69c4e412b9cfb8bb35e1c6224` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:32.809514 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3928779-5869-4040-920b-870575795307 None admin] RBAC: Authorizing `identity:get_user(user_id=78cfaec69c4e412b9cfb8bb35e1c6224)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:08:32.810938 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3928779-5869-4040-920b-870575795307 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:08:32.812585 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 593/1190] 10.222.0.24 () {56 vars in 1177 bytes} [Thu Apr 7 06:08:32 2022] GET /identity/v3/users/78cfaec69c4e412b9cfb8bb35e1c6224 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:08:32.818275 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af48d3f6-75d0-483f-92db-6eba15b7cc85 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:08:32.912200 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af48d3f6-75d0-483f-92db-6eba15b7cc85 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:08:32.943500 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b7cf4e-871f-476a-93af-083f2f2c2c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:08:32.944368 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7cf4e-871f-476a-93af-083f2f2c2c5c None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:32.944656 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7cf4e-871f-476a-93af-083f2f2c2c5c None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:32.944933 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7cf4e-871f-476a-93af-083f2f2c2c5c None admin] PATH_INFO: `/v3/projects/d1ce1531c1e64d7e9739530e7dad5db9` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:32.946086 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b7cf4e-871f-476a-93af-083f2f2c2c5c None admin] RBAC: Authorizing `identity:get_project(project_id=d1ce1531c1e64d7e9739530e7dad5db9)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:08:32.947489 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b7cf4e-871f-476a-93af-083f2f2c2c5c None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:08:32.949168 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 598/1191] 10.222.0.24 () {56 vars in 1186 bytes} [Thu Apr 7 06:08:32 2022] GET /identity/v3/projects/d1ce1531c1e64d7e9739530e7dad5db9 => generated 361 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:08:32.954714 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3928779-5869-4040-920b-870575795307 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:08:33.047486 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3928779-5869-4040-920b-870575795307 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:08:33.078501 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d9c65b-71ca-4b50-b9a0-c9bf4ececcdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:08:33.079310 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9c65b-71ca-4b50-b9a0-c9bf4ececcdb None admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:33.079589 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9c65b-71ca-4b50-b9a0-c9bf4ececcdb None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:33.079889 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9c65b-71ca-4b50-b9a0-c9bf4ececcdb None admin] PATH_INFO: `/v3/projects/d1ce1531c1e64d7e9739530e7dad5db9/users/78cfaec69c4e412b9cfb8bb35e1c6224/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:33.082395 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d9c65b-71ca-4b50-b9a0-c9bf4ececcdb None admin] RBAC: Authorizing `identity:create_grant(project_id=d1ce1531c1e64d7e9739530e7dad5db9, user_id=78cfaec69c4e412b9cfb8bb35e1c6224, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:08:33.083840 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d9c65b-71ca-4b50-b9a0-c9bf4ececcdb None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:08:33.159195 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 594/1192] 10.222.0.24 () {58 vars in 1439 bytes} [Thu Apr 7 06:08:32 2022] PUT /identity/v3/projects/d1ce1531c1e64d7e9739530e7dad5db9/users/78cfaec69c4e412b9cfb8bb35e1c6224/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:08:35.407509 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280f7bf-7e3f-4448-bcd3-93bc5be46100 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:35.408098 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280f7bf-7e3f-4448-bcd3-93bc5be46100 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:35.408098 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280f7bf-7e3f-4448-bcd3-93bc5be46100 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:35.409984 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 599/1193] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:08:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:08:35.415282 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70728d-cb9a-44af-a062-a4dda67fd943 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:35.415694 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70728d-cb9a-44af-a062-a4dda67fd943 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:35.415882 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70728d-cb9a-44af-a062-a4dda67fd943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:35.432753 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-dc70728d-cb9a-44af-a062-a4dda67fd943 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:08:35.433934 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-dc70728d-cb9a-44af-a062-a4dda67fd943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:08:35.495697 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 595/1194] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:08:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 07 06:08:35.520670 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2280f7bf-7e3f-4448-bcd3-93bc5be46100 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:08:35.615699 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2280f7bf-7e3f-4448-bcd3-93bc5be46100 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:08:35.646910 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4934c4-8f07-49aa-8530-6dacb221534c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:08:35.647683 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4934c4-8f07-49aa-8530-6dacb221534c None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:35.647992 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4934c4-8f07-49aa-8530-6dacb221534c None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:35.648265 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4934c4-8f07-49aa-8530-6dacb221534c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:35.659344 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4934c4-8f07-49aa-8530-6dacb221534c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:08:35.665938 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-0d4934c4-8f07-49aa-8530-6dacb221534c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 07 06:08:35.667085 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 600/1195] 10.222.0.24 () {56 vars in 1096 bytes} [Thu Apr 7 06:08:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:08:35.673105 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70728d-cb9a-44af-a062-a4dda67fd943 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:08:35.764993 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70728d-cb9a-44af-a062-a4dda67fd943 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:08:35.797524 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183715c-fe13-4d92-b404-18f5df0cdb3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:08:35.798218 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183715c-fe13-4d92-b404-18f5df0cdb3c None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:35.798501 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183715c-fe13-4d92-b404-18f5df0cdb3c None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:35.798777 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183715c-fe13-4d92-b404-18f5df0cdb3c None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:35.799518 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3183715c-fe13-4d92-b404-18f5df0cdb3c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:08:35.799857 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3183715c-fe13-4d92-b404-18f5df0cdb3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:08:35.801216 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3183715c-fe13-4d92-b404-18f5df0cdb3c None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:08:35.808875 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 596/1196] 10.222.0.24 () {56 vars in 1099 bytes} [Thu Apr 7 06:08:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:08:35.814696 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4934c4-8f07-49aa-8530-6dacb221534c None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:08:35.915049 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4934c4-8f07-49aa-8530-6dacb221534c None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:08:35.945982 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3398b2f6-e55b-491f-acd5-392b51ca7b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:08:35.946834 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398b2f6-e55b-491f-acd5-392b51ca7b53 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:35.947114 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398b2f6-e55b-491f-acd5-392b51ca7b53 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:35.947387 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398b2f6-e55b-491f-acd5-392b51ca7b53 None admin] PATH_INFO: `/v3/users/78cfaec69c4e412b9cfb8bb35e1c6224` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:35.948572 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3398b2f6-e55b-491f-acd5-392b51ca7b53 None admin] RBAC: Authorizing `identity:get_user(user_id=78cfaec69c4e412b9cfb8bb35e1c6224)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:08:35.949988 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3398b2f6-e55b-491f-acd5-392b51ca7b53 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:08:35.951570 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 601/1197] 10.222.0.24 () {56 vars in 1177 bytes} [Thu Apr 7 06:08:35 2022] GET /identity/v3/users/78cfaec69c4e412b9cfb8bb35e1c6224 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:08:35.957852 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183715c-fe13-4d92-b404-18f5df0cdb3c None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:08:36.051929 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183715c-fe13-4d92-b404-18f5df0cdb3c None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:08:36.082829 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b885c3-c465-4211-ab6a-8c4662f72c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:08:36.083466 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b885c3-c465-4211-ab6a-8c4662f72c17 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:36.083764 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b885c3-c465-4211-ab6a-8c4662f72c17 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:36.084042 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b885c3-c465-4211-ab6a-8c4662f72c17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:36.146252 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b885c3-c465-4211-ab6a-8c4662f72c17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:08:36.147673 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b885c3-c465-4211-ab6a-8c4662f72c17 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:08:36.236838 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 597/1198] 10.222.0.24 () {58 vars in 1282 bytes} [Thu Apr 7 06:08:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 07 06:08:36.242983 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3398b2f6-e55b-491f-acd5-392b51ca7b53 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:08:36.334856 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3398b2f6-e55b-491f-acd5-392b51ca7b53 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:08:36.366235 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f67fa4-700e-49e7-b7b3-4d6e5c661b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:08:36.367067 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f67fa4-700e-49e7-b7b3-4d6e5c661b64 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:36.367347 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f67fa4-700e-49e7-b7b3-4d6e5c661b64 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:36.367618 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f67fa4-700e-49e7-b7b3-4d6e5c661b64 None admin] PATH_INFO: `/v3/projects/d1ce1531c1e64d7e9739530e7dad5db9` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:36.368787 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f67fa4-700e-49e7-b7b3-4d6e5c661b64 None admin] RBAC: Authorizing `identity:get_project(project_id=d1ce1531c1e64d7e9739530e7dad5db9)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:08:36.370195 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f67fa4-700e-49e7-b7b3-4d6e5c661b64 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:08:36.371854 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 602/1199] 10.222.0.24 () {56 vars in 1186 bytes} [Thu Apr 7 06:08:36 2022] GET /identity/v3/projects/d1ce1531c1e64d7e9739530e7dad5db9 => generated 361 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:08:36.377628 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b885c3-c465-4211-ab6a-8c4662f72c17 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:08:36.468175 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b885c3-c465-4211-ab6a-8c4662f72c17 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:08:36.500020 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc8c4bd-4b87-4ed0-a1a4-7fd5d42ab2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:08:36.500600 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8c4bd-4b87-4ed0-a1a4-7fd5d42ab2c8 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:08:36.500879 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8c4bd-4b87-4ed0-a1a4-7fd5d42ab2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:08:36.501149 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8c4bd-4b87-4ed0-a1a4-7fd5d42ab2c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:08:36.501963 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc8c4bd-4b87-4ed0-a1a4-7fd5d42ab2c8 None admin] RBAC: Adding query filter params (role.id=0fab680bc76f4a73826e9beb59e8129b, scope.project.id=d1ce1531c1e64d7e9739530e7dad5db9, user.id=78cfaec69c4e412b9cfb8bb35e1c6224) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:08:36.502312 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc8c4bd-4b87-4ed0-a1a4-7fd5d42ab2c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:08:36.503700 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc8c4bd-4b87-4ed0-a1a4-7fd5d42ab2c8 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:08:36.509119 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 598/1200] 10.222.0.24 () {56 vars in 1374 bytes} [Thu Apr 7 06:08:36 2022] GET /identity/v3/role_assignments?user.id=78cfaec69c4e412b9cfb8bb35e1c6224&scope.project.id=d1ce1531c1e64d7e9739530e7dad5db9&role.id=0fab680bc76f4a73826e9beb59e8129b => generated 608 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:09:58.954928 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ad151-7cfc-4660-967b-a57f8b575021 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:09:58.955501 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ad151-7cfc-4660-967b-a57f8b575021 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:09:58.955501 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ad151-7cfc-4660-967b-a57f8b575021 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:09:58.956869 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 603/1201] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:09:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:09:58.962048 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ba0a1-270a-48ae-be51-57d98e23b05e None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:09:58.962471 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ba0a1-270a-48ae-be51-57d98e23b05e None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:09:58.962607 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ba0a1-270a-48ae-be51-57d98e23b05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:09:58.978512 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-101ba0a1-270a-48ae-be51-57d98e23b05e None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:09:58.979738 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-101ba0a1-270a-48ae-be51-57d98e23b05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:09:59.042696 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 599/1202] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:09:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 07 06:09:59.069004 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ad151-7cfc-4660-967b-a57f8b575021 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:09:59.163669 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ad151-7cfc-4660-967b-a57f8b575021 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:09:59.196275 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef10387d-fd9f-460c-bc39-8c44139ca044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:09:59.197086 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10387d-fd9f-460c-bc39-8c44139ca044 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:09:59.197368 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10387d-fd9f-460c-bc39-8c44139ca044 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:09:59.197637 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10387d-fd9f-460c-bc39-8c44139ca044 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:09:59.207187 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef10387d-fd9f-460c-bc39-8c44139ca044 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:09:59.208641 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef10387d-fd9f-460c-bc39-8c44139ca044 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:09:59.225000 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-ef10387d-fd9f-460c-bc39-8c44139ca044 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:09:59.227489 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 604/1203] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:09:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:09:59.232092 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ba0a1-270a-48ae-be51-57d98e23b05e None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:09:59.327376 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ba0a1-270a-48ae-be51-57d98e23b05e None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:09:59.358847 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3cf30f-72eb-459b-a343-dec0c0f4761c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:09:59.359497 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3cf30f-72eb-459b-a343-dec0c0f4761c None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:09:59.360392 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3cf30f-72eb-459b-a343-dec0c0f4761c None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:09:59.360665 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3cf30f-72eb-459b-a343-dec0c0f4761c None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:09:59.361373 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3cf30f-72eb-459b-a343-dec0c0f4761c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:09:59.361674 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3cf30f-72eb-459b-a343-dec0c0f4761c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:09:59.363076 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3cf30f-72eb-459b-a343-dec0c0f4761c None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:09:59.374421 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 600/1204] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:09:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:09:59.380317 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef10387d-fd9f-460c-bc39-8c44139ca044 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:09:59.472776 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef10387d-fd9f-460c-bc39-8c44139ca044 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:09:59.504913 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe8870-f72a-4ebf-88cf-2c358236ca5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:09:59.505590 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe8870-f72a-4ebf-88cf-2c358236ca5d None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:09:59.505872 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe8870-f72a-4ebf-88cf-2c358236ca5d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:09:59.506141 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe8870-f72a-4ebf-88cf-2c358236ca5d None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:09:59.506837 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fe8870-f72a-4ebf-88cf-2c358236ca5d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:09:59.508283 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fe8870-f72a-4ebf-88cf-2c358236ca5d None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:09:59.670075 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 605/1205] 10.222.0.24 () {60 vars in 1132 bytes} [Thu Apr 7 06:09:59 2022] POST /identity/v3/users => generated 251 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:10:01.995713 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54f826-d17e-4d8a-88e0-df117d9a29a1 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:01.996282 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54f826-d17e-4d8a-88e0-df117d9a29a1 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:01.996282 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54f826-d17e-4d8a-88e0-df117d9a29a1 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:01.997672 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 601/1206] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:10:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:10:02.003728 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e03c1-e8f1-4eda-9f91-36a298458153 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:02.004135 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e03c1-e8f1-4eda-9f91-36a298458153 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:02.004319 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e03c1-e8f1-4eda-9f91-36a298458153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:02.020482 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-103e03c1-e8f1-4eda-9f91-36a298458153 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:10:02.021695 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-103e03c1-e8f1-4eda-9f91-36a298458153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:10:02.084100 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 606/1207] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:10:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 07 06:10:02.109308 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e54f826-d17e-4d8a-88e0-df117d9a29a1 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:02.204808 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e54f826-d17e-4d8a-88e0-df117d9a29a1 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:02.237097 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc00738-dfed-46de-ad97-4aaa6bcf0772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:02.237901 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc00738-dfed-46de-ad97-4aaa6bcf0772 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:02.238177 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc00738-dfed-46de-ad97-4aaa6bcf0772 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:02.238447 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc00738-dfed-46de-ad97-4aaa6bcf0772 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:02.248647 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc00738-dfed-46de-ad97-4aaa6bcf0772 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:10:02.255593 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-8cc00738-dfed-46de-ad97-4aaa6bcf0772 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 07 06:10:02.256813 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 602/1208] 10.222.0.24 () {56 vars in 1102 bytes} [Thu Apr 7 06:10:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:10:02.262869 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e03c1-e8f1-4eda-9f91-36a298458153 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:02.356691 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e03c1-e8f1-4eda-9f91-36a298458153 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:02.511486 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbff81f-eb53-4521-a45f-4f1b63a2e290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:02.512173 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbff81f-eb53-4521-a45f-4f1b63a2e290 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:02.512454 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbff81f-eb53-4521-a45f-4f1b63a2e290 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:02.512725 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbff81f-eb53-4521-a45f-4f1b63a2e290 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:02.513458 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbff81f-eb53-4521-a45f-4f1b63a2e290 None admin] RBAC: Adding query filter params (name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:10:02.513758 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbff81f-eb53-4521-a45f-4f1b63a2e290 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:02.515096 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbff81f-eb53-4521-a45f-4f1b63a2e290 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:02.523125 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 607/1209] 10.222.0.24 () {56 vars in 1103 bytes} [Thu Apr 7 06:10:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:10:02.528968 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc00738-dfed-46de-ad97-4aaa6bcf0772 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:02.624890 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc00738-dfed-46de-ad97-4aaa6bcf0772 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:02.657376 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d812ce4c-4d81-4ea7-a798-16146aa06d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:02.658157 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812ce4c-4d81-4ea7-a798-16146aa06d37 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:02.658443 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812ce4c-4d81-4ea7-a798-16146aa06d37 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:02.658718 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812ce4c-4d81-4ea7-a798-16146aa06d37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:02.668960 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d812ce4c-4d81-4ea7-a798-16146aa06d37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:02.670452 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d812ce4c-4d81-4ea7-a798-16146aa06d37 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:02.685875 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-d812ce4c-4d81-4ea7-a798-16146aa06d37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:10:02.687023 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 603/1210] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:10:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:10:02.692996 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbff81f-eb53-4521-a45f-4f1b63a2e290 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:02.787872 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbff81f-eb53-4521-a45f-4f1b63a2e290 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:02.819278 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf613aa-b843-4941-b9d0-6eb6d0805197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:02.819973 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf613aa-b843-4941-b9d0-6eb6d0805197 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:02.820259 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf613aa-b843-4941-b9d0-6eb6d0805197 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:02.820533 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf613aa-b843-4941-b9d0-6eb6d0805197 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:02.821247 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf613aa-b843-4941-b9d0-6eb6d0805197 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:10:02.821552 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf613aa-b843-4941-b9d0-6eb6d0805197 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:02.822955 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf613aa-b843-4941-b9d0-6eb6d0805197 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:02.834082 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 608/1211] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:10:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:10:02.839778 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d812ce4c-4d81-4ea7-a798-16146aa06d37 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:02.940684 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d812ce4c-4d81-4ea7-a798-16146aa06d37 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:02.972196 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2580e176-cdb0-471f-9ff1-1d9d65eea841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:02.972990 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580e176-cdb0-471f-9ff1-1d9d65eea841 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:02.973271 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580e176-cdb0-471f-9ff1-1d9d65eea841 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:02.973544 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580e176-cdb0-471f-9ff1-1d9d65eea841 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:02.981356 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2580e176-cdb0-471f-9ff1-1d9d65eea841 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:02.982779 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2580e176-cdb0-471f-9ff1-1d9d65eea841 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:02.996021 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-2580e176-cdb0-471f-9ff1-1d9d65eea841 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 07 06:10:02.997184 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 604/1212] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:10:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:10:03.003819 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf613aa-b843-4941-b9d0-6eb6d0805197 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:03.096846 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf613aa-b843-4941-b9d0-6eb6d0805197 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:03.128300 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f694b47c-4b92-4c00-87d3-6352c77ee23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:03.128958 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694b47c-4b92-4c00-87d3-6352c77ee23e None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:03.129241 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694b47c-4b92-4c00-87d3-6352c77ee23e None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:03.129515 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694b47c-4b92-4c00-87d3-6352c77ee23e None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:03.130339 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f694b47c-4b92-4c00-87d3-6352c77ee23e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:10:03.130645 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f694b47c-4b92-4c00-87d3-6352c77ee23e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:03.132073 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f694b47c-4b92-4c00-87d3-6352c77ee23e None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:03.148693 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 609/1213] 10.222.0.24 () {56 vars in 1143 bytes} [Thu Apr 7 06:10:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:10:03.154416 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2580e176-cdb0-471f-9ff1-1d9d65eea841 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:03.247719 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2580e176-cdb0-471f-9ff1-1d9d65eea841 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:03.279405 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb666b8d-98ef-4166-8c62-9fd06f67075c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:03.291006 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb666b8d-98ef-4166-8c62-9fd06f67075c None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:03.291006 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb666b8d-98ef-4166-8c62-9fd06f67075c None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:03.291006 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb666b8d-98ef-4166-8c62-9fd06f67075c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:03.343576 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb666b8d-98ef-4166-8c62-9fd06f67075c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:03.345037 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb666b8d-98ef-4166-8c62-9fd06f67075c None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:03.438978 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 605/1214] 10.222.0.24 () {58 vars in 1282 bytes} [Thu Apr 7 06:10:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 07 06:10:03.444836 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f694b47c-4b92-4c00-87d3-6352c77ee23e None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:03.537727 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f694b47c-4b92-4c00-87d3-6352c77ee23e None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:03.569797 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b046d-2aba-4cfe-bd16-ec18dc7988b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:03.570575 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b046d-2aba-4cfe-bd16-ec18dc7988b1 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:03.570856 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b046d-2aba-4cfe-bd16-ec18dc7988b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:03.571153 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b046d-2aba-4cfe-bd16-ec18dc7988b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:03.580470 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9b046d-2aba-4cfe-bd16-ec18dc7988b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:03.581910 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9b046d-2aba-4cfe-bd16-ec18dc7988b1 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:03.598063 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-fd9b046d-2aba-4cfe-bd16-ec18dc7988b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:10:03.599201 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 610/1215] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:10:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:10:03.604918 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb666b8d-98ef-4166-8c62-9fd06f67075c None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:03.700384 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb666b8d-98ef-4166-8c62-9fd06f67075c None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:03.732245 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b60365-e028-410a-879b-8ce83cee0906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:03.732900 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b60365-e028-410a-879b-8ce83cee0906 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:03.733185 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b60365-e028-410a-879b-8ce83cee0906 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:03.733460 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b60365-e028-410a-879b-8ce83cee0906 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:03.734174 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b60365-e028-410a-879b-8ce83cee0906 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:10:03.735119 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b60365-e028-410a-879b-8ce83cee0906 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:03.736506 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b60365-e028-410a-879b-8ce83cee0906 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:03.747394 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 606/1216] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:10:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:10:03.753105 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b046d-2aba-4cfe-bd16-ec18dc7988b1 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:03.847010 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b046d-2aba-4cfe-bd16-ec18dc7988b1 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:03.878660 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587cb395-f144-4597-9235-f7cb5d673385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:03.879459 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587cb395-f144-4597-9235-f7cb5d673385 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:03.879739 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587cb395-f144-4597-9235-f7cb5d673385 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:03.880041 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587cb395-f144-4597-9235-f7cb5d673385 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:03.886703 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587cb395-f144-4597-9235-f7cb5d673385 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:03.888257 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587cb395-f144-4597-9235-f7cb5d673385 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:03.901913 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-587cb395-f144-4597-9235-f7cb5d673385 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 07 06:10:03.903074 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 611/1217] 10.222.0.24 () {56 vars in 1111 bytes} [Thu Apr 7 06:10:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:10:03.909441 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b60365-e028-410a-879b-8ce83cee0906 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:04.007679 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b60365-e028-410a-879b-8ce83cee0906 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:04.047795 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b62670a-23da-4725-aabd-a28d295dd845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:04.048463 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62670a-23da-4725-aabd-a28d295dd845 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:04.048750 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62670a-23da-4725-aabd-a28d295dd845 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:04.049030 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62670a-23da-4725-aabd-a28d295dd845 None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:04.049823 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b62670a-23da-4725-aabd-a28d295dd845 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:10:04.050184 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b62670a-23da-4725-aabd-a28d295dd845 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:04.051623 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b62670a-23da-4725-aabd-a28d295dd845 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:04.063362 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 607/1218] 10.222.0.24 () {56 vars in 1148 bytes} [Thu Apr 7 06:10:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:10:04.069423 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587cb395-f144-4597-9235-f7cb5d673385 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:04.164556 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587cb395-f144-4597-9235-f7cb5d673385 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:04.196293 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a9e97e-1891-4fa9-8971-f00725393026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:04.196943 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9e97e-1891-4fa9-8971-f00725393026 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:04.197230 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9e97e-1891-4fa9-8971-f00725393026 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:04.197507 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9e97e-1891-4fa9-8971-f00725393026 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:04.198328 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a9e97e-1891-4fa9-8971-f00725393026 None admin] RBAC: Adding query filter params (role.id=64a6094c7a2942afb375bfb185843fd6, scope.project.id=de88f2c333ae49cfa7fff7fa1ed0022c, user.id=ff35b68665724754a6413bca0030016f) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:10:04.198640 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a9e97e-1891-4fa9-8971-f00725393026 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:04.200478 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a9e97e-1891-4fa9-8971-f00725393026 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:04.206162 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 612/1219] 10.222.0.24 () {56 vars in 1374 bytes} [Thu Apr 7 06:10:04 2022] GET /identity/v3/role_assignments?user.id=ff35b68665724754a6413bca0030016f&scope.project.id=de88f2c333ae49cfa7fff7fa1ed0022c&role.id=64a6094c7a2942afb375bfb185843fd6 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:10:06.450460 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e172fac-846a-4db0-b476-ec31508eafe9 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:06.451034 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e172fac-846a-4db0-b476-ec31508eafe9 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:06.451034 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e172fac-846a-4db0-b476-ec31508eafe9 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:06.452413 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 608/1220] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:10:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:10:06.458173 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888c8b3-9ac3-426b-aa01-73b6e82335cf None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:06.458544 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888c8b3-9ac3-426b-aa01-73b6e82335cf None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:06.458761 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888c8b3-9ac3-426b-aa01-73b6e82335cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:06.475516 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-d888c8b3-9ac3-426b-aa01-73b6e82335cf None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:10:06.476708 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d888c8b3-9ac3-426b-aa01-73b6e82335cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:10:06.538970 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 613/1221] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:10:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 07 06:10:06.561254 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e172fac-846a-4db0-b476-ec31508eafe9 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:06.658372 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e172fac-846a-4db0-b476-ec31508eafe9 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:06.691210 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b1161e-bec5-4b0f-b7de-f2fcaf41020d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:06.692033 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1161e-bec5-4b0f-b7de-f2fcaf41020d None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:06.692313 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1161e-bec5-4b0f-b7de-f2fcaf41020d None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:06.692583 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1161e-bec5-4b0f-b7de-f2fcaf41020d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:06.702273 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b1161e-bec5-4b0f-b7de-f2fcaf41020d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:10:06.709693 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-d3b1161e-bec5-4b0f-b7de-f2fcaf41020d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 07 06:10:06.710871 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 609/1222] 10.222.0.24 () {56 vars in 1102 bytes} [Thu Apr 7 06:10:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:10:06.718258 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d888c8b3-9ac3-426b-aa01-73b6e82335cf None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:06.810080 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d888c8b3-9ac3-426b-aa01-73b6e82335cf None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:06.842327 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b630b-8125-4b01-a079-94d3bb729e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:06.842989 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b630b-8125-4b01-a079-94d3bb729e92 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:06.843270 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b630b-8125-4b01-a079-94d3bb729e92 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:06.843542 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b630b-8125-4b01-a079-94d3bb729e92 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:06.844341 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33b630b-8125-4b01-a079-94d3bb729e92 None admin] RBAC: Adding query filter params (name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:10:06.844646 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33b630b-8125-4b01-a079-94d3bb729e92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:06.845990 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33b630b-8125-4b01-a079-94d3bb729e92 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:06.853429 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 614/1223] 10.222.0.24 () {56 vars in 1103 bytes} [Thu Apr 7 06:10:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:10:06.859227 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b1161e-bec5-4b0f-b7de-f2fcaf41020d None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:06.951922 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b1161e-bec5-4b0f-b7de-f2fcaf41020d None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:06.983967 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc10d84-1ca8-4a5c-90d6-65d386df6223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:06.985207 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc10d84-1ca8-4a5c-90d6-65d386df6223 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:06.985491 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc10d84-1ca8-4a5c-90d6-65d386df6223 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:06.985764 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc10d84-1ca8-4a5c-90d6-65d386df6223 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:06.995995 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc10d84-1ca8-4a5c-90d6-65d386df6223 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:06.997437 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc10d84-1ca8-4a5c-90d6-65d386df6223 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:07.013817 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-abc10d84-1ca8-4a5c-90d6-65d386df6223 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:10:07.014976 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 610/1224] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:10:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:10:07.020708 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b630b-8125-4b01-a079-94d3bb729e92 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:07.114544 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b630b-8125-4b01-a079-94d3bb729e92 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:07.145931 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca1383-54e5-4d08-a69f-0b1a58e6b7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:07.146587 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca1383-54e5-4d08-a69f-0b1a58e6b7dc None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:07.146868 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca1383-54e5-4d08-a69f-0b1a58e6b7dc None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:07.147142 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca1383-54e5-4d08-a69f-0b1a58e6b7dc None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:07.147882 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ca1383-54e5-4d08-a69f-0b1a58e6b7dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:10:07.148187 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ca1383-54e5-4d08-a69f-0b1a58e6b7dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:07.149558 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ca1383-54e5-4d08-a69f-0b1a58e6b7dc None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:07.160586 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 615/1225] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:10:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:10:07.166247 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc10d84-1ca8-4a5c-90d6-65d386df6223 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:07.260881 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc10d84-1ca8-4a5c-90d6-65d386df6223 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:07.291483 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2afadc-a332-459c-a80f-bb14653cf51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:07.292299 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2afadc-a332-459c-a80f-bb14653cf51c None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:07.292578 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2afadc-a332-459c-a80f-bb14653cf51c None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:07.292854 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2afadc-a332-459c-a80f-bb14653cf51c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:07.300380 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2afadc-a332-459c-a80f-bb14653cf51c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:07.301802 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2afadc-a332-459c-a80f-bb14653cf51c None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:07.315209 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-0c2afadc-a332-459c-a80f-bb14653cf51c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 07 06:10:07.316378 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 611/1226] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:10:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:10:07.324405 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca1383-54e5-4d08-a69f-0b1a58e6b7dc None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:07.415522 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca1383-54e5-4d08-a69f-0b1a58e6b7dc None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:07.448087 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d3bd5-0d97-4c3e-8f13-2a6bf831c63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:07.450590 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d3bd5-0d97-4c3e-8f13-2a6bf831c63c None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:07.450590 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d3bd5-0d97-4c3e-8f13-2a6bf831c63c None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:07.450590 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d3bd5-0d97-4c3e-8f13-2a6bf831c63c None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:07.450590 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9d3bd5-0d97-4c3e-8f13-2a6bf831c63c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:10:07.450590 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9d3bd5-0d97-4c3e-8f13-2a6bf831c63c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:07.451950 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9d3bd5-0d97-4c3e-8f13-2a6bf831c63c None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:07.469315 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 616/1227] 10.222.0.24 () {56 vars in 1143 bytes} [Thu Apr 7 06:10:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:10:07.474959 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2afadc-a332-459c-a80f-bb14653cf51c None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:07.570070 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2afadc-a332-459c-a80f-bb14653cf51c None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:07.601543 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d212e-47b3-4509-9ef8-0856583c8121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:07.602319 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d212e-47b3-4509-9ef8-0856583c8121 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:07.602633 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d212e-47b3-4509-9ef8-0856583c8121 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:07.602906 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d212e-47b3-4509-9ef8-0856583c8121 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:07.613431 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599d212e-47b3-4509-9ef8-0856583c8121 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:07.615115 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599d212e-47b3-4509-9ef8-0856583c8121 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:07.631000 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-599d212e-47b3-4509-9ef8-0856583c8121 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:10:07.632174 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 612/1228] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:10:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:10:07.638022 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d3bd5-0d97-4c3e-8f13-2a6bf831c63c None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:07.736353 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d3bd5-0d97-4c3e-8f13-2a6bf831c63c None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:07.770705 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365f7a5f-1599-44ef-b937-a1524e702172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:07.771390 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f7a5f-1599-44ef-b937-a1524e702172 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:07.771636 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f7a5f-1599-44ef-b937-a1524e702172 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:07.771934 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f7a5f-1599-44ef-b937-a1524e702172 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:07.772674 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365f7a5f-1599-44ef-b937-a1524e702172 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:10:07.772977 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365f7a5f-1599-44ef-b937-a1524e702172 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:07.774374 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365f7a5f-1599-44ef-b937-a1524e702172 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:07.785799 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 617/1229] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:10:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:10:07.791721 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d212e-47b3-4509-9ef8-0856583c8121 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:07.884868 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d212e-47b3-4509-9ef8-0856583c8121 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:07.916820 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5daa2c-405b-4cd0-900c-19d9664d73c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:07.917598 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5daa2c-405b-4cd0-900c-19d9664d73c1 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:07.917879 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5daa2c-405b-4cd0-900c-19d9664d73c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:07.918154 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5daa2c-405b-4cd0-900c-19d9664d73c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:07.924458 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5daa2c-405b-4cd0-900c-19d9664d73c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:07.925872 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5daa2c-405b-4cd0-900c-19d9664d73c1 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:07.939349 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-4c5daa2c-405b-4cd0-900c-19d9664d73c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 07 06:10:07.940519 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 613/1230] 10.222.0.24 () {56 vars in 1111 bytes} [Thu Apr 7 06:10:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:10:07.946192 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365f7a5f-1599-44ef-b937-a1524e702172 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:08.040358 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365f7a5f-1599-44ef-b937-a1524e702172 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:08.070815 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b1b034-41e2-4db4-9a53-7d5b0a478773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:08.071456 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1b034-41e2-4db4-9a53-7d5b0a478773 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:08.071736 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1b034-41e2-4db4-9a53-7d5b0a478773 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:08.072037 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1b034-41e2-4db4-9a53-7d5b0a478773 None admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:08.072806 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b1b034-41e2-4db4-9a53-7d5b0a478773 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:10:08.073110 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b1b034-41e2-4db4-9a53-7d5b0a478773 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:08.074539 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b1b034-41e2-4db4-9a53-7d5b0a478773 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:08.086298 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 618/1231] 10.222.0.24 () {56 vars in 1148 bytes} [Thu Apr 7 06:10:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:10:08.092126 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5daa2c-405b-4cd0-900c-19d9664d73c1 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:08.186256 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5daa2c-405b-4cd0-900c-19d9664d73c1 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:08.218658 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f3cbe9-e9d0-4845-9974-4bfd376ce21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:08.223415 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3cbe9-e9d0-4845-9974-4bfd376ce21d None admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:08.223415 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3cbe9-e9d0-4845-9974-4bfd376ce21d None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:08.223415 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3cbe9-e9d0-4845-9974-4bfd376ce21d None admin] PATH_INFO: `/v3/projects/de88f2c333ae49cfa7fff7fa1ed0022c/users/ff35b68665724754a6413bca0030016f/roles/64a6094c7a2942afb375bfb185843fd6` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:08.233814 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f3cbe9-e9d0-4845-9974-4bfd376ce21d None admin] RBAC: Authorizing `identity:create_grant(project_id=de88f2c333ae49cfa7fff7fa1ed0022c, user_id=ff35b68665724754a6413bca0030016f, role_id=64a6094c7a2942afb375bfb185843fd6)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:08.235283 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f3cbe9-e9d0-4845-9974-4bfd376ce21d None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:08.337885 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 614/1232] 10.222.0.24 () {58 vars in 1439 bytes} [Thu Apr 7 06:10:08 2022] PUT /identity/v3/projects/de88f2c333ae49cfa7fff7fa1ed0022c/users/ff35b68665724754a6413bca0030016f/roles/64a6094c7a2942afb375bfb185843fd6 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:10:10.598713 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b951358-c97d-4bb1-8fe9-c34cd79546b9 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:10.599257 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b951358-c97d-4bb1-8fe9-c34cd79546b9 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:10.599257 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b951358-c97d-4bb1-8fe9-c34cd79546b9 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:10.600705 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 619/1233] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:10:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:10:10.605811 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df934007-f690-4726-beb4-963d7900d90c None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:10.606226 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df934007-f690-4726-beb4-963d7900d90c None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:10.606368 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df934007-f690-4726-beb4-963d7900d90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:10.622322 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-df934007-f690-4726-beb4-963d7900d90c None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:10:10.623485 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-df934007-f690-4726-beb4-963d7900d90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:10:10.692377 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 615/1234] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:10:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 07 06:10:10.717642 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b951358-c97d-4bb1-8fe9-c34cd79546b9 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:10.812164 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b951358-c97d-4bb1-8fe9-c34cd79546b9 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:10.844018 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbe01e8-0b20-44e7-bb27-618fb9261e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:10.844804 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe01e8-0b20-44e7-bb27-618fb9261e89 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:10.845098 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe01e8-0b20-44e7-bb27-618fb9261e89 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:10.845400 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe01e8-0b20-44e7-bb27-618fb9261e89 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:10.856196 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbe01e8-0b20-44e7-bb27-618fb9261e89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:10:10.862379 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-fbbe01e8-0b20-44e7-bb27-618fb9261e89 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 07 06:10:10.863544 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 620/1235] 10.222.0.24 () {56 vars in 1102 bytes} [Thu Apr 7 06:10:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:10:10.869781 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df934007-f690-4726-beb4-963d7900d90c None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:10.963136 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df934007-f690-4726-beb4-963d7900d90c None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:10.995102 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6db014-fd0f-40d0-84ac-bc7b007d7f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:10.995781 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6db014-fd0f-40d0-84ac-bc7b007d7f34 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:10.996066 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6db014-fd0f-40d0-84ac-bc7b007d7f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:10.996337 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6db014-fd0f-40d0-84ac-bc7b007d7f34 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:10.997080 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6db014-fd0f-40d0-84ac-bc7b007d7f34 None admin] RBAC: Adding query filter params (name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:10:10.997382 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6db014-fd0f-40d0-84ac-bc7b007d7f34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:10.998740 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6db014-fd0f-40d0-84ac-bc7b007d7f34 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:11.007376 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 616/1236] 10.222.0.24 () {56 vars in 1103 bytes} [Thu Apr 7 06:10:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:10:11.013135 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbe01e8-0b20-44e7-bb27-618fb9261e89 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:11.107934 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbe01e8-0b20-44e7-bb27-618fb9261e89 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:11.139848 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927752e0-63bf-4518-a401-52445f96fbce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:11.140662 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927752e0-63bf-4518-a401-52445f96fbce None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:11.140951 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927752e0-63bf-4518-a401-52445f96fbce None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:11.141230 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927752e0-63bf-4518-a401-52445f96fbce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:11.151152 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927752e0-63bf-4518-a401-52445f96fbce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:11.152622 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927752e0-63bf-4518-a401-52445f96fbce None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:11.168873 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-927752e0-63bf-4518-a401-52445f96fbce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:10:11.170025 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 621/1237] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:10:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:10:11.176439 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6db014-fd0f-40d0-84ac-bc7b007d7f34 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:11.270553 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6db014-fd0f-40d0-84ac-bc7b007d7f34 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:11.303559 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e84b1d-7e09-470c-9fc6-d4043ba2a549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:11.304270 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e84b1d-7e09-470c-9fc6-d4043ba2a549 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:11.304556 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e84b1d-7e09-470c-9fc6-d4043ba2a549 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:11.304834 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e84b1d-7e09-470c-9fc6-d4043ba2a549 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:11.305548 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e84b1d-7e09-470c-9fc6-d4043ba2a549 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:10:11.305855 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e84b1d-7e09-470c-9fc6-d4043ba2a549 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:11.307219 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e84b1d-7e09-470c-9fc6-d4043ba2a549 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:11.317926 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 617/1238] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:10:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:10:11.323601 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927752e0-63bf-4518-a401-52445f96fbce None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:11.422560 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927752e0-63bf-4518-a401-52445f96fbce None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:11.453209 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8498174-e744-4dc7-8aba-a43558105eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:11.453993 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8498174-e744-4dc7-8aba-a43558105eaa None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:11.454275 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8498174-e744-4dc7-8aba-a43558105eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:11.454568 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8498174-e744-4dc7-8aba-a43558105eaa None admin] PATH_INFO: `/v3/users/placement` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:11.461498 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8498174-e744-4dc7-8aba-a43558105eaa None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:11.462939 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8498174-e744-4dc7-8aba-a43558105eaa None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:11.476365 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-a8498174-e744-4dc7-8aba-a43558105eaa None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 07 06:10:11.477515 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 622/1239] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:10:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:10:11.483297 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e84b1d-7e09-470c-9fc6-d4043ba2a549 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:11.579371 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e84b1d-7e09-470c-9fc6-d4043ba2a549 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:11.611124 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa8f32-e5f9-4c98-8b8a-feaec52ec8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:11.611811 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa8f32-e5f9-4c98-8b8a-feaec52ec8a0 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:11.612100 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa8f32-e5f9-4c98-8b8a-feaec52ec8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:11.612377 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa8f32-e5f9-4c98-8b8a-feaec52ec8a0 None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:11.613208 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaa8f32-e5f9-4c98-8b8a-feaec52ec8a0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:10:11.613514 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaa8f32-e5f9-4c98-8b8a-feaec52ec8a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:11.615198 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaa8f32-e5f9-4c98-8b8a-feaec52ec8a0 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:11.632311 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 618/1240] 10.222.0.24 () {56 vars in 1143 bytes} [Thu Apr 7 06:10:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:10:11.637987 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8498174-e744-4dc7-8aba-a43558105eaa None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:11.734776 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8498174-e744-4dc7-8aba-a43558105eaa None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:11.767550 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8486b-18f1-49ad-a601-00a370b03cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:11.768222 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8486b-18f1-49ad-a601-00a370b03cc9 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:11.768525 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8486b-18f1-49ad-a601-00a370b03cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:11.768800 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8486b-18f1-49ad-a601-00a370b03cc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:11.831148 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda8486b-18f1-49ad-a601-00a370b03cc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:11.832634 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda8486b-18f1-49ad-a601-00a370b03cc9 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:11.924200 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 623/1241] 10.222.0.24 () {58 vars in 1282 bytes} [Thu Apr 7 06:10:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 07 06:10:11.930232 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa8f32-e5f9-4c98-8b8a-feaec52ec8a0 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:12.024568 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa8f32-e5f9-4c98-8b8a-feaec52ec8a0 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:12.057457 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e8bb8d-eec1-43af-bd25-1d751e251e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:12.058233 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8bb8d-eec1-43af-bd25-1d751e251e88 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:12.058578 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8bb8d-eec1-43af-bd25-1d751e251e88 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:12.058846 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8bb8d-eec1-43af-bd25-1d751e251e88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:12.068970 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e8bb8d-eec1-43af-bd25-1d751e251e88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:12.070398 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e8bb8d-eec1-43af-bd25-1d751e251e88 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:12.087128 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-e9e8bb8d-eec1-43af-bd25-1d751e251e88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:10:12.092968 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 619/1242] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:10:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:10:12.094198 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8486b-18f1-49ad-a601-00a370b03cc9 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:12.198465 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8486b-18f1-49ad-a601-00a370b03cc9 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:12.230205 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b70b24-29fb-4701-830b-e721486b7fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:12.230857 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b70b24-29fb-4701-830b-e721486b7fc0 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:12.231135 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b70b24-29fb-4701-830b-e721486b7fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:12.231443 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b70b24-29fb-4701-830b-e721486b7fc0 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:12.232175 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b70b24-29fb-4701-830b-e721486b7fc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:10:12.232477 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b70b24-29fb-4701-830b-e721486b7fc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:12.233815 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b70b24-29fb-4701-830b-e721486b7fc0 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:12.245392 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 624/1243] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:10:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:10:12.251626 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e8bb8d-eec1-43af-bd25-1d751e251e88 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:12.365137 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e8bb8d-eec1-43af-bd25-1d751e251e88 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:12.402937 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c8e24-748c-4b62-a904-7af879c2d7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:12.403926 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c8e24-748c-4b62-a904-7af879c2d7fe None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:12.404208 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c8e24-748c-4b62-a904-7af879c2d7fe None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:12.404564 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c8e24-748c-4b62-a904-7af879c2d7fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:12.411052 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0c8e24-748c-4b62-a904-7af879c2d7fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:12.412954 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0c8e24-748c-4b62-a904-7af879c2d7fe None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:12.428616 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-fc0c8e24-748c-4b62-a904-7af879c2d7fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 07 06:10:12.432461 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 620/1244] 10.222.0.24 () {56 vars in 1111 bytes} [Thu Apr 7 06:10:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:10:12.436318 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b70b24-29fb-4701-830b-e721486b7fc0 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:12.537339 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b70b24-29fb-4701-830b-e721486b7fc0 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:12.569863 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5ed9a7-1bda-4d41-a8bd-07d835e10e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:12.570534 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ed9a7-1bda-4d41-a8bd-07d835e10e85 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:12.570810 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ed9a7-1bda-4d41-a8bd-07d835e10e85 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:12.571085 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ed9a7-1bda-4d41-a8bd-07d835e10e85 None admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:12.571893 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5ed9a7-1bda-4d41-a8bd-07d835e10e85 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:10:12.572203 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5ed9a7-1bda-4d41-a8bd-07d835e10e85 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:12.573674 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5ed9a7-1bda-4d41-a8bd-07d835e10e85 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:12.585236 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 625/1245] 10.222.0.24 () {56 vars in 1148 bytes} [Thu Apr 7 06:10:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:10:12.591304 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c8e24-748c-4b62-a904-7af879c2d7fe None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:12.687888 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c8e24-748c-4b62-a904-7af879c2d7fe None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:12.720111 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f7eea-0b4e-4f93-9495-234be047a793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:12.720764 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f7eea-0b4e-4f93-9495-234be047a793 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:12.721052 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f7eea-0b4e-4f93-9495-234be047a793 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:12.721338 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f7eea-0b4e-4f93-9495-234be047a793 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:12.722634 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136f7eea-0b4e-4f93-9495-234be047a793 None admin] RBAC: Adding query filter params (role.id=64a6094c7a2942afb375bfb185843fd6, scope.project.id=de88f2c333ae49cfa7fff7fa1ed0022c, user.id=ff35b68665724754a6413bca0030016f) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:10:12.723208 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136f7eea-0b4e-4f93-9495-234be047a793 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:12.725214 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136f7eea-0b4e-4f93-9495-234be047a793 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:12.735012 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 621/1246] 10.222.0.24 () {56 vars in 1374 bytes} [Thu Apr 7 06:10:12 2022] GET /identity/v3/role_assignments?user.id=ff35b68665724754a6413bca0030016f&scope.project.id=de88f2c333ae49cfa7fff7fa1ed0022c&role.id=64a6094c7a2942afb375bfb185843fd6 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:10:15.058934 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d594d2-98e3-4248-b45c-e618b319ad81 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:15.059496 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d594d2-98e3-4248-b45c-e618b319ad81 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:15.059496 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d594d2-98e3-4248-b45c-e618b319ad81 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:15.061043 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 626/1247] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:10:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:10:15.066551 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd42d2-f99b-4823-905b-912dd5b34d16 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:15.066995 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd42d2-f99b-4823-905b-912dd5b34d16 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:15.067146 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd42d2-f99b-4823-905b-912dd5b34d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:15.084132 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-71fd42d2-f99b-4823-905b-912dd5b34d16 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:10:15.085675 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-71fd42d2-f99b-4823-905b-912dd5b34d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:10:15.148873 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 622/1248] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:10:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 07 06:10:15.173977 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d594d2-98e3-4248-b45c-e618b319ad81 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:15.271637 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d594d2-98e3-4248-b45c-e618b319ad81 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:15.303419 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb6f9b-5567-4e06-b9dd-e427f0ddc0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:15.304226 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb6f9b-5567-4e06-b9dd-e427f0ddc0e6 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:15.304505 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb6f9b-5567-4e06-b9dd-e427f0ddc0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:15.304776 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb6f9b-5567-4e06-b9dd-e427f0ddc0e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:15.316682 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbb6f9b-5567-4e06-b9dd-e427f0ddc0e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:10:15.321862 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-bcbb6f9b-5567-4e06-b9dd-e427f0ddc0e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 07 06:10:15.323031 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 627/1249] 10.222.0.24 () {56 vars in 1096 bytes} [Thu Apr 7 06:10:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:10:15.328999 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fd42d2-f99b-4823-905b-912dd5b34d16 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:15.419820 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fd42d2-f99b-4823-905b-912dd5b34d16 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:15.451807 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57cb946-fcbf-499c-afe4-fa5dda1566ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:15.452467 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57cb946-fcbf-499c-afe4-fa5dda1566ca None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:15.454393 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57cb946-fcbf-499c-afe4-fa5dda1566ca None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:15.454393 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57cb946-fcbf-499c-afe4-fa5dda1566ca None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:15.454393 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57cb946-fcbf-499c-afe4-fa5dda1566ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:10:15.454393 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57cb946-fcbf-499c-afe4-fa5dda1566ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:15.455386 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57cb946-fcbf-499c-afe4-fa5dda1566ca None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:15.463049 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 623/1250] 10.222.0.24 () {56 vars in 1099 bytes} [Thu Apr 7 06:10:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:10:15.468686 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb6f9b-5567-4e06-b9dd-e427f0ddc0e6 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:15.565125 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb6f9b-5567-4e06-b9dd-e427f0ddc0e6 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:15.597276 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18277271-7ea8-48be-8d6b-71bbfd598e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:15.597988 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18277271-7ea8-48be-8d6b-71bbfd598e93 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:15.598267 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18277271-7ea8-48be-8d6b-71bbfd598e93 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:15.598538 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18277271-7ea8-48be-8d6b-71bbfd598e93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:15.608377 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18277271-7ea8-48be-8d6b-71bbfd598e93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:15.610401 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18277271-7ea8-48be-8d6b-71bbfd598e93 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:15.626152 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-18277271-7ea8-48be-8d6b-71bbfd598e93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:10:15.627285 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 628/1251] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:10:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 07 06:10:15.633116 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57cb946-fcbf-499c-afe4-fa5dda1566ca None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:15.730375 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57cb946-fcbf-499c-afe4-fa5dda1566ca None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:15.763550 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a78fc-b81a-43c6-aa34-56ab10ad692a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:15.764240 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a78fc-b81a-43c6-aa34-56ab10ad692a None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:15.764524 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a78fc-b81a-43c6-aa34-56ab10ad692a None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:15.764797 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a78fc-b81a-43c6-aa34-56ab10ad692a None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:15.765509 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049a78fc-b81a-43c6-aa34-56ab10ad692a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:10:15.765815 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049a78fc-b81a-43c6-aa34-56ab10ad692a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:15.767216 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049a78fc-b81a-43c6-aa34-56ab10ad692a None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:15.778869 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 624/1252] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:10:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:10:15.785096 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18277271-7ea8-48be-8d6b-71bbfd598e93 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:15.879118 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18277271-7ea8-48be-8d6b-71bbfd598e93 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:15.910498 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d7a4d-11a5-4959-9515-13f7581d8ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:15.911284 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d7a4d-11a5-4959-9515-13f7581d8ff9 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:15.911567 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d7a4d-11a5-4959-9515-13f7581d8ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:15.911871 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d7a4d-11a5-4959-9515-13f7581d8ff9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:15.918944 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9d7a4d-11a5-4959-9515-13f7581d8ff9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:15.924620 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9d7a4d-11a5-4959-9515-13f7581d8ff9 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:15.933938 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-0b9d7a4d-11a5-4959-9515-13f7581d8ff9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 07 06:10:15.935081 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 629/1253] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:10:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:10:15.940888 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a78fc-b81a-43c6-aa34-56ab10ad692a None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:16.035931 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a78fc-b81a-43c6-aa34-56ab10ad692a None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:16.074203 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246583cf-d74c-4edb-aacf-55c73c033daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:16.074906 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246583cf-d74c-4edb-aacf-55c73c033daf None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:16.075192 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246583cf-d74c-4edb-aacf-55c73c033daf None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:16.075467 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246583cf-d74c-4edb-aacf-55c73c033daf None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:16.076361 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246583cf-d74c-4edb-aacf-55c73c033daf None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:10:16.076673 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246583cf-d74c-4edb-aacf-55c73c033daf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:16.078684 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246583cf-d74c-4edb-aacf-55c73c033daf None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:16.096055 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 625/1254] 10.222.0.24 () {56 vars in 1143 bytes} [Thu Apr 7 06:10:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:10:16.101980 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d7a4d-11a5-4959-9515-13f7581d8ff9 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:16.195569 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d7a4d-11a5-4959-9515-13f7581d8ff9 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:16.227426 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e35f8-9567-47d2-8ce5-6842861ca4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:16.228098 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e35f8-9567-47d2-8ce5-6842861ca4c7 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:16.228383 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e35f8-9567-47d2-8ce5-6842861ca4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:16.228657 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e35f8-9567-47d2-8ce5-6842861ca4c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:16.291185 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909e35f8-9567-47d2-8ce5-6842861ca4c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:16.292636 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909e35f8-9567-47d2-8ce5-6842861ca4c7 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:16.385484 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 630/1255] 10.222.0.24 () {58 vars in 1282 bytes} [Thu Apr 7 06:10:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 07 06:10:16.391352 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246583cf-d74c-4edb-aacf-55c73c033daf None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:16.485452 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246583cf-d74c-4edb-aacf-55c73c033daf None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:16.517202 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e687b-63fc-403d-8752-252c667e52ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:16.517981 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e687b-63fc-403d-8752-252c667e52ef None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:16.519039 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e687b-63fc-403d-8752-252c667e52ef None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:16.519039 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e687b-63fc-403d-8752-252c667e52ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:16.528226 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77e687b-63fc-403d-8752-252c667e52ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:16.529836 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77e687b-63fc-403d-8752-252c667e52ef None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:16.546416 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-a77e687b-63fc-403d-8752-252c667e52ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:10:16.547626 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 626/1256] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:10:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:10:16.553291 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e35f8-9567-47d2-8ce5-6842861ca4c7 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:16.647547 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e35f8-9567-47d2-8ce5-6842861ca4c7 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:16.678507 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de5adfd-62ec-4390-b58e-7bb38c4916d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:16.679158 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5adfd-62ec-4390-b58e-7bb38c4916d5 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:16.679442 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5adfd-62ec-4390-b58e-7bb38c4916d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:16.679829 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5adfd-62ec-4390-b58e-7bb38c4916d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:16.680457 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de5adfd-62ec-4390-b58e-7bb38c4916d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:10:16.680760 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de5adfd-62ec-4390-b58e-7bb38c4916d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:16.682105 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de5adfd-62ec-4390-b58e-7bb38c4916d5 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:16.693136 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 631/1257] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:10:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:10:16.698835 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e687b-63fc-403d-8752-252c667e52ef None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:16.794392 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e687b-63fc-403d-8752-252c667e52ef None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:16.826307 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be3e6cf-4001-45ad-94b8-3066e72ed8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:16.827089 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3e6cf-4001-45ad-94b8-3066e72ed8fa None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:16.827373 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3e6cf-4001-45ad-94b8-3066e72ed8fa None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:16.827649 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3e6cf-4001-45ad-94b8-3066e72ed8fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:16.834473 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be3e6cf-4001-45ad-94b8-3066e72ed8fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:16.835936 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be3e6cf-4001-45ad-94b8-3066e72ed8fa None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:16.848962 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-1be3e6cf-4001-45ad-94b8-3066e72ed8fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 07 06:10:16.850117 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 627/1258] 10.222.0.24 () {56 vars in 1111 bytes} [Thu Apr 7 06:10:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:10:16.856043 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de5adfd-62ec-4390-b58e-7bb38c4916d5 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:16.948762 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de5adfd-62ec-4390-b58e-7bb38c4916d5 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:16.980517 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d87c1ae-9337-432a-8a59-5bd63ba019a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:16.983517 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87c1ae-9337-432a-8a59-5bd63ba019a6 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:16.983517 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87c1ae-9337-432a-8a59-5bd63ba019a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:16.983517 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87c1ae-9337-432a-8a59-5bd63ba019a6 None admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:16.983517 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d87c1ae-9337-432a-8a59-5bd63ba019a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:10:16.983517 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d87c1ae-9337-432a-8a59-5bd63ba019a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:16.984212 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d87c1ae-9337-432a-8a59-5bd63ba019a6 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:16.995669 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 632/1259] 10.222.0.24 () {56 vars in 1148 bytes} [Thu Apr 7 06:10:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:10:17.001801 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be3e6cf-4001-45ad-94b8-3066e72ed8fa None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:17.097595 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be3e6cf-4001-45ad-94b8-3066e72ed8fa None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:17.129081 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0446563d-9bdb-4a46-a745-e85d8657f383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:17.132534 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446563d-9bdb-4a46-a745-e85d8657f383 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:17.132534 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446563d-9bdb-4a46-a745-e85d8657f383 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:17.132534 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446563d-9bdb-4a46-a745-e85d8657f383 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:17.132534 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0446563d-9bdb-4a46-a745-e85d8657f383 None admin] RBAC: Adding query filter params (role.id=0fab680bc76f4a73826e9beb59e8129b, scope.project.id=de88f2c333ae49cfa7fff7fa1ed0022c, user.id=ff35b68665724754a6413bca0030016f) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:10:17.132534 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0446563d-9bdb-4a46-a745-e85d8657f383 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:17.133017 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0446563d-9bdb-4a46-a745-e85d8657f383 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:17.137883 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 628/1260] 10.222.0.24 () {56 vars in 1374 bytes} [Thu Apr 7 06:10:17 2022] GET /identity/v3/role_assignments?user.id=ff35b68665724754a6413bca0030016f&scope.project.id=de88f2c333ae49cfa7fff7fa1ed0022c&role.id=0fab680bc76f4a73826e9beb59e8129b => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:10:19.389678 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b03c4e-80aa-437e-a3f9-cff9a32d9807 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:19.390227 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b03c4e-80aa-437e-a3f9-cff9a32d9807 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:19.390894 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b03c4e-80aa-437e-a3f9-cff9a32d9807 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:19.392319 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 633/1261] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:10:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:10:19.397516 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2ccf4-459e-44ee-b8e4-f3cecd7ac37b None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:19.402226 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2ccf4-459e-44ee-b8e4-f3cecd7ac37b None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:19.402226 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2ccf4-459e-44ee-b8e4-f3cecd7ac37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:19.414307 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-73e2ccf4-459e-44ee-b8e4-f3cecd7ac37b None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:10:19.415469 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-73e2ccf4-459e-44ee-b8e4-f3cecd7ac37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:10:19.477990 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 629/1262] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:10:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 07 06:10:19.501366 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b03c4e-80aa-437e-a3f9-cff9a32d9807 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:19.596666 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b03c4e-80aa-437e-a3f9-cff9a32d9807 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:19.630718 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42109e8b-e3c7-459f-987c-29e0cb5d37b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:19.631514 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42109e8b-e3c7-459f-987c-29e0cb5d37b5 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:19.631823 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42109e8b-e3c7-459f-987c-29e0cb5d37b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:19.632099 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42109e8b-e3c7-459f-987c-29e0cb5d37b5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:19.642602 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42109e8b-e3c7-459f-987c-29e0cb5d37b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:10:19.649540 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-42109e8b-e3c7-459f-987c-29e0cb5d37b5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 07 06:10:19.650722 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 634/1263] 10.222.0.24 () {56 vars in 1096 bytes} [Thu Apr 7 06:10:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:10:19.658273 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e2ccf4-459e-44ee-b8e4-f3cecd7ac37b None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:19.760510 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e2ccf4-459e-44ee-b8e4-f3cecd7ac37b None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:19.794050 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673af397-0229-48f6-a701-6060847895b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:19.816580 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673af397-0229-48f6-a701-6060847895b9 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:19.816580 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673af397-0229-48f6-a701-6060847895b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:19.816580 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673af397-0229-48f6-a701-6060847895b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:19.816580 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673af397-0229-48f6-a701-6060847895b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:10:19.816580 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673af397-0229-48f6-a701-6060847895b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:19.816580 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673af397-0229-48f6-a701-6060847895b9 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:19.817105 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 630/1264] 10.222.0.24 () {56 vars in 1099 bytes} [Thu Apr 7 06:10:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:10:19.817189 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42109e8b-e3c7-459f-987c-29e0cb5d37b5 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:19.905496 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42109e8b-e3c7-459f-987c-29e0cb5d37b5 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:19.936802 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1322ec4-a3e6-49c4-b995-89fa12b59dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:19.938125 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1322ec4-a3e6-49c4-b995-89fa12b59dc0 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:19.938410 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1322ec4-a3e6-49c4-b995-89fa12b59dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:19.938683 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1322ec4-a3e6-49c4-b995-89fa12b59dc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:19.948542 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1322ec4-a3e6-49c4-b995-89fa12b59dc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:19.949959 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1322ec4-a3e6-49c4-b995-89fa12b59dc0 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:19.965357 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-b1322ec4-a3e6-49c4-b995-89fa12b59dc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:10:19.966489 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 635/1265] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:10:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:10:19.972236 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673af397-0229-48f6-a701-6060847895b9 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:20.071175 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673af397-0229-48f6-a701-6060847895b9 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:20.102624 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a994a-2618-40d2-b0a3-b9fe75fec8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:20.117315 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a994a-2618-40d2-b0a3-b9fe75fec8b7 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:20.117315 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a994a-2618-40d2-b0a3-b9fe75fec8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:20.117315 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a994a-2618-40d2-b0a3-b9fe75fec8b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:20.117315 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0a994a-2618-40d2-b0a3-b9fe75fec8b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:10:20.117315 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0a994a-2618-40d2-b0a3-b9fe75fec8b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:20.117315 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0a994a-2618-40d2-b0a3-b9fe75fec8b7 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:20.118242 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 631/1266] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:10:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:10:20.123945 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1322ec4-a3e6-49c4-b995-89fa12b59dc0 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:20.217271 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1322ec4-a3e6-49c4-b995-89fa12b59dc0 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:20.248588 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebf3c5c-64d2-44e6-ad61-2f5e314db996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:20.249376 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf3c5c-64d2-44e6-ad61-2f5e314db996 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:20.250193 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf3c5c-64d2-44e6-ad61-2f5e314db996 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:20.250468 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf3c5c-64d2-44e6-ad61-2f5e314db996 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:20.257705 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebf3c5c-64d2-44e6-ad61-2f5e314db996 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:20.259126 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebf3c5c-64d2-44e6-ad61-2f5e314db996 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:20.272532 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-0ebf3c5c-64d2-44e6-ad61-2f5e314db996 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 07 06:10:20.273682 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 636/1267] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:10:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:10:20.279538 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a994a-2618-40d2-b0a3-b9fe75fec8b7 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:20.374299 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a994a-2618-40d2-b0a3-b9fe75fec8b7 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:20.407235 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f7745-6a2f-4f42-a5db-14e6c25c6594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:20.407929 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f7745-6a2f-4f42-a5db-14e6c25c6594 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:20.408214 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f7745-6a2f-4f42-a5db-14e6c25c6594 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:20.408487 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f7745-6a2f-4f42-a5db-14e6c25c6594 None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:20.409315 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f7745-6a2f-4f42-a5db-14e6c25c6594 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:10:20.409683 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f7745-6a2f-4f42-a5db-14e6c25c6594 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:20.411121 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f7745-6a2f-4f42-a5db-14e6c25c6594 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:20.427330 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 632/1268] 10.222.0.24 () {56 vars in 1143 bytes} [Thu Apr 7 06:10:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:10:20.433226 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebf3c5c-64d2-44e6-ad61-2f5e314db996 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:20.527488 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebf3c5c-64d2-44e6-ad61-2f5e314db996 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:20.558976 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d1f4f-07fc-40b8-9814-ae550c690160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:20.559782 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d1f4f-07fc-40b8-9814-ae550c690160 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:20.560066 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d1f4f-07fc-40b8-9814-ae550c690160 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:20.560338 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d1f4f-07fc-40b8-9814-ae550c690160 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:20.570926 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d1f4f-07fc-40b8-9814-ae550c690160 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:20.572384 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d1f4f-07fc-40b8-9814-ae550c690160 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:20.587931 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-645d1f4f-07fc-40b8-9814-ae550c690160 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:10:20.589080 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 637/1269] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:10:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:10:20.594886 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f7745-6a2f-4f42-a5db-14e6c25c6594 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:20.691048 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f7745-6a2f-4f42-a5db-14e6c25c6594 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:20.723348 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6f7a92-92ac-434b-9e0a-6508ae4759dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:20.724052 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f7a92-92ac-434b-9e0a-6508ae4759dc None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:20.724335 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f7a92-92ac-434b-9e0a-6508ae4759dc None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:20.724607 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f7a92-92ac-434b-9e0a-6508ae4759dc None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:20.725313 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6f7a92-92ac-434b-9e0a-6508ae4759dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:10:20.725614 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6f7a92-92ac-434b-9e0a-6508ae4759dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:20.726960 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6f7a92-92ac-434b-9e0a-6508ae4759dc None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:20.738242 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 633/1270] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:10:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:10:20.744220 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d1f4f-07fc-40b8-9814-ae550c690160 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:20.838168 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d1f4f-07fc-40b8-9814-ae550c690160 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:20.870759 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ec96da-adad-48d1-95ef-50d2788df4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:20.871548 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec96da-adad-48d1-95ef-50d2788df4c6 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:20.871883 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec96da-adad-48d1-95ef-50d2788df4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:20.872164 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec96da-adad-48d1-95ef-50d2788df4c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:20.878555 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ec96da-adad-48d1-95ef-50d2788df4c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:20.880016 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ec96da-adad-48d1-95ef-50d2788df4c6 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:20.892899 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-47ec96da-adad-48d1-95ef-50d2788df4c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 07 06:10:20.894057 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 638/1271] 10.222.0.24 () {56 vars in 1111 bytes} [Thu Apr 7 06:10:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:10:20.899921 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6f7a92-92ac-434b-9e0a-6508ae4759dc None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:20.993609 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6f7a92-92ac-434b-9e0a-6508ae4759dc None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:21.024520 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e45d932-bf04-454f-824b-79994c0c5ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:21.025188 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45d932-bf04-454f-824b-79994c0c5ca2 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:21.025480 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45d932-bf04-454f-824b-79994c0c5ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:21.025763 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45d932-bf04-454f-824b-79994c0c5ca2 None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:21.026558 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e45d932-bf04-454f-824b-79994c0c5ca2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:10:21.026872 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e45d932-bf04-454f-824b-79994c0c5ca2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:21.028380 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e45d932-bf04-454f-824b-79994c0c5ca2 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:21.040572 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 634/1272] 10.222.0.24 () {56 vars in 1148 bytes} [Thu Apr 7 06:10:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:10:21.046412 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ec96da-adad-48d1-95ef-50d2788df4c6 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:21.140333 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ec96da-adad-48d1-95ef-50d2788df4c6 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:21.172729 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e7e48-4641-4a0f-94f4-06e58cbe759d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:21.173623 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e7e48-4641-4a0f-94f4-06e58cbe759d None admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:21.173905 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e7e48-4641-4a0f-94f4-06e58cbe759d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:21.174177 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e7e48-4641-4a0f-94f4-06e58cbe759d None admin] PATH_INFO: `/v3/projects/de88f2c333ae49cfa7fff7fa1ed0022c/users/ff35b68665724754a6413bca0030016f/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:21.176103 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4e7e48-4641-4a0f-94f4-06e58cbe759d None admin] RBAC: Authorizing `identity:create_grant(project_id=de88f2c333ae49cfa7fff7fa1ed0022c, user_id=ff35b68665724754a6413bca0030016f, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:21.177509 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4e7e48-4641-4a0f-94f4-06e58cbe759d None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:21.270104 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 639/1273] 10.222.0.24 () {58 vars in 1439 bytes} [Thu Apr 7 06:10:21 2022] PUT /identity/v3/projects/de88f2c333ae49cfa7fff7fa1ed0022c/users/ff35b68665724754a6413bca0030016f/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:10:23.530782 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973db52-3388-42b3-a657-c40127da7056 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:23.531855 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973db52-3388-42b3-a657-c40127da7056 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:23.531968 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973db52-3388-42b3-a657-c40127da7056 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:23.533300 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 635/1274] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:10:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:10:23.538392 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79529ba1-79e4-4665-81e8-94a81a043d6e None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:23.538761 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79529ba1-79e4-4665-81e8-94a81a043d6e None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:23.538937 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79529ba1-79e4-4665-81e8-94a81a043d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:23.555246 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-79529ba1-79e4-4665-81e8-94a81a043d6e None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:10:23.556480 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-79529ba1-79e4-4665-81e8-94a81a043d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:10:23.619499 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 640/1275] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:10:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 07 06:10:23.644131 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3973db52-3388-42b3-a657-c40127da7056 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:23.741446 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3973db52-3388-42b3-a657-c40127da7056 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:23.777941 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748276eb-7682-4181-b81a-5ec4794f06d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:23.781604 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748276eb-7682-4181-b81a-5ec4794f06d5 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:23.781604 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748276eb-7682-4181-b81a-5ec4794f06d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:23.781604 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748276eb-7682-4181-b81a-5ec4794f06d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:23.789546 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748276eb-7682-4181-b81a-5ec4794f06d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 07 06:10:23.799550 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-748276eb-7682-4181-b81a-5ec4794f06d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 07 06:10:23.800741 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 636/1276] 10.222.0.24 () {56 vars in 1096 bytes} [Thu Apr 7 06:10:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:10:23.806867 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79529ba1-79e4-4665-81e8-94a81a043d6e None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:23.900086 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79529ba1-79e4-4665-81e8-94a81a043d6e None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:23.931111 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c1a7c1-49f7-454b-951f-4fc3268fcc6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:23.931788 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c1a7c1-49f7-454b-951f-4fc3268fcc6f None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:23.932071 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c1a7c1-49f7-454b-951f-4fc3268fcc6f None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:23.932345 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c1a7c1-49f7-454b-951f-4fc3268fcc6f None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:23.933076 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c1a7c1-49f7-454b-951f-4fc3268fcc6f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:10:23.933376 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c1a7c1-49f7-454b-951f-4fc3268fcc6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:23.934714 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c1a7c1-49f7-454b-951f-4fc3268fcc6f None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:23.942821 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 641/1277] 10.222.0.24 () {56 vars in 1099 bytes} [Thu Apr 7 06:10:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:10:23.948472 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748276eb-7682-4181-b81a-5ec4794f06d5 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:24.043015 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748276eb-7682-4181-b81a-5ec4794f06d5 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:24.074421 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a932394-073f-4065-b236-0ca45ddc26ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:24.075309 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a932394-073f-4065-b236-0ca45ddc26ff None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:24.075592 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a932394-073f-4065-b236-0ca45ddc26ff None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:24.075891 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a932394-073f-4065-b236-0ca45ddc26ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:24.086397 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a932394-073f-4065-b236-0ca45ddc26ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:24.087850 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a932394-073f-4065-b236-0ca45ddc26ff None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:24.103500 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-1a932394-073f-4065-b236-0ca45ddc26ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:10:24.104671 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 637/1278] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:10:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:10:24.110527 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c1a7c1-49f7-454b-951f-4fc3268fcc6f None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:24.205547 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c1a7c1-49f7-454b-951f-4fc3268fcc6f None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:24.237319 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3673d984-f871-4810-bbdf-62a376179c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:24.237967 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3673d984-f871-4810-bbdf-62a376179c44 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:24.238248 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3673d984-f871-4810-bbdf-62a376179c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:24.238519 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3673d984-f871-4810-bbdf-62a376179c44 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:24.239256 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3673d984-f871-4810-bbdf-62a376179c44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:10:24.239840 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3673d984-f871-4810-bbdf-62a376179c44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:24.241182 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3673d984-f871-4810-bbdf-62a376179c44 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:24.252796 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 642/1279] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:10:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:10:24.258472 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a932394-073f-4065-b236-0ca45ddc26ff None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:24.353420 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a932394-073f-4065-b236-0ca45ddc26ff None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:24.385974 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a939580c-f290-4610-8a90-16acdbe3823f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:24.386755 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939580c-f290-4610-8a90-16acdbe3823f None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:24.387042 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939580c-f290-4610-8a90-16acdbe3823f None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:24.387321 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939580c-f290-4610-8a90-16acdbe3823f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:24.394494 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a939580c-f290-4610-8a90-16acdbe3823f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:24.396815 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a939580c-f290-4610-8a90-16acdbe3823f None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:24.409127 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-a939580c-f290-4610-8a90-16acdbe3823f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 07 06:10:24.410276 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 638/1280] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:10:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:10:24.416129 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3673d984-f871-4810-bbdf-62a376179c44 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:24.510443 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3673d984-f871-4810-bbdf-62a376179c44 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:24.541973 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd91bf-59be-44f4-aae0-c91024d611bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:24.542641 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd91bf-59be-44f4-aae0-c91024d611bb None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:24.542926 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd91bf-59be-44f4-aae0-c91024d611bb None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:24.543198 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd91bf-59be-44f4-aae0-c91024d611bb None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:24.544083 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bd91bf-59be-44f4-aae0-c91024d611bb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:10:24.544376 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bd91bf-59be-44f4-aae0-c91024d611bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:24.545820 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bd91bf-59be-44f4-aae0-c91024d611bb None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:24.563205 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 643/1281] 10.222.0.24 () {56 vars in 1143 bytes} [Thu Apr 7 06:10:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:10:24.569237 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a939580c-f290-4610-8a90-16acdbe3823f None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:24.664238 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a939580c-f290-4610-8a90-16acdbe3823f None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:24.696140 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376acc6-2c50-4e12-a3fa-360fd9ab5971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:24.696768 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376acc6-2c50-4e12-a3fa-360fd9ab5971 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:24.697053 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376acc6-2c50-4e12-a3fa-360fd9ab5971 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:24.697329 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376acc6-2c50-4e12-a3fa-360fd9ab5971 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:24.760751 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4376acc6-2c50-4e12-a3fa-360fd9ab5971 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:24.762230 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4376acc6-2c50-4e12-a3fa-360fd9ab5971 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:24.862566 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 639/1282] 10.222.0.24 () {58 vars in 1282 bytes} [Thu Apr 7 06:10:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 07 06:10:24.868647 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd91bf-59be-44f4-aae0-c91024d611bb None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:24.963032 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd91bf-59be-44f4-aae0-c91024d611bb None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:24.995625 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491eab9a-22a5-43f1-96bd-1a39fa7d4d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:24.996744 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491eab9a-22a5-43f1-96bd-1a39fa7d4d7c None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:24.996744 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491eab9a-22a5-43f1-96bd-1a39fa7d4d7c None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:24.996961 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491eab9a-22a5-43f1-96bd-1a39fa7d4d7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:25.006308 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491eab9a-22a5-43f1-96bd-1a39fa7d4d7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:25.007736 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491eab9a-22a5-43f1-96bd-1a39fa7d4d7c None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:25.024267 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-491eab9a-22a5-43f1-96bd-1a39fa7d4d7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 07 06:10:25.025438 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 644/1283] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:10:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:10:25.031683 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376acc6-2c50-4e12-a3fa-360fd9ab5971 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:25.125251 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376acc6-2c50-4e12-a3fa-360fd9ab5971 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:25.158024 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf43fc-21d7-44a6-b804-8f9d2447bb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:25.158680 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf43fc-21d7-44a6-b804-8f9d2447bb4d None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:25.158966 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf43fc-21d7-44a6-b804-8f9d2447bb4d None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:25.159242 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf43fc-21d7-44a6-b804-8f9d2447bb4d None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:25.159983 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bf43fc-21d7-44a6-b804-8f9d2447bb4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:10:25.160289 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bf43fc-21d7-44a6-b804-8f9d2447bb4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:25.161645 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bf43fc-21d7-44a6-b804-8f9d2447bb4d None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:25.172524 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 640/1284] 10.222.0.24 () {56 vars in 1109 bytes} [Thu Apr 7 06:10:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:10:25.178423 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491eab9a-22a5-43f1-96bd-1a39fa7d4d7c None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:25.272209 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491eab9a-22a5-43f1-96bd-1a39fa7d4d7c None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:25.305688 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915d1b1b-b02a-46ed-b1f8-2ea9aae8bbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:25.306468 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d1b1b-b02a-46ed-b1f8-2ea9aae8bbab None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:25.306754 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d1b1b-b02a-46ed-b1f8-2ea9aae8bbab None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:25.307032 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d1b1b-b02a-46ed-b1f8-2ea9aae8bbab None admin] PATH_INFO: `/v3/projects/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:25.313707 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915d1b1b-b02a-46ed-b1f8-2ea9aae8bbab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:25.315123 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915d1b1b-b02a-46ed-b1f8-2ea9aae8bbab None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:25.328381 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING keystone.server.flask.application [None req-915d1b1b-b02a-46ed-b1f8-2ea9aae8bbab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 07 06:10:25.329534 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 645/1285] 10.222.0.24 () {56 vars in 1111 bytes} [Thu Apr 7 06:10:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:10:25.335443 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf43fc-21d7-44a6-b804-8f9d2447bb4d None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:25.431821 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf43fc-21d7-44a6-b804-8f9d2447bb4d None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:25.464306 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec5c07e-8917-4bfa-b500-1e60647c0838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:25.464956 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5c07e-8917-4bfa-b500-1e60647c0838 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:25.465240 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5c07e-8917-4bfa-b500-1e60647c0838 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:25.465515 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5c07e-8917-4bfa-b500-1e60647c0838 None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:25.466289 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec5c07e-8917-4bfa-b500-1e60647c0838 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:10:25.466596 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec5c07e-8917-4bfa-b500-1e60647c0838 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:25.468048 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec5c07e-8917-4bfa-b500-1e60647c0838 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:25.479654 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 641/1286] 10.222.0.24 () {56 vars in 1148 bytes} [Thu Apr 7 06:10:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:10:25.485930 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915d1b1b-b02a-46ed-b1f8-2ea9aae8bbab None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:25.579884 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915d1b1b-b02a-46ed-b1f8-2ea9aae8bbab None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:25.611188 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399ddbf6-ee0d-4103-ae5c-d4b0bd153910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:25.611861 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ddbf6-ee0d-4103-ae5c-d4b0bd153910 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:25.612144 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ddbf6-ee0d-4103-ae5c-d4b0bd153910 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:25.612412 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ddbf6-ee0d-4103-ae5c-d4b0bd153910 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:25.613228 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399ddbf6-ee0d-4103-ae5c-d4b0bd153910 None admin] RBAC: Adding query filter params (role.id=0fab680bc76f4a73826e9beb59e8129b, scope.project.id=de88f2c333ae49cfa7fff7fa1ed0022c, user.id=ff35b68665724754a6413bca0030016f) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:10:25.613595 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399ddbf6-ee0d-4103-ae5c-d4b0bd153910 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:25.615253 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399ddbf6-ee0d-4103-ae5c-d4b0bd153910 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:25.620879 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 646/1287] 10.222.0.24 () {56 vars in 1374 bytes} [Thu Apr 7 06:10:25 2022] GET /identity/v3/role_assignments?user.id=ff35b68665724754a6413bca0030016f&scope.project.id=de88f2c333ae49cfa7fff7fa1ed0022c&role.id=0fab680bc76f4a73826e9beb59e8129b => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:10:27.916574 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81265ec-b9f0-46e4-860f-4d8ae660f92c None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:27.917109 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81265ec-b9f0-46e4-860f-4d8ae660f92c None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:27.917109 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81265ec-b9f0-46e4-860f-4d8ae660f92c None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:27.918530 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 642/1288] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:10:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:10:27.923625 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4f158-4637-4bdf-987d-c27f4b8ed556 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:27.924110 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4f158-4637-4bdf-987d-c27f4b8ed556 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:27.924205 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4f158-4637-4bdf-987d-c27f4b8ed556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:27.941221 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-0dc4f158-4637-4bdf-987d-c27f4b8ed556 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:10:27.942498 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-0dc4f158-4637-4bdf-987d-c27f4b8ed556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:10:28.009332 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 647/1289] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:10:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 07 06:10:28.032080 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81265ec-b9f0-46e4-860f-4d8ae660f92c None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:28.131765 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81265ec-b9f0-46e4-860f-4d8ae660f92c None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:28.165124 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15808387-10d9-46ef-8d6c-5ec70f80ecdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:28.165915 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15808387-10d9-46ef-8d6c-5ec70f80ecdc None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:28.166194 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15808387-10d9-46ef-8d6c-5ec70f80ecdc None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:28.166464 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15808387-10d9-46ef-8d6c-5ec70f80ecdc None admin] PATH_INFO: `/v3/services/placement` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:28.167114 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15808387-10d9-46ef-8d6c-5ec70f80ecdc None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:28.168573 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15808387-10d9-46ef-8d6c-5ec70f80ecdc None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:28.179800 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-15808387-10d9-46ef-8d6c-5ec70f80ecdc None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 07 06:10:28.181024 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 643/1290] 10.222.0.24 () {56 vars in 1117 bytes} [Thu Apr 7 06:10:28 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:10:28.188946 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc4f158-4637-4bdf-987d-c27f4b8ed556 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:28.280811 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc4f158-4637-4bdf-987d-c27f4b8ed556 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:28.313153 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc8d95-1297-42a0-8f50-1d95d520538c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:28.313755 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc8d95-1297-42a0-8f50-1d95d520538c None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:28.314035 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc8d95-1297-42a0-8f50-1d95d520538c None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:28.314314 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc8d95-1297-42a0-8f50-1d95d520538c None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:28.315016 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdc8d95-1297-42a0-8f50-1d95d520538c None admin] RBAC: Adding query filter params (name=placement) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:10:28.315322 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdc8d95-1297-42a0-8f50-1d95d520538c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:28.316700 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdc8d95-1297-42a0-8f50-1d95d520538c None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:28.321341 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 648/1291] 10.222.0.24 () {56 vars in 1116 bytes} [Thu Apr 7 06:10:28 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:10:28.327215 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15808387-10d9-46ef-8d6c-5ec70f80ecdc None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:28.423914 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15808387-10d9-46ef-8d6c-5ec70f80ecdc None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:28.455279 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016cfc59-bf53-466b-b018-5920f10f1696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:28.455959 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016cfc59-bf53-466b-b018-5920f10f1696 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:28.456245 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016cfc59-bf53-466b-b018-5920f10f1696 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:28.456522 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016cfc59-bf53-466b-b018-5920f10f1696 None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:28.457313 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016cfc59-bf53-466b-b018-5920f10f1696 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:10:28.457615 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016cfc59-bf53-466b-b018-5920f10f1696 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:28.458982 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016cfc59-bf53-466b-b018-5920f10f1696 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:28.463518 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 644/1292] 10.222.0.24 () {56 vars in 1116 bytes} [Thu Apr 7 06:10:28 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:10:30.744359 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e1055-794b-4784-8afd-052ba93c4cf3 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:30.744909 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e1055-794b-4784-8afd-052ba93c4cf3 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:30.744909 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e1055-794b-4784-8afd-052ba93c4cf3 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:30.746277 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 649/1293] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:10:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:10:30.751684 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa1fc5-1d96-41a4-a6fe-c96d01276e79 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:30.752120 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa1fc5-1d96-41a4-a6fe-c96d01276e79 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:30.752295 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa1fc5-1d96-41a4-a6fe-c96d01276e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:30.768645 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-e5fa1fc5-1d96-41a4-a6fe-c96d01276e79 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:10:30.769823 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-e5fa1fc5-1d96-41a4-a6fe-c96d01276e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:10:30.833042 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 645/1294] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:10:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 07 06:10:30.857525 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72e1055-794b-4784-8afd-052ba93c4cf3 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:30.953584 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72e1055-794b-4784-8afd-052ba93c4cf3 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:30.986094 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bfe1a0-fadf-4c75-ae02-7faaa06d895b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:30.988764 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bfe1a0-fadf-4c75-ae02-7faaa06d895b None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:30.988764 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bfe1a0-fadf-4c75-ae02-7faaa06d895b None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:30.988764 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bfe1a0-fadf-4c75-ae02-7faaa06d895b None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:30.988764 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bfe1a0-fadf-4c75-ae02-7faaa06d895b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:30.989361 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bfe1a0-fadf-4c75-ae02-7faaa06d895b None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:31.057546 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 650/1295] 10.222.0.24 () {60 vars in 1141 bytes} [Thu Apr 7 06:10:30 2022] POST /identity/v3/services => generated 246 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:10:33.385783 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3850a-1720-4e42-91fe-82b7ea5bc918 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:33.386308 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3850a-1720-4e42-91fe-82b7ea5bc918 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:33.386429 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3850a-1720-4e42-91fe-82b7ea5bc918 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:33.387736 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 646/1296] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:10:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:10:33.393442 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c426c32-ff25-486e-a5a3-8750357e50a4 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:33.393823 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c426c32-ff25-486e-a5a3-8750357e50a4 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:33.394011 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c426c32-ff25-486e-a5a3-8750357e50a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:33.410589 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-0c426c32-ff25-486e-a5a3-8750357e50a4 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:10:33.411778 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-0c426c32-ff25-486e-a5a3-8750357e50a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:10:33.478949 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 651/1297] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:10:33 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 07 06:10:33.502540 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3850a-1720-4e42-91fe-82b7ea5bc918 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:33.598502 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3850a-1720-4e42-91fe-82b7ea5bc918 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:33.630636 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac99c76-001a-43aa-a205-b824347d0d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:33.631425 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac99c76-001a-43aa-a205-b824347d0d0f None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:33.631712 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac99c76-001a-43aa-a205-b824347d0d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:33.632025 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac99c76-001a-43aa-a205-b824347d0d0f None admin] PATH_INFO: `/v3/services/placement` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:33.632685 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac99c76-001a-43aa-a205-b824347d0d0f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:33.634054 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac99c76-001a-43aa-a205-b824347d0d0f None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:33.645497 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-2ac99c76-001a-43aa-a205-b824347d0d0f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 07 06:10:33.646602 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 647/1298] 10.222.0.24 () {56 vars in 1117 bytes} [Thu Apr 7 06:10:33 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:10:33.652890 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c426c32-ff25-486e-a5a3-8750357e50a4 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:33.743730 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c426c32-ff25-486e-a5a3-8750357e50a4 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:33.777589 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69587c99-df91-4143-a3ab-e6a3d60b9d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:33.778260 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69587c99-df91-4143-a3ab-e6a3d60b9d83 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:33.778538 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69587c99-df91-4143-a3ab-e6a3d60b9d83 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:33.778812 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69587c99-df91-4143-a3ab-e6a3d60b9d83 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:33.779513 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69587c99-df91-4143-a3ab-e6a3d60b9d83 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:10:33.779853 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69587c99-df91-4143-a3ab-e6a3d60b9d83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:33.781218 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69587c99-df91-4143-a3ab-e6a3d60b9d83 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:33.786195 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 652/1299] 10.222.0.24 () {56 vars in 1116 bytes} [Thu Apr 7 06:10:33 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:10:33.792131 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac99c76-001a-43aa-a205-b824347d0d0f None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:33.888374 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac99c76-001a-43aa-a205-b824347d0d0f None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:33.920076 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c147e2b-c620-445b-b24f-21af88022c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:33.920676 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c147e2b-c620-445b-b24f-21af88022c27 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:33.920964 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c147e2b-c620-445b-b24f-21af88022c27 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:33.921301 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c147e2b-c620-445b-b24f-21af88022c27 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:33.922067 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c147e2b-c620-445b-b24f-21af88022c27 None admin] RBAC: Adding query filter params (interface=public, service_id=e89d47ac481e4907bce122a7ab2cab7a, region_id=RegionOne) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:10:33.922380 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c147e2b-c620-445b-b24f-21af88022c27 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:33.923762 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c147e2b-c620-445b-b24f-21af88022c27 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:33.928573 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 648/1300] 10.222.0.24 () {56 vars in 1251 bytes} [Thu Apr 7 06:10:33 2022] GET /identity/v3/endpoints?service_id=e89d47ac481e4907bce122a7ab2cab7a&interface=public®ion_id=RegionOne => generated 194 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:10:33.934208 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69587c99-df91-4143-a3ab-e6a3d60b9d83 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:34.027938 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69587c99-df91-4143-a3ab-e6a3d60b9d83 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:34.059816 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283d4606-f0f5-4971-a52e-dd47d01a5488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:34.060469 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d4606-f0f5-4971-a52e-dd47d01a5488 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:34.060751 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d4606-f0f5-4971-a52e-dd47d01a5488 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:34.061023 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d4606-f0f5-4971-a52e-dd47d01a5488 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:34.062316 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283d4606-f0f5-4971-a52e-dd47d01a5488 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:34.063670 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283d4606-f0f5-4971-a52e-dd47d01a5488 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:34.070283 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 653/1301] 10.222.0.24 () {56 vars in 1087 bytes} [Thu Apr 7 06:10:33 2022] GET /identity/v3/services => generated 2191 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 07 06:10:36.334688 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf88ab8-aef2-4b3a-ae43-977b65d402cf None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:36.335234 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf88ab8-aef2-4b3a-ae43-977b65d402cf None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:36.335234 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf88ab8-aef2-4b3a-ae43-977b65d402cf None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:36.336638 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 649/1302] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:10:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 07 06:10:36.341784 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb26e4-973a-432b-976c-a931f30d798a None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:36.342199 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb26e4-973a-432b-976c-a931f30d798a None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:36.342311 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb26e4-973a-432b-976c-a931f30d798a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:36.358293 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-cecb26e4-973a-432b-976c-a931f30d798a None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:10:36.359999 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-cecb26e4-973a-432b-976c-a931f30d798a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:10:36.423194 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 654/1303] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:10:36 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 07 06:10:36.447447 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf88ab8-aef2-4b3a-ae43-977b65d402cf None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:36.542128 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf88ab8-aef2-4b3a-ae43-977b65d402cf None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:36.573838 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2388466a-bbc8-4781-bc16-33ce47051566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:36.574627 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2388466a-bbc8-4781-bc16-33ce47051566 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:36.574915 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2388466a-bbc8-4781-bc16-33ce47051566 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:36.575191 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2388466a-bbc8-4781-bc16-33ce47051566 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:36.575862 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2388466a-bbc8-4781-bc16-33ce47051566 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:36.577223 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2388466a-bbc8-4781-bc16-33ce47051566 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:36.587938 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING keystone.server.flask.application [None req-2388466a-bbc8-4781-bc16-33ce47051566 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 07 06:10:36.589053 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 650/1304] 10.222.0.24 () {56 vars in 1117 bytes} [Thu Apr 7 06:10:36 2022] GET /identity/v3/services/placement => generated 90 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 07 06:10:36.595492 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb26e4-973a-432b-976c-a931f30d798a None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:36.687562 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb26e4-973a-432b-976c-a931f30d798a None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:36.719849 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa644ab-66b7-4d78-b288-bf0773bfc824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:36.720510 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa644ab-66b7-4d78-b288-bf0773bfc824 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:36.720793 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa644ab-66b7-4d78-b288-bf0773bfc824 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:36.721068 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa644ab-66b7-4d78-b288-bf0773bfc824 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:36.721761 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa644ab-66b7-4d78-b288-bf0773bfc824 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:10:36.722065 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa644ab-66b7-4d78-b288-bf0773bfc824 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:36.723410 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa644ab-66b7-4d78-b288-bf0773bfc824 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:36.728348 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 655/1305] 10.222.0.24 () {56 vars in 1116 bytes} [Thu Apr 7 06:10:36 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:10:36.734583 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2388466a-bbc8-4781-bc16-33ce47051566 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:10:36.829414 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2388466a-bbc8-4781-bc16-33ce47051566 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:10:36.861684 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc191d1a-62a2-488d-b934-38ff50723f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:10:36.862279 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc191d1a-62a2-488d-b934-38ff50723f1a None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:10:36.862566 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc191d1a-62a2-488d-b934-38ff50723f1a None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:10:36.862844 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc191d1a-62a2-488d-b934-38ff50723f1a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:10:36.863592 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc191d1a-62a2-488d-b934-38ff50723f1a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:10:36.865290 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc191d1a-62a2-488d-b934-38ff50723f1a None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:10:36.977726 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 651/1306] 10.222.0.24 () {60 vars in 1144 bytes} [Thu Apr 7 06:10:36 2022] POST /identity/v3/endpoints => generated 331 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:18:21.027773 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ca031-3a21-4cfc-9d44-2e560e453107 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:18:21.029307 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ca031-3a21-4cfc-9d44-2e560e453107 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:18:21.029790 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ca031-3a21-4cfc-9d44-2e560e453107 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:18:21.036691 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7187bec-8a3f-444d-b713-7b9f003982cc None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:18:21.037556 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7187bec-8a3f-444d-b713-7b9f003982cc None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:18:21.038061 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7187bec-8a3f-444d-b713-7b9f003982cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:18:21.041865 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 656/1307] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:18:21 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:18:21.111997 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-b7187bec-8a3f-444d-b713-7b9f003982cc None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:18:21.113585 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b7187bec-8a3f-444d-b713-7b9f003982cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:18:21.228144 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 652/1308] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:18:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:18:21.267365 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db271eb-b8ad-46bf-96bd-899e6962c92e None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:18:21.268006 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db271eb-b8ad-46bf-96bd-899e6962c92e None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:18:21.268512 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db271eb-b8ad-46bf-96bd-899e6962c92e None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:18:21.270523 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 657/1309] 10.222.0.24 () {54 vars in 963 bytes} [Thu Apr 7 06:18:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:18:21.278253 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0bb3c2-97ea-4d84-b535-7ac1d00d647e None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:18:21.278970 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0bb3c2-97ea-4d84-b535-7ac1d00d647e None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:18:21.279573 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0bb3c2-97ea-4d84-b535-7ac1d00d647e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:18:21.378955 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-2d0bb3c2-97ea-4d84-b535-7ac1d00d647e None None] MFA Rules not processed for user `bb7f549fd26e4642828d4f476aef0239`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:18:21.381095 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-2d0bb3c2-97ea-4d84-b535-7ac1d00d647e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:18:21.501874 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 653/1310] 10.222.0.24 () {58 vars in 1060 bytes} [Thu Apr 7 06:18:21 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:18:21.502881 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db271eb-b8ad-46bf-96bd-899e6962c92e None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:18:21.504633 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-4db271eb-b8ad-46bf-96bd-899e6962c92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:18:21.628560 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db271eb-b8ad-46bf-96bd-899e6962c92e None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:18:21.702033 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85de8b-0df9-4938-ab62-dcb7167326fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:18:21.702690 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85de8b-0df9-4938-ab62-dcb7167326fe service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:18:21.703155 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85de8b-0df9-4938-ab62-dcb7167326fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:18:21.703693 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85de8b-0df9-4938-ab62-dcb7167326fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:18:21.706079 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-3e85de8b-0df9-4938-ab62-dcb7167326fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:18:21.849740 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e85de8b-0df9-4938-ab62-dcb7167326fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:18:21.851122 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e85de8b-0df9-4938-ab62-dcb7167326fe service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:18:21.871357 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 658/1311] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:18:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 07 06:18:24.452086 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d744f-7231-4d50-9a47-760e882630c2 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:18:24.452086 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d744f-7231-4d50-9a47-760e882630c2 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:18:24.452558 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d744f-7231-4d50-9a47-760e882630c2 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:18:24.460775 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c2d91-17f5-4477-bc60-8d75b7034f44 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:18:24.460775 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c2d91-17f5-4477-bc60-8d75b7034f44 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:18:24.460775 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c2d91-17f5-4477-bc60-8d75b7034f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:18:24.462835 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 654/1312] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:18:24 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:18:24.552925 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-795c2d91-17f5-4477-bc60-8d75b7034f44 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:18:24.554156 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-795c2d91-17f5-4477-bc60-8d75b7034f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:18:24.654047 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 659/1313] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:18:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:18:24.710489 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24c56a-7ca7-4d75-a7e1-01ac6adb7541 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:18:24.710781 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24c56a-7ca7-4d75-a7e1-01ac6adb7541 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:18:24.711262 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24c56a-7ca7-4d75-a7e1-01ac6adb7541 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:18:24.712844 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 655/1314] 10.222.0.24 () {54 vars in 963 bytes} [Thu Apr 7 06:18:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:18:24.719422 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0efed6-4c01-48c3-b0d0-3b1dd045012a None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:18:24.719713 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0efed6-4c01-48c3-b0d0-3b1dd045012a None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:18:24.720013 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0efed6-4c01-48c3-b0d0-3b1dd045012a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:18:24.806275 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-2d0efed6-4c01-48c3-b0d0-3b1dd045012a None None] MFA Rules not processed for user `bb7f549fd26e4642828d4f476aef0239`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:18:24.809585 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-2d0efed6-4c01-48c3-b0d0-3b1dd045012a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:18:24.894725 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 660/1315] 10.222.0.24 () {58 vars in 1060 bytes} [Thu Apr 7 06:18:24 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:18:24.904246 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa24c56a-7ca7-4d75-a7e1-01ac6adb7541 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:18:24.905877 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-fa24c56a-7ca7-4d75-a7e1-01ac6adb7541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:18:25.010190 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa24c56a-7ca7-4d75-a7e1-01ac6adb7541 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:18:25.083660 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4b3a68-f925-45f2-9935-597a5235d64a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:18:25.084344 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b3a68-f925-45f2-9935-597a5235d64a service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:18:25.084632 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b3a68-f925-45f2-9935-597a5235d64a service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:18:25.084912 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b3a68-f925-45f2-9935-597a5235d64a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:18:25.086560 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-1d4b3a68-f925-45f2-9935-597a5235d64a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:18:25.195179 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4b3a68-f925-45f2-9935-597a5235d64a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:18:25.196652 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4b3a68-f925-45f2-9935-597a5235d64a service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:18:25.219292 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 656/1316] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:18:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:18:28.264992 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3742c9f-87ef-4da8-946a-ad0234c257d9 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:18:28.265524 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3742c9f-87ef-4da8-946a-ad0234c257d9 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:18:28.265619 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3742c9f-87ef-4da8-946a-ad0234c257d9 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:18:28.266938 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 661/1317] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:18:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:18:28.271969 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d7ec1-2503-44bd-bed4-64b2dbd2c3c1 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:18:28.272355 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d7ec1-2503-44bd-bed4-64b2dbd2c3c1 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:18:28.272521 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d7ec1-2503-44bd-bed4-64b2dbd2c3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:18:28.334353 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-c89d7ec1-2503-44bd-bed4-64b2dbd2c3c1 None None] MFA Rules not processed for user `e3ccb23df7814ee8bbd9a0cd75ed58d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:18:28.335561 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-c89d7ec1-2503-44bd-bed4-64b2dbd2c3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:18:28.428446 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 657/1318] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:18:28 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:18:28.469353 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3742c9f-87ef-4da8-946a-ad0234c257d9 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:18:28.470889 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b3742c9f-87ef-4da8-946a-ad0234c257d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:18:28.569528 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3742c9f-87ef-4da8-946a-ad0234c257d9 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:18:28.639114 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae432572-e4d7-49af-bc92-1faa846e1647 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:18:28.639789 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae432572-e4d7-49af-bc92-1faa846e1647 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:18:28.640103 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae432572-e4d7-49af-bc92-1faa846e1647 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:18:28.640357 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae432572-e4d7-49af-bc92-1faa846e1647 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:18:28.641988 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-ae432572-e4d7-49af-bc92-1faa846e1647 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:18:28.747699 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae432572-e4d7-49af-bc92-1faa846e1647 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:18:28.749151 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae432572-e4d7-49af-bc92-1faa846e1647 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:18:28.767055 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 662/1319] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:18:28 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:18:31.843419 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b708f58-732d-4c17-9372-b8dc07df2d0b None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:18:31.843940 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b708f58-732d-4c17-9372-b8dc07df2d0b None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:18:31.844053 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b708f58-732d-4c17-9372-b8dc07df2d0b None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:18:31.845432 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 658/1320] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:18:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:18:31.850401 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43df14-9652-4684-8c9f-327b72213a70 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:18:31.850778 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43df14-9652-4684-8c9f-327b72213a70 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:18:31.850962 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43df14-9652-4684-8c9f-327b72213a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:18:31.912396 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-4c43df14-9652-4684-8c9f-327b72213a70 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:18:31.913570 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-4c43df14-9652-4684-8c9f-327b72213a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:18:32.007185 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 663/1321] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:18:31 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:18:32.046866 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b708f58-732d-4c17-9372-b8dc07df2d0b None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:18:32.048425 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-2b708f58-732d-4c17-9372-b8dc07df2d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:18:32.145487 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b708f58-732d-4c17-9372-b8dc07df2d0b None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:18:32.212727 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb089b9-2732-4afc-ba4d-ca96628006ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:18:32.213361 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb089b9-2732-4afc-ba4d-ca96628006ed service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:18:32.213645 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb089b9-2732-4afc-ba4d-ca96628006ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:18:32.213920 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb089b9-2732-4afc-ba4d-ca96628006ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:18:32.215515 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-3bb089b9-2732-4afc-ba4d-ca96628006ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:18:32.320003 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb089b9-2732-4afc-ba4d-ca96628006ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:18:32.321354 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb089b9-2732-4afc-ba4d-ca96628006ed service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:18:32.339016 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 659/1322] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:18:32 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:18:35.665705 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06356f8e-1f3e-404d-acb8-76230e1f449b None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:18:35.666261 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06356f8e-1f3e-404d-acb8-76230e1f449b None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:18:35.666261 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06356f8e-1f3e-404d-acb8-76230e1f449b None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:18:35.667668 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 664/1323] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:18:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:18:35.673462 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b20a4-7926-406c-833d-e9e94d2bd202 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:18:35.673898 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b20a4-7926-406c-833d-e9e94d2bd202 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:18:35.674023 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b20a4-7926-406c-833d-e9e94d2bd202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:18:35.736476 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-7f5b20a4-7926-406c-833d-e9e94d2bd202 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:18:35.737683 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-7f5b20a4-7926-406c-833d-e9e94d2bd202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:18:35.829972 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 660/1324] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:18:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:18:35.866802 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06356f8e-1f3e-404d-acb8-76230e1f449b None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:18:35.868401 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-06356f8e-1f3e-404d-acb8-76230e1f449b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:18:35.967985 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06356f8e-1f3e-404d-acb8-76230e1f449b None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:18:36.043824 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec50c6-06e3-4dc5-ae92-5a41567a0e03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:18:36.044494 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec50c6-06e3-4dc5-ae92-5a41567a0e03 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:18:36.044777 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec50c6-06e3-4dc5-ae92-5a41567a0e03 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:18:36.045052 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec50c6-06e3-4dc5-ae92-5a41567a0e03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:18:36.046702 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-1dec50c6-06e3-4dc5-ae92-5a41567a0e03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:18:36.151086 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dec50c6-06e3-4dc5-ae92-5a41567a0e03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:18:36.152547 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dec50c6-06e3-4dc5-ae92-5a41567a0e03 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:18:36.170892 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 665/1325] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:18:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:18:38.515061 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39164301-d3ee-40ff-bd9d-8530b1b230d5 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:18:38.515593 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39164301-d3ee-40ff-bd9d-8530b1b230d5 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:18:38.515593 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39164301-d3ee-40ff-bd9d-8530b1b230d5 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:18:38.517019 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 661/1326] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:18:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:18:38.522159 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943c2da-8ebd-40f9-a8b6-fca07b03b40f None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:18:38.522577 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943c2da-8ebd-40f9-a8b6-fca07b03b40f None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:18:38.522757 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943c2da-8ebd-40f9-a8b6-fca07b03b40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:18:38.590095 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-0943c2da-8ebd-40f9-a8b6-fca07b03b40f None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:18:38.592181 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-0943c2da-8ebd-40f9-a8b6-fca07b03b40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:18:38.687019 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 666/1327] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:18:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:18:38.724868 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39164301-d3ee-40ff-bd9d-8530b1b230d5 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:18:38.726386 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-39164301-d3ee-40ff-bd9d-8530b1b230d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:18:38.829648 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39164301-d3ee-40ff-bd9d-8530b1b230d5 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:18:38.904662 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802036e6-fe85-4637-b0d8-4e73b02ff2f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:18:38.905313 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802036e6-fe85-4637-b0d8-4e73b02ff2f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:18:38.905600 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802036e6-fe85-4637-b0d8-4e73b02ff2f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:18:38.905877 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802036e6-fe85-4637-b0d8-4e73b02ff2f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:18:38.907512 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-802036e6-fe85-4637-b0d8-4e73b02ff2f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:18:39.011300 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802036e6-fe85-4637-b0d8-4e73b02ff2f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:18:39.012780 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802036e6-fe85-4637-b0d8-4e73b02ff2f7 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:18:39.030493 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 662/1328] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:18:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 07 06:18:41.370420 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b98cb5-beea-4a27-bd84-047b53b850df None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:18:41.370939 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b98cb5-beea-4a27-bd84-047b53b850df None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:18:41.370939 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b98cb5-beea-4a27-bd84-047b53b850df None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:18:41.372899 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 667/1329] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:18:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:18:41.380123 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d65c2-9f3e-4940-8dc5-a3d50cbcd82f None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:18:41.380624 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d65c2-9f3e-4940-8dc5-a3d50cbcd82f None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:18:41.380726 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d65c2-9f3e-4940-8dc5-a3d50cbcd82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:18:41.444723 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-c29d65c2-9f3e-4940-8dc5-a3d50cbcd82f None None] MFA Rules not processed for user `e3ccb23df7814ee8bbd9a0cd75ed58d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:18:41.445956 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-c29d65c2-9f3e-4940-8dc5-a3d50cbcd82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:18:41.537476 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 663/1330] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:18:41 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:18:41.576215 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b98cb5-beea-4a27-bd84-047b53b850df None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:18:41.577804 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-66b98cb5-beea-4a27-bd84-047b53b850df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:18:41.677530 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b98cb5-beea-4a27-bd84-047b53b850df None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:18:41.757243 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9be4c-7556-443d-8659-86a81cc26e1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:18:41.757901 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9be4c-7556-443d-8659-86a81cc26e1f service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:18:41.759797 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9be4c-7556-443d-8659-86a81cc26e1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:18:41.759797 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9be4c-7556-443d-8659-86a81cc26e1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:18:41.760392 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-eeb9be4c-7556-443d-8659-86a81cc26e1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:18:41.875574 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb9be4c-7556-443d-8659-86a81cc26e1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:18:41.877070 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb9be4c-7556-443d-8659-86a81cc26e1f service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:18:41.895633 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 668/1331] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:18:41 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 07 06:18:44.885147 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe8fe5-5977-409b-a5ba-a956c003d035 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:18:44.885636 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe8fe5-5977-409b-a5ba-a956c003d035 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:18:44.885845 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe8fe5-5977-409b-a5ba-a956c003d035 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:18:44.887381 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 664/1332] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:18:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:18:44.893045 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381b0e9-2522-4972-a019-aed28636ab62 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:18:44.893544 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381b0e9-2522-4972-a019-aed28636ab62 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:18:44.893650 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381b0e9-2522-4972-a019-aed28636ab62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:18:44.960256 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-c381b0e9-2522-4972-a019-aed28636ab62 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:18:44.961472 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c381b0e9-2522-4972-a019-aed28636ab62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:18:45.059060 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 669/1333] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:18:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:18:45.103134 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe8fe5-5977-409b-a5ba-a956c003d035 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:18:45.104710 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-33fe8fe5-5977-409b-a5ba-a956c003d035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:18:45.214171 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe8fe5-5977-409b-a5ba-a956c003d035 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:18:45.289005 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd9562-fea7-4f0a-8b40-5b1f4c794712 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:18:45.289665 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd9562-fea7-4f0a-8b40-5b1f4c794712 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:18:45.289946 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd9562-fea7-4f0a-8b40-5b1f4c794712 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:18:45.290218 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd9562-fea7-4f0a-8b40-5b1f4c794712 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:18:45.291892 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-67cd9562-fea7-4f0a-8b40-5b1f4c794712 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:18:45.403468 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cd9562-fea7-4f0a-8b40-5b1f4c794712 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:18:45.405077 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cd9562-fea7-4f0a-8b40-5b1f4c794712 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:18:45.423111 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 665/1334] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:18:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 07 06:18:47.769301 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e3e94-17ff-42e6-a36f-26ef746ec8e5 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:18:47.769860 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e3e94-17ff-42e6-a36f-26ef746ec8e5 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:18:47.769860 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e3e94-17ff-42e6-a36f-26ef746ec8e5 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:18:47.771218 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 670/1335] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:18:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:18:47.776306 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f1be4-0954-417c-bd25-612f354cd4a9 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:18:47.776720 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f1be4-0954-417c-bd25-612f354cd4a9 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:18:47.776858 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f1be4-0954-417c-bd25-612f354cd4a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:18:47.838617 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-322f1be4-0954-417c-bd25-612f354cd4a9 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:18:47.839878 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-322f1be4-0954-417c-bd25-612f354cd4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:18:47.931660 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 666/1336] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:18:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:18:47.972268 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417e3e94-17ff-42e6-a36f-26ef746ec8e5 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:18:47.973793 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-417e3e94-17ff-42e6-a36f-26ef746ec8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:18:48.071984 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417e3e94-17ff-42e6-a36f-26ef746ec8e5 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:18:48.142990 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5fbc0c-7f3e-440b-8d11-2f9cc483e483 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:18:48.143635 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5fbc0c-7f3e-440b-8d11-2f9cc483e483 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:18:48.143950 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5fbc0c-7f3e-440b-8d11-2f9cc483e483 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:18:48.144227 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5fbc0c-7f3e-440b-8d11-2f9cc483e483 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:18:48.145879 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-ba5fbc0c-7f3e-440b-8d11-2f9cc483e483 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:18:48.253587 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5fbc0c-7f3e-440b-8d11-2f9cc483e483 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:18:48.255072 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5fbc0c-7f3e-440b-8d11-2f9cc483e483 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:18:48.272201 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 671/1337] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:18:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:18:51.173429 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37598ec8-e73b-4285-b773-740e33d60b70 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:18:51.173946 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37598ec8-e73b-4285-b773-740e33d60b70 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:18:51.174054 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37598ec8-e73b-4285-b773-740e33d60b70 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:18:51.175403 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 667/1338] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:18:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:18:51.180583 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca8726-0705-447b-ac5e-ef8489cd25c3 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:18:51.180996 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca8726-0705-447b-ac5e-ef8489cd25c3 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:18:51.181141 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca8726-0705-447b-ac5e-ef8489cd25c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:18:51.244400 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-95ca8726-0705-447b-ac5e-ef8489cd25c3 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:18:51.245585 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-95ca8726-0705-447b-ac5e-ef8489cd25c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:18:51.335093 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 672/1339] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:18:51 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:18:51.370296 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37598ec8-e73b-4285-b773-740e33d60b70 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:18:51.374224 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-37598ec8-e73b-4285-b773-740e33d60b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:18:51.484480 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37598ec8-e73b-4285-b773-740e33d60b70 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:18:51.488128 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7649472-3cc9-4b26-b352-7050c288901d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:18:51.488768 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7649472-3cc9-4b26-b352-7050c288901d service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:18:51.489051 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7649472-3cc9-4b26-b352-7050c288901d service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:18:51.489323 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7649472-3cc9-4b26-b352-7050c288901d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:18:51.491331 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-e7649472-3cc9-4b26-b352-7050c288901d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:18:51.587876 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7649472-3cc9-4b26-b352-7050c288901d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:18:51.589258 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7649472-3cc9-4b26-b352-7050c288901d service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:18:51.607510 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 668/1340] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:18:51 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:18:56.158148 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ad16a-b5a7-489a-b7e6-79ab6ae01cd9 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:18:56.158650 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ad16a-b5a7-489a-b7e6-79ab6ae01cd9 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:18:56.158650 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ad16a-b5a7-489a-b7e6-79ab6ae01cd9 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:18:56.161414 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 673/1341] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:18:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:18:56.166707 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03000666-6aa7-4c80-a9cb-28e501c00717 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:18:56.167181 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03000666-6aa7-4c80-a9cb-28e501c00717 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:18:56.167285 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03000666-6aa7-4c80-a9cb-28e501c00717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:18:56.215458 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-03000666-6aa7-4c80-a9cb-28e501c00717 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:18:56.216593 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-03000666-6aa7-4c80-a9cb-28e501c00717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:18:56.289484 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 669/1342] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:18:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:18:56.329337 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ad16a-b5a7-489a-b7e6-79ab6ae01cd9 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:18:56.341240 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ad16a-b5a7-489a-b7e6-79ab6ae01cd9 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:18:56.344792 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708b1535-62a7-422e-a049-4642c2d1968f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:18:56.345429 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b1535-62a7-422e-a049-4642c2d1968f service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:18:56.345721 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b1535-62a7-422e-a049-4642c2d1968f service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:18:56.345995 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b1535-62a7-422e-a049-4642c2d1968f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:18:56.354808 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708b1535-62a7-422e-a049-4642c2d1968f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:18:56.356822 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708b1535-62a7-422e-a049-4642c2d1968f service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:18:56.366267 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 674/1343] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:18:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 07 06:18:59.658623 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b5900-e703-4f1c-9850-aedede713ee8 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:18:59.659184 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b5900-e703-4f1c-9850-aedede713ee8 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:18:59.659184 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b5900-e703-4f1c-9850-aedede713ee8 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:18:59.660734 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 670/1344] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:18:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:18:59.666054 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d477177-10a0-4a9e-a5c9-8e83b8c23e53 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:18:59.666482 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d477177-10a0-4a9e-a5c9-8e83b8c23e53 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:18:59.666666 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d477177-10a0-4a9e-a5c9-8e83b8c23e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:18:59.693616 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-7d477177-10a0-4a9e-a5c9-8e83b8c23e53 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:18:59.694814 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-7d477177-10a0-4a9e-a5c9-8e83b8c23e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:18:59.703226 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 675/1345] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:18:59 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:18:59.741769 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63b5900-e703-4f1c-9850-aedede713ee8 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:18:59.752493 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63b5900-e703-4f1c-9850-aedede713ee8 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:18:59.756049 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7421701-1f8f-451a-9b41-7728c2af28df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:18:59.756821 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7421701-1f8f-451a-9b41-7728c2af28df service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:18:59.757108 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7421701-1f8f-451a-9b41-7728c2af28df service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:18:59.757486 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7421701-1f8f-451a-9b41-7728c2af28df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:18:59.773164 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7421701-1f8f-451a-9b41-7728c2af28df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:18:59.774717 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7421701-1f8f-451a-9b41-7728c2af28df service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:18:59.785123 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 671/1346] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:18:59 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:19:04.259574 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab4a2e-57ec-466f-aea7-9c03e642c991 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:19:04.260154 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab4a2e-57ec-466f-aea7-9c03e642c991 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:19:04.260154 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab4a2e-57ec-466f-aea7-9c03e642c991 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:19:04.261961 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 676/1347] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:19:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:19:04.267108 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc86cf-2a8e-4d89-b0d1-a8224d2b606a None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:19:04.267495 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc86cf-2a8e-4d89-b0d1-a8224d2b606a None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:19:04.267665 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc86cf-2a8e-4d89-b0d1-a8224d2b606a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:19:04.285669 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-48fc86cf-2a8e-4d89-b0d1-a8224d2b606a None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:19:04.286854 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-48fc86cf-2a8e-4d89-b0d1-a8224d2b606a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:19:04.294786 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 672/1348] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:19:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:19:04.333639 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ab4a2e-57ec-466f-aea7-9c03e642c991 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:19:04.344803 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ab4a2e-57ec-466f-aea7-9c03e642c991 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:19:04.348543 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e915b-fc1f-4821-9ce0-18da34387513 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:19:04.349178 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e915b-fc1f-4821-9ce0-18da34387513 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:19:04.349462 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e915b-fc1f-4821-9ce0-18da34387513 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:19:04.349736 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e915b-fc1f-4821-9ce0-18da34387513 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:19:04.358413 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722e915b-fc1f-4821-9ce0-18da34387513 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:19:04.359853 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722e915b-fc1f-4821-9ce0-18da34387513 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:19:04.369692 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 677/1349] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:19:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:19:09.744152 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b287fe4-a256-468c-8f90-61e073287485 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:19:09.745789 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b287fe4-a256-468c-8f90-61e073287485 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:19:09.746394 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b287fe4-a256-468c-8f90-61e073287485 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:19:09.748272 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 673/1350] 10.222.0.24 () {54 vars in 921 bytes} [Thu Apr 7 06:19:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:19:09.754415 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ca94c-2858-4dd1-a840-ec2ea2ef91e4 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:19:09.754846 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ca94c-2858-4dd1-a840-ec2ea2ef91e4 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:19:09.755156 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ca94c-2858-4dd1-a840-ec2ea2ef91e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:19:09.848774 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-f76ca94c-2858-4dd1-a840-ec2ea2ef91e4 None None] MFA Rules not processed for user `ff35b68665724754a6413bca0030016f`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:19:09.850310 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f76ca94c-2858-4dd1-a840-ec2ea2ef91e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:19:09.949566 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 678/1351] 10.222.0.24 () {58 vars in 1018 bytes} [Thu Apr 7 06:19:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:19:14.426883 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2dd06-279a-496e-a76c-16062dc1b1c7 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:19:14.427462 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2dd06-279a-496e-a76c-16062dc1b1c7 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:19:14.427462 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2dd06-279a-496e-a76c-16062dc1b1c7 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:19:14.429199 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 674/1352] 10.222.0.24 () {54 vars in 921 bytes} [Thu Apr 7 06:19:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:19:14.434702 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40bcc02-0905-4539-952f-b4b2c13ef1fb None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:19:14.435533 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40bcc02-0905-4539-952f-b4b2c13ef1fb None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:19:14.436019 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40bcc02-0905-4539-952f-b4b2c13ef1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:19:14.454522 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-a40bcc02-0905-4539-952f-b4b2c13ef1fb None None] MFA Rules not processed for user `ff35b68665724754a6413bca0030016f`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:19:14.456007 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a40bcc02-0905-4539-952f-b4b2c13ef1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:19:14.467495 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 679/1353] 10.222.0.24 () {58 vars in 1018 bytes} [Thu Apr 7 06:19:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:19:15.801404 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2ec1c-c183-42e4-b336-5ce1d3fc08e9 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:19:15.801964 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2ec1c-c183-42e4-b336-5ce1d3fc08e9 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:19:15.801964 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2ec1c-c183-42e4-b336-5ce1d3fc08e9 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:19:15.803360 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 675/1354] 10.222.0.24 () {54 vars in 921 bytes} [Thu Apr 7 06:19:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:19:15.809235 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd90cf-7ca7-4eef-8ec7-802f0820f282 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:19:15.809800 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd90cf-7ca7-4eef-8ec7-802f0820f282 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:19:15.809800 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd90cf-7ca7-4eef-8ec7-802f0820f282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:19:15.828716 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-44bd90cf-7ca7-4eef-8ec7-802f0820f282 None None] MFA Rules not processed for user `ff35b68665724754a6413bca0030016f`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:19:15.829946 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-44bd90cf-7ca7-4eef-8ec7-802f0820f282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:19:15.839185 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 680/1355] 10.222.0.24 () {58 vars in 1018 bytes} [Thu Apr 7 06:19:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:19:19.811269 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190e5aa-f8d2-4cf6-be0d-cdda73941441 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:19:19.811869 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190e5aa-f8d2-4cf6-be0d-cdda73941441 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:19:19.811869 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190e5aa-f8d2-4cf6-be0d-cdda73941441 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:19:19.813363 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 676/1356] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:19:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:19:19.818312 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26a7b1-c864-4cf0-b475-1d44914cbb6a None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:19:19.818721 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26a7b1-c864-4cf0-b475-1d44914cbb6a None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:19:19.818859 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26a7b1-c864-4cf0-b475-1d44914cbb6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:19:19.839296 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-7a26a7b1-c864-4cf0-b475-1d44914cbb6a None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:19:19.841056 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-7a26a7b1-c864-4cf0-b475-1d44914cbb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:19:19.849825 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 681/1357] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:19:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:19:19.898606 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a9e4d-30a8-4869-baa8-249c6f574a0f None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:19:19.899096 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a9e4d-30a8-4869-baa8-249c6f574a0f None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:19:19.899472 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a9e4d-30a8-4869-baa8-249c6f574a0f None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:19:19.901688 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 677/1358] 10.222.0.24 () {54 vars in 960 bytes} [Thu Apr 7 06:19:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:19:19.907242 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c83962-2fc7-4115-9612-e093bd99b6c4 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:19:19.907536 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c83962-2fc7-4115-9612-e093bd99b6c4 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:19:19.907955 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c83962-2fc7-4115-9612-e093bd99b6c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:19:19.955131 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-a1c83962-2fc7-4115-9612-e093bd99b6c4 None None] MFA Rules not processed for user `02cd81f6620f410db450871fb29961f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:19:19.956335 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a1c83962-2fc7-4115-9612-e093bd99b6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:19:20.038860 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 682/1359] 10.222.0.24 () {58 vars in 1057 bytes} [Thu Apr 7 06:19:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:19:20.048568 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646a9e4d-30a8-4869-baa8-249c6f574a0f None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:19:20.065565 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646a9e4d-30a8-4869-baa8-249c6f574a0f None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:19:20.073242 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b6862e-4c7c-4d0d-9c31-e8d23e87568b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cd81f6620f410db450871fb29961f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:19:20.074037 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6862e-4c7c-4d0d-9c31-e8d23e87568b service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:19:20.074419 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6862e-4c7c-4d0d-9c31-e8d23e87568b service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:19:20.074884 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6862e-4c7c-4d0d-9c31-e8d23e87568b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:19:20.086892 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b6862e-4c7c-4d0d-9c31-e8d23e87568b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:19:20.089374 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b6862e-4c7c-4d0d-9c31-e8d23e87568b service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:19:20.100381 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 678/1360] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:19:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:19:22.641245 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d4c76-8368-43b3-b425-7898b440567b None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:19:22.642057 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d4c76-8368-43b3-b425-7898b440567b None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:19:22.642506 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d4c76-8368-43b3-b425-7898b440567b None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:19:22.649242 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703cceda-773a-4d45-8c58-06fb1f475f09 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:19:22.649691 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703cceda-773a-4d45-8c58-06fb1f475f09 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:19:22.649795 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703cceda-773a-4d45-8c58-06fb1f475f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:19:22.651350 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 683/1361] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:19:22 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:19:22.667427 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-703cceda-773a-4d45-8c58-06fb1f475f09 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:19:22.668603 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-703cceda-773a-4d45-8c58-06fb1f475f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:19:22.676447 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 679/1362] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:19:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:19:22.728584 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d4c76-8368-43b3-b425-7898b440567b None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:19:22.745546 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d4c76-8368-43b3-b425-7898b440567b None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:19:22.751732 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492c329-f4f2-443b-922c-531f804aa80d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cd81f6620f410db450871fb29961f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:19:22.761510 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492c329-f4f2-443b-922c-531f804aa80d service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:19:22.761510 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492c329-f4f2-443b-922c-531f804aa80d service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:19:22.761510 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492c329-f4f2-443b-922c-531f804aa80d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:19:22.762230 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c492c329-f4f2-443b-922c-531f804aa80d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:19:22.764024 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c492c329-f4f2-443b-922c-531f804aa80d service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:19:22.778984 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 684/1363] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:19:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:19:25.498429 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e465a333-49b3-4ff2-8a21-3a5b854c0c93 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:19:25.498946 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e465a333-49b3-4ff2-8a21-3a5b854c0c93 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:19:25.499050 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e465a333-49b3-4ff2-8a21-3a5b854c0c93 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:19:25.500394 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 680/1364] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:19:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:19:25.505516 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3868307-5cbe-4d31-a998-44ce682eb9f2 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:19:25.505900 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3868307-5cbe-4d31-a998-44ce682eb9f2 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:19:25.506075 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3868307-5cbe-4d31-a998-44ce682eb9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:19:25.523355 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-e3868307-5cbe-4d31-a998-44ce682eb9f2 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:19:25.524588 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e3868307-5cbe-4d31-a998-44ce682eb9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:19:25.533037 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 685/1365] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:19:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:19:25.580831 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614020c9-8458-4500-9c74-b92acb5f2ffe None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:19:25.582591 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614020c9-8458-4500-9c74-b92acb5f2ffe None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:19:25.582591 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614020c9-8458-4500-9c74-b92acb5f2ffe None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:19:25.583076 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 681/1366] 10.222.0.24 () {54 vars in 960 bytes} [Thu Apr 7 06:19:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:19:25.588068 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c55171-8580-4dc8-87e3-dd3bcd5359bb None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:19:25.589271 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c55171-8580-4dc8-87e3-dd3bcd5359bb None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:19:25.589598 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c55171-8580-4dc8-87e3-dd3bcd5359bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:19:25.607608 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-d5c55171-8580-4dc8-87e3-dd3bcd5359bb None None] MFA Rules not processed for user `02cd81f6620f410db450871fb29961f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:19:25.608852 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d5c55171-8580-4dc8-87e3-dd3bcd5359bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:19:25.618573 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 686/1367] 10.222.0.24 () {58 vars in 1057 bytes} [Thu Apr 7 06:19:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:19:25.626938 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614020c9-8458-4500-9c74-b92acb5f2ffe None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:19:25.642021 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614020c9-8458-4500-9c74-b92acb5f2ffe None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:19:25.647540 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd26641d-2e65-48de-9674-e0c948aade7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cd81f6620f410db450871fb29961f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:19:25.648214 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26641d-2e65-48de-9674-e0c948aade7c service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:19:25.648504 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26641d-2e65-48de-9674-e0c948aade7c service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:19:25.651351 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26641d-2e65-48de-9674-e0c948aade7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:19:25.661684 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd26641d-2e65-48de-9674-e0c948aade7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:19:25.663409 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd26641d-2e65-48de-9674-e0c948aade7c service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:19:25.674396 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 682/1368] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:19:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:19:28.211828 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b38790-04fa-4f0d-b951-62393dbbe015 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:19:28.212379 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b38790-04fa-4f0d-b951-62393dbbe015 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:19:28.212379 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b38790-04fa-4f0d-b951-62393dbbe015 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:19:28.214343 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 687/1369] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:19:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 07 06:19:28.219594 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1214064d-a8d3-4f82-a36b-5e925eea5312 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:19:28.220414 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1214064d-a8d3-4f82-a36b-5e925eea5312 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:19:28.220701 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1214064d-a8d3-4f82-a36b-5e925eea5312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:19:28.238243 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-1214064d-a8d3-4f82-a36b-5e925eea5312 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:19:28.239855 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-1214064d-a8d3-4f82-a36b-5e925eea5312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:19:28.247768 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 683/1370] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:19:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:19:28.261746 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5300c0-718d-4f4a-a4ea-95b01c90c7bb None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:19:28.262037 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5300c0-718d-4f4a-a4ea-95b01c90c7bb None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:19:28.262316 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5300c0-718d-4f4a-a4ea-95b01c90c7bb None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:19:28.263678 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 688/1371] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:19:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:19:28.269056 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19667f-ed02-4185-8773-7cf8d2b5523c None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:19:28.269461 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19667f-ed02-4185-8773-7cf8d2b5523c None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:19:28.269848 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19667f-ed02-4185-8773-7cf8d2b5523c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:19:28.289509 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-3b19667f-ed02-4185-8773-7cf8d2b5523c None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:19:28.290837 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-3b19667f-ed02-4185-8773-7cf8d2b5523c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:19:28.299682 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 684/1372] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:19:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:19:28.345010 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5300c0-718d-4f4a-a4ea-95b01c90c7bb None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:19:28.359778 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5300c0-718d-4f4a-a4ea-95b01c90c7bb None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:19:28.365470 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b477f306-aeab-4c7a-bf66-243611913aef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cd81f6620f410db450871fb29961f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:19:28.366113 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477f306-aeab-4c7a-bf66-243611913aef service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:19:28.366418 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477f306-aeab-4c7a-bf66-243611913aef service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:19:28.366681 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477f306-aeab-4c7a-bf66-243611913aef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:19:28.375607 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b477f306-aeab-4c7a-bf66-243611913aef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:19:28.377232 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b477f306-aeab-4c7a-bf66-243611913aef service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:19:28.387128 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 689/1373] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:19:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:19:28.556523 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67c817-476b-4dd2-a10e-f010f9493b22 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:19:28.556891 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67c817-476b-4dd2-a10e-f010f9493b22 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:19:28.557236 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67c817-476b-4dd2-a10e-f010f9493b22 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:19:28.558747 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 685/1374] 10.222.0.24 () {54 vars in 962 bytes} [Thu Apr 7 06:19:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:19:28.563934 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c189a1-6c04-4a85-b8ee-94f4367bf39f None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:19:28.564228 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c189a1-6c04-4a85-b8ee-94f4367bf39f None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:19:28.564504 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c189a1-6c04-4a85-b8ee-94f4367bf39f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:19:28.629443 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-09c189a1-6c04-4a85-b8ee-94f4367bf39f None None] MFA Rules not processed for user `0fc81e8151cc4dd2a79d3c6c9d9ceaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:19:28.630917 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-09c189a1-6c04-4a85-b8ee-94f4367bf39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:19:28.699556 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 690/1375] 10.222.0.24 () {58 vars in 1059 bytes} [Thu Apr 7 06:19:28 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:19:28.707433 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c67c817-476b-4dd2-a10e-f010f9493b22 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:19:28.718872 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c67c817-476b-4dd2-a10e-f010f9493b22 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:19:28.722649 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac329176-057d-4604-a2d6-60f7dfa2cfc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:19:28.723323 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac329176-057d-4604-a2d6-60f7dfa2cfc2 service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:19:28.723613 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac329176-057d-4604-a2d6-60f7dfa2cfc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:19:28.723932 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac329176-057d-4604-a2d6-60f7dfa2cfc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:19:28.734562 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac329176-057d-4604-a2d6-60f7dfa2cfc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:19:28.736064 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac329176-057d-4604-a2d6-60f7dfa2cfc2 service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:19:28.751932 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 686/1376] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:19:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:19:30.873026 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f8e654-aa85-4ec3-8d8a-03fd354a705f None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:19:30.873535 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f8e654-aa85-4ec3-8d8a-03fd354a705f None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:19:30.873641 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f8e654-aa85-4ec3-8d8a-03fd354a705f None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:19:30.875225 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 691/1377] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:19:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:19:30.880410 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca392c-c180-4960-977e-a51c13cdb62c None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:19:30.881256 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca392c-c180-4960-977e-a51c13cdb62c None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:19:30.881539 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca392c-c180-4960-977e-a51c13cdb62c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:19:30.899017 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-7bca392c-c180-4960-977e-a51c13cdb62c None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:19:30.900233 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-7bca392c-c180-4960-977e-a51c13cdb62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:19:30.908518 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 687/1378] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:19:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:19:30.953264 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f8e654-aa85-4ec3-8d8a-03fd354a705f None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:19:30.968692 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f8e654-aa85-4ec3-8d8a-03fd354a705f None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:19:30.974257 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb47fa-0e8d-4f94-92e9-d34cbf843815 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cd81f6620f410db450871fb29961f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:19:30.974940 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb47fa-0e8d-4f94-92e9-d34cbf843815 service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:19:30.975230 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb47fa-0e8d-4f94-92e9-d34cbf843815 service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:19:30.975508 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb47fa-0e8d-4f94-92e9-d34cbf843815 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:19:30.984187 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eb47fa-0e8d-4f94-92e9-d34cbf843815 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:19:30.985995 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eb47fa-0e8d-4f94-92e9-d34cbf843815 service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:19:30.996522 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 692/1379] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:19:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:19:33.476205 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd8e75-722d-43de-8564-6a8ffc931fc9 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:19:33.476715 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd8e75-722d-43de-8564-6a8ffc931fc9 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:19:33.476715 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd8e75-722d-43de-8564-6a8ffc931fc9 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:19:33.478061 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 688/1380] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:19:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:19:33.483735 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f0615-3fb7-4225-ae5e-259423b44a1f None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:19:33.484152 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f0615-3fb7-4225-ae5e-259423b44a1f None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:19:33.484330 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f0615-3fb7-4225-ae5e-259423b44a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:19:33.502522 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-991f0615-3fb7-4225-ae5e-259423b44a1f None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:19:33.503700 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-991f0615-3fb7-4225-ae5e-259423b44a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:19:33.511623 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 693/1381] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:19:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:19:33.555584 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebd8e75-722d-43de-8564-6a8ffc931fc9 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:19:33.569806 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebd8e75-722d-43de-8564-6a8ffc931fc9 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:19:33.576049 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6908228-05eb-4bb9-9338-db5008ab5126 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cd81f6620f410db450871fb29961f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:19:33.576691 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6908228-05eb-4bb9-9338-db5008ab5126 service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:19:33.576977 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6908228-05eb-4bb9-9338-db5008ab5126 service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:19:33.577265 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6908228-05eb-4bb9-9338-db5008ab5126 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:19:33.585464 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6908228-05eb-4bb9-9338-db5008ab5126 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:19:33.587044 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6908228-05eb-4bb9-9338-db5008ab5126 service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:19:33.596670 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 689/1382] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:19:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:19:36.021698 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51579364-f60d-4e71-bb7a-5de77b0d872b None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:19:36.022242 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51579364-f60d-4e71-bb7a-5de77b0d872b None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:19:36.022242 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51579364-f60d-4e71-bb7a-5de77b0d872b None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:19:36.023692 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 694/1383] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:19:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:19:36.028725 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50d158-8f66-449c-b4c6-4e9d1d1861c6 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:19:36.029157 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50d158-8f66-449c-b4c6-4e9d1d1861c6 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:19:36.029284 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50d158-8f66-449c-b4c6-4e9d1d1861c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:19:36.047317 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-ce50d158-8f66-449c-b4c6-4e9d1d1861c6 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:19:36.048550 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-ce50d158-8f66-449c-b4c6-4e9d1d1861c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:19:36.056959 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 690/1384] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:19:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:19:36.100001 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51579364-f60d-4e71-bb7a-5de77b0d872b None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:19:36.114237 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51579364-f60d-4e71-bb7a-5de77b0d872b None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:19:36.120455 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd6042f-79ca-4e23-9678-7914acbdecb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cd81f6620f410db450871fb29961f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:19:36.121089 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6042f-79ca-4e23-9678-7914acbdecb7 service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:19:36.121566 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6042f-79ca-4e23-9678-7914acbdecb7 service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:19:36.121863 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6042f-79ca-4e23-9678-7914acbdecb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:19:36.130079 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd6042f-79ca-4e23-9678-7914acbdecb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:19:36.131682 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd6042f-79ca-4e23-9678-7914acbdecb7 service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:19:36.141647 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 695/1385] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:19:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:19:38.685246 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372c290-a40a-44f2-a99c-f4a99535daf8 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:19:38.685780 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372c290-a40a-44f2-a99c-f4a99535daf8 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:19:38.685780 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372c290-a40a-44f2-a99c-f4a99535daf8 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:19:38.687150 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 691/1386] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:19:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:19:38.693475 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfac180-c5d1-4734-8009-c772a20aa68a None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:19:38.694059 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfac180-c5d1-4734-8009-c772a20aa68a None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:19:38.694154 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfac180-c5d1-4734-8009-c772a20aa68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:19:38.711314 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-acfac180-c5d1-4734-8009-c772a20aa68a None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:19:38.712547 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-acfac180-c5d1-4734-8009-c772a20aa68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:19:38.720361 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 696/1387] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:19:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:19:38.767886 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7372c290-a40a-44f2-a99c-f4a99535daf8 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:19:38.782063 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7372c290-a40a-44f2-a99c-f4a99535daf8 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:19:38.787583 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130dd0e3-7f38-415a-b0f8-943327d41b8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cd81f6620f410db450871fb29961f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:19:38.788253 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130dd0e3-7f38-415a-b0f8-943327d41b8b service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:19:38.788536 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130dd0e3-7f38-415a-b0f8-943327d41b8b service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:19:38.788807 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130dd0e3-7f38-415a-b0f8-943327d41b8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:19:38.797342 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130dd0e3-7f38-415a-b0f8-943327d41b8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:19:38.798918 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130dd0e3-7f38-415a-b0f8-943327d41b8b service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:19:38.808706 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 692/1388] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:19:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:19:41.379523 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19d685-cfd0-4089-8f19-ec89d26e3ec0 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:19:41.380066 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19d685-cfd0-4089-8f19-ec89d26e3ec0 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:19:41.380066 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19d685-cfd0-4089-8f19-ec89d26e3ec0 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:19:41.381383 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 697/1389] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:19:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:19:41.387204 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29162d-0985-4252-b522-4015aac6c184 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:19:41.387872 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29162d-0985-4252-b522-4015aac6c184 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:19:41.387872 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29162d-0985-4252-b522-4015aac6c184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:19:41.404814 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-0e29162d-0985-4252-b522-4015aac6c184 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:19:41.406021 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-0e29162d-0985-4252-b522-4015aac6c184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:19:41.413773 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 693/1390] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:19:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:19:41.458591 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e19d685-cfd0-4089-8f19-ec89d26e3ec0 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:19:41.472739 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e19d685-cfd0-4089-8f19-ec89d26e3ec0 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:19:41.479202 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d6407-3c2d-40df-9e2b-b44759dd8930 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cd81f6620f410db450871fb29961f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:19:41.480379 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d6407-3c2d-40df-9e2b-b44759dd8930 service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:19:41.480775 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d6407-3c2d-40df-9e2b-b44759dd8930 service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:19:41.481133 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d6407-3c2d-40df-9e2b-b44759dd8930 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:19:41.492018 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d6407-3c2d-40df-9e2b-b44759dd8930 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:19:41.494532 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d6407-3c2d-40df-9e2b-b44759dd8930 service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:19:41.505946 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 698/1391] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:19:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:19:43.967683 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e9b17-cfc0-45d6-9852-5828e5090f5a None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:19:43.968305 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e9b17-cfc0-45d6-9852-5828e5090f5a None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:19:43.968305 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e9b17-cfc0-45d6-9852-5828e5090f5a None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:19:43.969622 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 694/1392] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:19:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:19:43.974866 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5c31ce-6dab-47a3-bf71-87f2a8e723ba None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:19:43.975292 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5c31ce-6dab-47a3-bf71-87f2a8e723ba None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:19:43.975406 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5c31ce-6dab-47a3-bf71-87f2a8e723ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:19:43.993122 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-8f5c31ce-6dab-47a3-bf71-87f2a8e723ba None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:19:43.994928 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-8f5c31ce-6dab-47a3-bf71-87f2a8e723ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:19:44.002596 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 699/1393] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:19:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:19:44.046380 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e9b17-cfc0-45d6-9852-5828e5090f5a None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:19:44.060976 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e9b17-cfc0-45d6-9852-5828e5090f5a None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:19:44.066260 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6deda1-ed80-42c8-8afa-2413df39a69c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cd81f6620f410db450871fb29961f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:19:44.066887 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6deda1-ed80-42c8-8afa-2413df39a69c service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:19:44.067170 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6deda1-ed80-42c8-8afa-2413df39a69c service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:19:44.067443 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6deda1-ed80-42c8-8afa-2413df39a69c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:19:44.075288 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6deda1-ed80-42c8-8afa-2413df39a69c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:19:44.076890 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6deda1-ed80-42c8-8afa-2413df39a69c service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:19:44.086248 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 695/1394] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:19:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:19:45.041609 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766bc7c-30ad-4564-b285-dd4b3f43db37 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:19:45.042149 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766bc7c-30ad-4564-b285-dd4b3f43db37 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:19:45.042260 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766bc7c-30ad-4564-b285-dd4b3f43db37 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:19:45.043670 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 700/1395] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:19:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 07 06:19:45.048925 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b01e5-5534-4fef-86bd-8820f25c0318 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:19:45.049358 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b01e5-5534-4fef-86bd-8820f25c0318 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:19:45.049500 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b01e5-5534-4fef-86bd-8820f25c0318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:19:45.068450 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-5f8b01e5-5534-4fef-86bd-8820f25c0318 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:19:45.069638 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-5f8b01e5-5534-4fef-86bd-8820f25c0318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:19:45.078075 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 696/1396] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:19:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:19:45.136045 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b10bb7-fd9a-4860-83c8-7c6f4f079d11 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:19:45.136530 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b10bb7-fd9a-4860-83c8-7c6f4f079d11 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:19:45.137022 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b10bb7-fd9a-4860-83c8-7c6f4f079d11 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:19:45.138855 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 701/1397] 10.222.0.24 () {54 vars in 961 bytes} [Thu Apr 7 06:19:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:19:45.143922 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587ea97-5e5a-4ca4-bde4-a30ffeba2672 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:19:45.144219 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587ea97-5e5a-4ca4-bde4-a30ffeba2672 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:19:45.144504 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587ea97-5e5a-4ca4-bde4-a30ffeba2672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:19:45.190868 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-7587ea97-5e5a-4ca4-bde4-a30ffeba2672 None None] MFA Rules not processed for user `0ca88debdfcc4a9d918e3b0138a9add1`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:19:45.192096 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-7587ea97-5e5a-4ca4-bde4-a30ffeba2672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:19:45.248983 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 697/1398] 10.222.0.24 () {58 vars in 1058 bytes} [Thu Apr 7 06:19:45 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:19:45.256574 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b10bb7-fd9a-4860-83c8-7c6f4f079d11 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:19:45.268094 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b10bb7-fd9a-4860-83c8-7c6f4f079d11 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:19:45.271603 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1e5e5d-950e-4977-81b9-5c3bcadca847 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca88debdfcc4a9d918e3b0138a9add1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:19:45.272285 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e5e5d-950e-4977-81b9-5c3bcadca847 service glance] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:19:45.272571 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e5e5d-950e-4977-81b9-5c3bcadca847 service glance] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:19:45.272845 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e5e5d-950e-4977-81b9-5c3bcadca847 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:19:45.281918 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1e5e5d-950e-4977-81b9-5c3bcadca847 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:19:45.283401 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1e5e5d-950e-4977-81b9-5c3bcadca847 service glance] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:19:45.292695 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 702/1399] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:19:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:19:45.867928 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c68f56-e02e-48a0-9c68-6d9875ede242 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:19:45.868217 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c68f56-e02e-48a0-9c68-6d9875ede242 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:19:45.868993 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c68f56-e02e-48a0-9c68-6d9875ede242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:19:45.915727 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-b9c68f56-e02e-48a0-9c68-6d9875ede242 None None] MFA Rules not processed for user `f4435fb14c3844728531af63993f78c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:19:45.916986 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b9c68f56-e02e-48a0-9c68-6d9875ede242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:19:45.979082 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 698/1400] 10.222.0.24 () {58 vars in 1009 bytes} [Thu Apr 7 06:19:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:19:46.019402 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe0b9a-1ee3-4101-ba27-1fa6b2bbcc2d None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:19:46.019786 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe0b9a-1ee3-4101-ba27-1fa6b2bbcc2d None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:19:46.020140 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe0b9a-1ee3-4101-ba27-1fa6b2bbcc2d None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:19:46.021769 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 703/1401] 10.222.0.24 () {54 vars in 942 bytes} [Thu Apr 7 06:19:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:19:46.027547 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20af5d-2a70-4d90-acae-693ead63f0f6 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:19:46.027866 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20af5d-2a70-4d90-acae-693ead63f0f6 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:19:46.028149 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20af5d-2a70-4d90-acae-693ead63f0f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:19:46.075128 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-df20af5d-2a70-4d90-acae-693ead63f0f6 None None] MFA Rules not processed for user `8b4abbb8c5324b7babd69e3b4473b3e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:19:46.076344 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-df20af5d-2a70-4d90-acae-693ead63f0f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:19:46.145536 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 699/1402] 10.222.0.24 () {58 vars in 1039 bytes} [Thu Apr 7 06:19:46 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:19:46.154229 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe0b9a-1ee3-4101-ba27-1fa6b2bbcc2d None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:19:46.168484 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe0b9a-1ee3-4101-ba27-1fa6b2bbcc2d None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:19:46.173828 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f570fc0c-8f7f-45c6-9407-fd1b2a74d19f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4abbb8c5324b7babd69e3b4473b3e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:19:46.174477 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570fc0c-8f7f-45c6-9407-fd1b2a74d19f service swift] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:19:46.174885 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570fc0c-8f7f-45c6-9407-fd1b2a74d19f service swift] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:19:46.175172 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570fc0c-8f7f-45c6-9407-fd1b2a74d19f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:19:46.184358 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f570fc0c-8f7f-45c6-9407-fd1b2a74d19f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:19:46.185945 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f570fc0c-8f7f-45c6-9407-fd1b2a74d19f service swift] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:19:46.193775 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 704/1403] 10.222.0.24 () {60 vars in 1384 bytes} [Thu Apr 7 06:19:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 07 06:19:46.515379 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb65988-0e92-4706-9fad-7afa27be0904 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:19:46.515673 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb65988-0e92-4706-9fad-7afa27be0904 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:19:46.515988 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb65988-0e92-4706-9fad-7afa27be0904 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:19:46.517371 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 700/1404] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:19:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:19:46.522680 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d192a-54da-4049-bbd4-7f784220d5d3 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:19:46.522972 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d192a-54da-4049-bbd4-7f784220d5d3 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:19:46.523248 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d192a-54da-4049-bbd4-7f784220d5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:19:46.541234 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-0b9d192a-54da-4049-bbd4-7f784220d5d3 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:19:46.542439 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-0b9d192a-54da-4049-bbd4-7f784220d5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:19:46.551022 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 705/1405] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:19:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:19:46.598538 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb65988-0e92-4706-9fad-7afa27be0904 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:19:46.613634 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb65988-0e92-4706-9fad-7afa27be0904 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:19:46.619877 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111cc8b-fc1b-45a0-a638-f88529c1767c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cd81f6620f410db450871fb29961f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:19:46.620510 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111cc8b-fc1b-45a0-a638-f88529c1767c service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:19:46.620798 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111cc8b-fc1b-45a0-a638-f88529c1767c service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:19:46.621071 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111cc8b-fc1b-45a0-a638-f88529c1767c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:19:46.629378 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f111cc8b-fc1b-45a0-a638-f88529c1767c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:19:46.630970 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f111cc8b-fc1b-45a0-a638-f88529c1767c service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:19:46.640997 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 701/1406] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:19:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:19:49.136137 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee6ce1-8c65-4644-b626-55890760637f None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:19:49.136607 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee6ce1-8c65-4644-b626-55890760637f None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:19:49.136703 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee6ce1-8c65-4644-b626-55890760637f None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:19:49.138066 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 706/1407] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:19:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 07 06:19:49.143518 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52068bb9-97d3-4735-ab3f-617f4868573f None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:19:49.144130 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52068bb9-97d3-4735-ab3f-617f4868573f None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:19:49.144400 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52068bb9-97d3-4735-ab3f-617f4868573f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:19:49.166245 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-52068bb9-97d3-4735-ab3f-617f4868573f None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:19:49.167448 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-52068bb9-97d3-4735-ab3f-617f4868573f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:19:49.176434 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 702/1408] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:19:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:19:49.221971 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee6ce1-8c65-4644-b626-55890760637f None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:19:49.247839 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee6ce1-8c65-4644-b626-55890760637f None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:19:49.257379 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0ac76-bae2-4a8f-8885-cad155e305d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cd81f6620f410db450871fb29961f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:19:49.258469 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0ac76-bae2-4a8f-8885-cad155e305d1 service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:19:49.258842 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0ac76-bae2-4a8f-8885-cad155e305d1 service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:19:49.259875 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0ac76-bae2-4a8f-8885-cad155e305d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:19:49.274566 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea0ac76-bae2-4a8f-8885-cad155e305d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:19:49.277694 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea0ac76-bae2-4a8f-8885-cad155e305d1 service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:19:49.293059 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 707/1409] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:19:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:20:11.184162 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62728d4b-3d42-4c75-b367-bafc3b35aaf8 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:20:11.184762 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62728d4b-3d42-4c75-b367-bafc3b35aaf8 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:20:11.184868 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62728d4b-3d42-4c75-b367-bafc3b35aaf8 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:20:11.186196 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 703/1410] 10.222.0.24 () {54 vars in 918 bytes} [Thu Apr 7 06:20:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:20:11.191482 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd2d1d-ae6d-4211-89df-fc7ae12957ed None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:20:11.191988 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd2d1d-ae6d-4211-89df-fc7ae12957ed None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:20:11.192099 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd2d1d-ae6d-4211-89df-fc7ae12957ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:20:11.210482 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-e3cd2d1d-ae6d-4211-89df-fc7ae12957ed None None] MFA Rules not processed for user `ff35b68665724754a6413bca0030016f`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:20:11.212308 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e3cd2d1d-ae6d-4211-89df-fc7ae12957ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:20:11.220680 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 708/1411] 10.222.0.24 () {58 vars in 1015 bytes} [Thu Apr 7 06:20:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:20:11.234673 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ca177-b92d-40cb-866f-1eceee9a69cb None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:20:11.234960 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ca177-b92d-40cb-866f-1eceee9a69cb None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:20:11.235235 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ca177-b92d-40cb-866f-1eceee9a69cb None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:20:11.236616 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 704/1412] 10.222.0.24 () {54 vars in 918 bytes} [Thu Apr 7 06:20:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:20:11.241824 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c2cb7-a674-4eae-8ada-386436ff34f3 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:20:11.246079 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c2cb7-a674-4eae-8ada-386436ff34f3 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:20:11.246079 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c2cb7-a674-4eae-8ada-386436ff34f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:20:11.260621 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-8d7c2cb7-a674-4eae-8ada-386436ff34f3 None None] MFA Rules not processed for user `02cd81f6620f410db450871fb29961f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:20:11.261795 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-8d7c2cb7-a674-4eae-8ada-386436ff34f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:20:11.271221 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 709/1413] 10.222.0.24 () {58 vars in 1015 bytes} [Thu Apr 7 06:20:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:20:14.017685 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9800af8-80bc-4252-af2b-ca92bae1aa4b None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:20:14.018269 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9800af8-80bc-4252-af2b-ca92bae1aa4b None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:20:14.018269 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9800af8-80bc-4252-af2b-ca92bae1aa4b None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:20:14.019985 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 705/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Apr 7 06:20:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:20:14.025971 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f7bb6-31c2-417c-a3cd-5f212aa18522 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:20:14.026364 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f7bb6-31c2-417c-a3cd-5f212aa18522 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:20:14.026467 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f7bb6-31c2-417c-a3cd-5f212aa18522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:20:14.043598 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-d38f7bb6-31c2-417c-a3cd-5f212aa18522 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:20:14.044803 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d38f7bb6-31c2-417c-a3cd-5f212aa18522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:20:14.052497 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 710/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Apr 7 06:20:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:20:14.096459 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9800af8-80bc-4252-af2b-ca92bae1aa4b None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:20:14.112248 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9800af8-80bc-4252-af2b-ca92bae1aa4b None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:20:14.118535 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8eecdc-c56d-4828-a5e9-0b2f0d402077 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cd81f6620f410db450871fb29961f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:20:14.119238 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8eecdc-c56d-4828-a5e9-0b2f0d402077 service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:20:14.119537 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8eecdc-c56d-4828-a5e9-0b2f0d402077 service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:20:14.119869 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8eecdc-c56d-4828-a5e9-0b2f0d402077 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:20:14.128444 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8eecdc-c56d-4828-a5e9-0b2f0d402077 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:20:14.130049 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8eecdc-c56d-4828-a5e9-0b2f0d402077 service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:20:14.139609 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 706/1416] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:20:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:20:15.485159 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd11be-9804-48c6-918d-cc5db90cdb09 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:20:15.485718 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd11be-9804-48c6-918d-cc5db90cdb09 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:20:15.485718 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd11be-9804-48c6-918d-cc5db90cdb09 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:20:15.487022 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 711/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Apr 7 06:20:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:20:15.492073 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530bb593-23a1-4cd9-9a01-91d24fc048c3 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:20:15.493080 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530bb593-23a1-4cd9-9a01-91d24fc048c3 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:20:15.493183 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530bb593-23a1-4cd9-9a01-91d24fc048c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:20:15.510441 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-530bb593-23a1-4cd9-9a01-91d24fc048c3 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:20:15.511611 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-530bb593-23a1-4cd9-9a01-91d24fc048c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:20:15.519286 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 707/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Apr 7 06:20:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:20:15.713061 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd11be-9804-48c6-918d-cc5db90cdb09 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:20:15.727727 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd11be-9804-48c6-918d-cc5db90cdb09 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:20:15.733021 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f488f-de5d-429f-82d0-6d241ce58066 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cd81f6620f410db450871fb29961f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:20:15.733652 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f488f-de5d-429f-82d0-6d241ce58066 service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:20:15.733932 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f488f-de5d-429f-82d0-6d241ce58066 service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:20:15.734204 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f488f-de5d-429f-82d0-6d241ce58066 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:20:15.742799 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072f488f-de5d-429f-82d0-6d241ce58066 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:20:15.744458 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072f488f-de5d-429f-82d0-6d241ce58066 service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:20:15.753662 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 712/1419] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:20:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:20:17.060468 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57ca02-d560-4f9b-83f9-0f6865a2a9ee None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:20:17.060984 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57ca02-d560-4f9b-83f9-0f6865a2a9ee None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:20:17.061134 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57ca02-d560-4f9b-83f9-0f6865a2a9ee None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:20:17.062635 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 708/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Apr 7 06:20:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:20:17.067547 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfaecf-7e3d-4a50-a12f-c21320b516cf None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:20:17.067971 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfaecf-7e3d-4a50-a12f-c21320b516cf None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:20:17.068133 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfaecf-7e3d-4a50-a12f-c21320b516cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:20:17.085471 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-5bbfaecf-7e3d-4a50-a12f-c21320b516cf None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:20:17.086751 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-5bbfaecf-7e3d-4a50-a12f-c21320b516cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:20:17.094432 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 713/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Apr 7 06:20:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:20:17.251810 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef57ca02-d560-4f9b-83f9-0f6865a2a9ee None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:20:17.265931 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef57ca02-d560-4f9b-83f9-0f6865a2a9ee None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:20:17.271261 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4a14b-065c-48eb-81ba-082842e30b9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cd81f6620f410db450871fb29961f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:20:17.271931 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4a14b-065c-48eb-81ba-082842e30b9a service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:20:17.272219 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4a14b-065c-48eb-81ba-082842e30b9a service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:20:17.272497 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4a14b-065c-48eb-81ba-082842e30b9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:20:17.280890 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c4a14b-065c-48eb-81ba-082842e30b9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:20:17.282485 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c4a14b-065c-48eb-81ba-082842e30b9a service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:20:17.292254 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 709/1422] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:20:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:20:18.590710 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318f73c-8ac3-4345-8966-8b4485439fc0 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:20:18.591278 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318f73c-8ac3-4345-8966-8b4485439fc0 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:20:18.591413 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318f73c-8ac3-4345-8966-8b4485439fc0 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:20:18.592792 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 714/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Apr 7 06:20:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:20:18.597751 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42647230-7da1-4745-a3e8-7ff989b16e04 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:20:18.598158 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42647230-7da1-4745-a3e8-7ff989b16e04 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:20:18.598337 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42647230-7da1-4745-a3e8-7ff989b16e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:20:18.616452 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-42647230-7da1-4745-a3e8-7ff989b16e04 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:20:18.617669 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-42647230-7da1-4745-a3e8-7ff989b16e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:20:18.625428 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 710/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Apr 7 06:20:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:20:18.778227 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d318f73c-8ac3-4345-8966-8b4485439fc0 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:20:18.792034 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d318f73c-8ac3-4345-8966-8b4485439fc0 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:20:18.797219 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d9a076-67b4-449d-9fe5-c3814f3d2cdb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cd81f6620f410db450871fb29961f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:20:18.797841 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9a076-67b4-449d-9fe5-c3814f3d2cdb service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:20:18.798122 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9a076-67b4-449d-9fe5-c3814f3d2cdb service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:20:18.798392 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9a076-67b4-449d-9fe5-c3814f3d2cdb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:20:18.806664 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d9a076-67b4-449d-9fe5-c3814f3d2cdb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:20:18.808245 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d9a076-67b4-449d-9fe5-c3814f3d2cdb service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:20:18.817236 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 715/1425] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:20:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:20:20.199310 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605526b-ce21-4547-850d-0d631bea6e92 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:20:20.199808 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605526b-ce21-4547-850d-0d631bea6e92 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:20:20.199926 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605526b-ce21-4547-850d-0d631bea6e92 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:20:20.201266 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 711/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Apr 7 06:20:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:20:20.206099 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f2412-fbb4-4e46-93b9-bc2e8c82cb16 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:20:20.206552 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f2412-fbb4-4e46-93b9-bc2e8c82cb16 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:20:20.206649 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f2412-fbb4-4e46-93b9-bc2e8c82cb16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:20:20.224671 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-2d0f2412-fbb4-4e46-93b9-bc2e8c82cb16 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:20:20.225846 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-2d0f2412-fbb4-4e46-93b9-bc2e8c82cb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:20:20.233578 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 716/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Apr 7 06:20:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:20:20.383287 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8605526b-ce21-4547-850d-0d631bea6e92 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:20:20.397584 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8605526b-ce21-4547-850d-0d631bea6e92 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:20:20.403460 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db163064-db5d-41a8-b1ab-e3db600f01a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cd81f6620f410db450871fb29961f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:20:20.404137 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db163064-db5d-41a8-b1ab-e3db600f01a3 service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:20:20.404426 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db163064-db5d-41a8-b1ab-e3db600f01a3 service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:20:20.404708 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db163064-db5d-41a8-b1ab-e3db600f01a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:20:20.416374 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db163064-db5d-41a8-b1ab-e3db600f01a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:20:20.417971 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db163064-db5d-41a8-b1ab-e3db600f01a3 service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:20:20.427891 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 712/1428] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:20:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:20:21.753133 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b5b0a-7f8e-4db3-bff0-6a31b83aec6e None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:20:21.753675 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b5b0a-7f8e-4db3-bff0-6a31b83aec6e None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:20:21.753675 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b5b0a-7f8e-4db3-bff0-6a31b83aec6e None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:20:21.755067 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 717/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Apr 7 06:20:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:20:21.761223 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9722523-76c7-458b-9e90-3eec173dcba0 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:20:21.761678 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9722523-76c7-458b-9e90-3eec173dcba0 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:20:21.761804 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9722523-76c7-458b-9e90-3eec173dcba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:20:21.779686 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-a9722523-76c7-458b-9e90-3eec173dcba0 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:20:21.781315 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a9722523-76c7-458b-9e90-3eec173dcba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:20:21.788669 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 713/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Apr 7 06:20:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:20:21.940235 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b5b0a-7f8e-4db3-bff0-6a31b83aec6e None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:20:21.954943 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b5b0a-7f8e-4db3-bff0-6a31b83aec6e None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:20:21.960417 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa65535-79fc-4726-a94d-c1224c9a483b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cd81f6620f410db450871fb29961f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:20:21.961147 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa65535-79fc-4726-a94d-c1224c9a483b service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:20:21.961437 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa65535-79fc-4726-a94d-c1224c9a483b service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:20:21.961714 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa65535-79fc-4726-a94d-c1224c9a483b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:20:21.969801 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa65535-79fc-4726-a94d-c1224c9a483b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:20:21.971367 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa65535-79fc-4726-a94d-c1224c9a483b service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:20:21.980535 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 718/1431] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:20:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:20:23.296063 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75824bb1-c32f-4138-8730-876997ffcf5c None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:20:23.296585 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75824bb1-c32f-4138-8730-876997ffcf5c None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:20:23.296674 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75824bb1-c32f-4138-8730-876997ffcf5c None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:20:23.298029 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 714/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Apr 7 06:20:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:20:23.302963 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6356997-41ca-40de-8700-02a274211efe None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:20:23.303344 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6356997-41ca-40de-8700-02a274211efe None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:20:23.303513 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6356997-41ca-40de-8700-02a274211efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:20:23.322205 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-b6356997-41ca-40de-8700-02a274211efe None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:20:23.323879 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b6356997-41ca-40de-8700-02a274211efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:20:23.332782 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 719/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Apr 7 06:20:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:20:23.481494 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75824bb1-c32f-4138-8730-876997ffcf5c None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:20:23.495969 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75824bb1-c32f-4138-8730-876997ffcf5c None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:20:23.501239 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce98ea5-6bad-4a38-8cd0-809f78e94c28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cd81f6620f410db450871fb29961f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:20:23.501864 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce98ea5-6bad-4a38-8cd0-809f78e94c28 service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:20:23.502173 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce98ea5-6bad-4a38-8cd0-809f78e94c28 service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:20:23.502416 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce98ea5-6bad-4a38-8cd0-809f78e94c28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:20:23.510903 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce98ea5-6bad-4a38-8cd0-809f78e94c28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:20:23.512506 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce98ea5-6bad-4a38-8cd0-809f78e94c28 service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:20:23.521564 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 715/1434] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:20:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:20:24.831022 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e17be2-820b-43c6-acd1-f1986b8867da None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:20:24.831632 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e17be2-820b-43c6-acd1-f1986b8867da None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:20:24.831632 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e17be2-820b-43c6-acd1-f1986b8867da None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:20:24.833076 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 720/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Apr 7 06:20:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:20:24.839013 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d99538-d278-46bc-a8d8-cb26d06a551f None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:20:24.839479 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d99538-d278-46bc-a8d8-cb26d06a551f None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:20:24.839586 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d99538-d278-46bc-a8d8-cb26d06a551f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:20:24.857998 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-d9d99538-d278-46bc-a8d8-cb26d06a551f None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:20:24.859183 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d9d99538-d278-46bc-a8d8-cb26d06a551f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:20:24.867155 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 716/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Apr 7 06:20:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:20:25.019212 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e17be2-820b-43c6-acd1-f1986b8867da None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:20:25.033438 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e17be2-820b-43c6-acd1-f1986b8867da None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:20:25.039546 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff82ca9c-5b6f-4f2d-a2bf-b023ee2efa44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cd81f6620f410db450871fb29961f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:20:25.040293 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82ca9c-5b6f-4f2d-a2bf-b023ee2efa44 service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:20:25.040588 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82ca9c-5b6f-4f2d-a2bf-b023ee2efa44 service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:20:25.040862 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82ca9c-5b6f-4f2d-a2bf-b023ee2efa44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:20:25.049016 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff82ca9c-5b6f-4f2d-a2bf-b023ee2efa44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:20:25.050587 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff82ca9c-5b6f-4f2d-a2bf-b023ee2efa44 service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:20:25.060538 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 721/1437] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:20:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:20:26.404969 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda98239-475d-477e-96dc-100fab6dffa6 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:20:26.405518 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda98239-475d-477e-96dc-100fab6dffa6 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:20:26.405518 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda98239-475d-477e-96dc-100fab6dffa6 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:20:26.406903 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 717/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Apr 7 06:20:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:20:26.411816 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae8535-7bdb-4bfa-bbc1-a58858357b1e None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:20:26.412237 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae8535-7bdb-4bfa-bbc1-a58858357b1e None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:20:26.412386 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae8535-7bdb-4bfa-bbc1-a58858357b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:20:26.430733 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-09ae8535-7bdb-4bfa-bbc1-a58858357b1e None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:20:26.431996 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-09ae8535-7bdb-4bfa-bbc1-a58858357b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:20:26.440364 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 722/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Apr 7 06:20:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:20:26.590096 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda98239-475d-477e-96dc-100fab6dffa6 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:20:26.604222 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda98239-475d-477e-96dc-100fab6dffa6 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:20:26.609444 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b0913-4265-4c1c-adc5-5c5617389731 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cd81f6620f410db450871fb29961f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:20:26.610072 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b0913-4265-4c1c-adc5-5c5617389731 service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:20:26.610355 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b0913-4265-4c1c-adc5-5c5617389731 service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:20:26.610627 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b0913-4265-4c1c-adc5-5c5617389731 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:20:26.618799 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675b0913-4265-4c1c-adc5-5c5617389731 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:20:26.623720 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675b0913-4265-4c1c-adc5-5c5617389731 service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:20:26.629985 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 718/1440] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:20:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:20:28.778940 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60aa67-7881-4a7b-829c-5ffd1e64cd2b None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:20:28.779456 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60aa67-7881-4a7b-829c-5ffd1e64cd2b None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:20:28.779563 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60aa67-7881-4a7b-829c-5ffd1e64cd2b None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:20:28.780919 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 723/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Apr 7 06:20:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:20:28.786128 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c21f03-18c6-4c96-a5c9-0c4cf3a31e5a None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:20:28.786620 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c21f03-18c6-4c96-a5c9-0c4cf3a31e5a None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:20:28.786715 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c21f03-18c6-4c96-a5c9-0c4cf3a31e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:20:28.806720 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-d7c21f03-18c6-4c96-a5c9-0c4cf3a31e5a None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:20:28.807983 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d7c21f03-18c6-4c96-a5c9-0c4cf3a31e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:20:28.815621 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 719/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Apr 7 06:20:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:20:28.856088 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c60aa67-7881-4a7b-829c-5ffd1e64cd2b None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:20:28.866587 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c60aa67-7881-4a7b-829c-5ffd1e64cd2b None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:20:28.870073 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92686d25-e2c6-4bea-83e3-a92d95c39d91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:20:28.870699 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92686d25-e2c6-4bea-83e3-a92d95c39d91 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:20:28.870981 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92686d25-e2c6-4bea-83e3-a92d95c39d91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:20:28.871254 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92686d25-e2c6-4bea-83e3-a92d95c39d91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:20:28.879698 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92686d25-e2c6-4bea-83e3-a92d95c39d91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:20:28.881161 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92686d25-e2c6-4bea-83e3-a92d95c39d91 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:20:28.890661 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 724/1443] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:20:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:20:31.317908 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd0672-ec7c-41b9-85e9-67215f2e5bec None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:20:31.318517 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd0672-ec7c-41b9-85e9-67215f2e5bec None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:20:31.318517 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd0672-ec7c-41b9-85e9-67215f2e5bec None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:20:31.320429 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 720/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Apr 7 06:20:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:20:31.325907 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad5a42-28aa-4cf0-892e-b26fe0b954c0 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:20:31.326376 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad5a42-28aa-4cf0-892e-b26fe0b954c0 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:20:31.326563 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad5a42-28aa-4cf0-892e-b26fe0b954c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:20:31.344478 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-bbad5a42-28aa-4cf0-892e-b26fe0b954c0 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:20:31.345659 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-bbad5a42-28aa-4cf0-892e-b26fe0b954c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:20:31.353907 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 725/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Apr 7 06:20:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:20:31.393246 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd0672-ec7c-41b9-85e9-67215f2e5bec None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:20:31.403826 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd0672-ec7c-41b9-85e9-67215f2e5bec None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:20:31.407293 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d26f3bb-381a-44b3-81a0-f46bd79156b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:20:31.407966 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26f3bb-381a-44b3-81a0-f46bd79156b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:20:31.408253 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26f3bb-381a-44b3-81a0-f46bd79156b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:20:31.408530 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26f3bb-381a-44b3-81a0-f46bd79156b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:20:31.417612 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d26f3bb-381a-44b3-81a0-f46bd79156b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:20:31.419031 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d26f3bb-381a-44b3-81a0-f46bd79156b2 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:20:31.428189 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 721/1446] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:20:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:20:34.068700 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b8147-3222-42bc-8a6c-8dcdc9ef2ef1 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:20:34.069247 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b8147-3222-42bc-8a6c-8dcdc9ef2ef1 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:20:34.069247 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b8147-3222-42bc-8a6c-8dcdc9ef2ef1 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:20:34.071930 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 726/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Apr 7 06:20:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:20:34.076986 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca970a5-4048-40ef-974e-5053df35e6c1 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:20:34.077421 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca970a5-4048-40ef-974e-5053df35e6c1 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:20:34.077549 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca970a5-4048-40ef-974e-5053df35e6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:20:34.097540 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-8ca970a5-4048-40ef-974e-5053df35e6c1 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:20:34.098730 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-8ca970a5-4048-40ef-974e-5053df35e6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:20:34.108688 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 722/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Apr 7 06:20:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:20:34.149095 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b8147-3222-42bc-8a6c-8dcdc9ef2ef1 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:20:34.159596 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b8147-3222-42bc-8a6c-8dcdc9ef2ef1 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:20:34.163096 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8227b603-18b9-4934-9bec-a0de45b58121 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:20:34.164257 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227b603-18b9-4934-9bec-a0de45b58121 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:20:34.164540 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227b603-18b9-4934-9bec-a0de45b58121 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:20:34.164814 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227b603-18b9-4934-9bec-a0de45b58121 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:20:34.173353 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8227b603-18b9-4934-9bec-a0de45b58121 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:20:34.174761 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8227b603-18b9-4934-9bec-a0de45b58121 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:20:34.184520 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 727/1449] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:20:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:20:36.572573 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433cb268-c4d9-45be-81a0-2e64e70a35ff None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:20:36.573184 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433cb268-c4d9-45be-81a0-2e64e70a35ff None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:20:36.573184 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433cb268-c4d9-45be-81a0-2e64e70a35ff None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:20:36.574564 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 723/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Apr 7 06:20:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:20:36.579977 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5828f-c8e3-4d21-952a-c4e4536e0f87 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:20:36.580400 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5828f-c8e3-4d21-952a-c4e4536e0f87 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:20:36.580565 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5828f-c8e3-4d21-952a-c4e4536e0f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:20:36.598321 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-b0c5828f-c8e3-4d21-952a-c4e4536e0f87 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:20:36.599489 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b0c5828f-c8e3-4d21-952a-c4e4536e0f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:20:36.607260 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 728/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Apr 7 06:20:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:20:36.646113 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433cb268-c4d9-45be-81a0-2e64e70a35ff None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:20:36.657119 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433cb268-c4d9-45be-81a0-2e64e70a35ff None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:20:36.660598 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ff5489-c193-4db9-8d2a-c463c4fe2fe7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:20:36.661233 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff5489-c193-4db9-8d2a-c463c4fe2fe7 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:20:36.661528 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff5489-c193-4db9-8d2a-c463c4fe2fe7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:20:36.661808 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff5489-c193-4db9-8d2a-c463c4fe2fe7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:20:36.670452 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ff5489-c193-4db9-8d2a-c463c4fe2fe7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:20:36.672041 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ff5489-c193-4db9-8d2a-c463c4fe2fe7 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:20:36.681110 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 724/1452] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:20:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:20:39.019499 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f362798-75a0-4c7a-bbe6-0abd11f84ddb None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:20:39.020082 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f362798-75a0-4c7a-bbe6-0abd11f84ddb None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:20:39.020082 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f362798-75a0-4c7a-bbe6-0abd11f84ddb None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:20:39.021537 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 729/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Apr 7 06:20:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:20:39.026676 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5e39a-407c-4eba-88ec-3abf22e6205c None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:20:39.027108 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5e39a-407c-4eba-88ec-3abf22e6205c None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:20:39.027230 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5e39a-407c-4eba-88ec-3abf22e6205c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:20:39.044562 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-2ad5e39a-407c-4eba-88ec-3abf22e6205c None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:20:39.045760 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-2ad5e39a-407c-4eba-88ec-3abf22e6205c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:20:39.053512 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 725/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Apr 7 06:20:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:20:39.092733 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f362798-75a0-4c7a-bbe6-0abd11f84ddb None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:20:39.103893 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f362798-75a0-4c7a-bbe6-0abd11f84ddb None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:20:39.107470 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc7ec05-ef27-401a-a895-ba655a0ec130 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:20:39.108130 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc7ec05-ef27-401a-a895-ba655a0ec130 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:20:39.108415 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc7ec05-ef27-401a-a895-ba655a0ec130 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:20:39.108687 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc7ec05-ef27-401a-a895-ba655a0ec130 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:20:39.117755 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc7ec05-ef27-401a-a895-ba655a0ec130 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:20:39.119163 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc7ec05-ef27-401a-a895-ba655a0ec130 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:20:39.128467 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 730/1455] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:20:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:20:41.542122 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9383809-84b2-462d-b7af-b2c5083c0a7a None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:20:41.542674 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9383809-84b2-462d-b7af-b2c5083c0a7a None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:20:41.542775 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9383809-84b2-462d-b7af-b2c5083c0a7a None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:20:41.544133 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 726/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Apr 7 06:20:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 07 06:20:41.549207 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0332db-5a99-48e8-a90b-ae0272915a5f None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:20:41.556139 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0332db-5a99-48e8-a90b-ae0272915a5f None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:20:41.556139 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0332db-5a99-48e8-a90b-ae0272915a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:20:41.571299 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-5e0332db-5a99-48e8-a90b-ae0272915a5f None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:20:41.572587 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-5e0332db-5a99-48e8-a90b-ae0272915a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:20:41.580529 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 731/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Apr 7 06:20:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:20:41.620554 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9383809-84b2-462d-b7af-b2c5083c0a7a None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:20:41.622320 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a9383809-84b2-462d-b7af-b2c5083c0a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:20:41.634913 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9383809-84b2-462d-b7af-b2c5083c0a7a None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:20:41.638316 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f780b8cc-824e-4c8a-973e-29815ddd053a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:20:41.638942 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780b8cc-824e-4c8a-973e-29815ddd053a service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:20:41.639224 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780b8cc-824e-4c8a-973e-29815ddd053a service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:20:41.639498 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780b8cc-824e-4c8a-973e-29815ddd053a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:20:41.648019 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f780b8cc-824e-4c8a-973e-29815ddd053a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:20:41.649427 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f780b8cc-824e-4c8a-973e-29815ddd053a service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:20:41.658445 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 727/1458] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:20:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:20:44.111462 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2be3e0-551c-45fe-9800-6f4e14e62a87 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:20:44.112047 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2be3e0-551c-45fe-9800-6f4e14e62a87 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:20:44.112047 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2be3e0-551c-45fe-9800-6f4e14e62a87 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:20:44.113431 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 732/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Apr 7 06:20:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:20:44.119481 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ce5cb-5bd6-4ff4-abcf-376031e78093 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:20:44.119954 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ce5cb-5bd6-4ff4-abcf-376031e78093 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:20:44.120056 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ce5cb-5bd6-4ff4-abcf-376031e78093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:20:44.137331 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-478ce5cb-5bd6-4ff4-abcf-376031e78093 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:20:44.138529 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-478ce5cb-5bd6-4ff4-abcf-376031e78093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:20:44.146154 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 728/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Apr 7 06:20:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:20:44.184662 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2be3e0-551c-45fe-9800-6f4e14e62a87 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:20:44.195051 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2be3e0-551c-45fe-9800-6f4e14e62a87 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:20:44.198487 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caccfeb-637a-4040-a7b8-1838faab1334 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:20:44.199114 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caccfeb-637a-4040-a7b8-1838faab1334 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:20:44.199399 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caccfeb-637a-4040-a7b8-1838faab1334 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:20:44.199674 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caccfeb-637a-4040-a7b8-1838faab1334 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:20:44.208224 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caccfeb-637a-4040-a7b8-1838faab1334 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:20:44.209636 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caccfeb-637a-4040-a7b8-1838faab1334 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:20:44.220360 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 733/1461] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:20:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:20:46.547362 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982fbd5-be2b-40cf-9464-82c3f633c6d2 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:20:46.547927 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982fbd5-be2b-40cf-9464-82c3f633c6d2 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:20:46.550729 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982fbd5-be2b-40cf-9464-82c3f633c6d2 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:20:46.550729 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 729/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Apr 7 06:20:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:20:46.555124 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a51182-7d18-4e25-886d-4eeb95cddf62 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:20:46.555574 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a51182-7d18-4e25-886d-4eeb95cddf62 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:20:46.555688 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a51182-7d18-4e25-886d-4eeb95cddf62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:20:46.573884 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-c7a51182-7d18-4e25-886d-4eeb95cddf62 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:20:46.575058 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c7a51182-7d18-4e25-886d-4eeb95cddf62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:20:46.582867 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 734/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Apr 7 06:20:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:20:46.621826 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982fbd5-be2b-40cf-9464-82c3f633c6d2 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:20:46.632416 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982fbd5-be2b-40cf-9464-82c3f633c6d2 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:20:46.635870 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f8608-4f85-4042-b31f-2111f67c3e35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:20:46.636502 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f8608-4f85-4042-b31f-2111f67c3e35 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:20:46.636782 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f8608-4f85-4042-b31f-2111f67c3e35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:20:46.637055 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f8608-4f85-4042-b31f-2111f67c3e35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:20:46.645537 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f8608-4f85-4042-b31f-2111f67c3e35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:20:46.646958 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f8608-4f85-4042-b31f-2111f67c3e35 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:20:46.656490 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 730/1464] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:20:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:20:48.935003 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27124ef-04e9-4668-8301-a621ad13629e None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:20:48.935565 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27124ef-04e9-4668-8301-a621ad13629e None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:20:48.935565 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27124ef-04e9-4668-8301-a621ad13629e None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:20:48.937005 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 735/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Apr 7 06:20:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:20:48.942046 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc60670-a5e6-4dd5-9b8b-9f4b7eb37bbf None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:20:48.942468 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc60670-a5e6-4dd5-9b8b-9f4b7eb37bbf None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:20:48.942596 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc60670-a5e6-4dd5-9b8b-9f4b7eb37bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:20:48.960382 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-fdc60670-a5e6-4dd5-9b8b-9f4b7eb37bbf None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:20:48.961554 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-fdc60670-a5e6-4dd5-9b8b-9f4b7eb37bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:20:48.969179 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 731/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Apr 7 06:20:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:20:49.007081 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27124ef-04e9-4668-8301-a621ad13629e None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:20:49.017441 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27124ef-04e9-4668-8301-a621ad13629e None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:20:49.020873 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44b8056-662c-4dab-a011-62b22dc2c2e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:20:49.021549 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b8056-662c-4dab-a011-62b22dc2c2e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:20:49.021800 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b8056-662c-4dab-a011-62b22dc2c2e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:20:49.022104 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b8056-662c-4dab-a011-62b22dc2c2e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:20:49.030621 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44b8056-662c-4dab-a011-62b22dc2c2e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:20:49.032081 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44b8056-662c-4dab-a011-62b22dc2c2e3 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:20:49.043191 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 736/1467] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:20:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:20:51.340343 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923dff7d-1530-48be-bba5-d1f797fe9853 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:20:51.340892 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923dff7d-1530-48be-bba5-d1f797fe9853 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:20:51.340892 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923dff7d-1530-48be-bba5-d1f797fe9853 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:20:51.342288 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 732/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Apr 7 06:20:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:20:51.347465 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96fac01-e6c3-4111-82ad-bbf7e7bad011 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:20:51.349270 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96fac01-e6c3-4111-82ad-bbf7e7bad011 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:20:51.349270 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96fac01-e6c3-4111-82ad-bbf7e7bad011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:20:51.365940 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-d96fac01-e6c3-4111-82ad-bbf7e7bad011 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:20:51.367124 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d96fac01-e6c3-4111-82ad-bbf7e7bad011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:20:51.374784 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 737/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Apr 7 06:20:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:20:51.412406 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923dff7d-1530-48be-bba5-d1f797fe9853 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:20:51.422869 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923dff7d-1530-48be-bba5-d1f797fe9853 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:20:51.426318 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b1741-721c-4894-976b-5080279d002e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:20:51.426955 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b1741-721c-4894-976b-5080279d002e service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:20:51.427243 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b1741-721c-4894-976b-5080279d002e service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:20:51.427522 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b1741-721c-4894-976b-5080279d002e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:20:51.436237 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3b1741-721c-4894-976b-5080279d002e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:20:51.437660 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3b1741-721c-4894-976b-5080279d002e service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:20:51.447308 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 733/1470] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:20:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:21:24.746582 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b45da6-6eea-4c15-b243-79682db002da None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:21:24.747173 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b45da6-6eea-4c15-b243-79682db002da None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:21:24.747173 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b45da6-6eea-4c15-b243-79682db002da None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:21:24.748462 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 738/1471] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:21:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:21:24.753747 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c797c88-db45-45ac-b194-7b48db95f686 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:21:24.754196 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c797c88-db45-45ac-b194-7b48db95f686 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:21:24.754309 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c797c88-db45-45ac-b194-7b48db95f686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:21:24.772522 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-5c797c88-db45-45ac-b194-7b48db95f686 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:21:24.773370 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-5c797c88-db45-45ac-b194-7b48db95f686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:21:24.781099 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 734/1472] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:21:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:21:24.827194 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df4910-4e21-4e3d-8689-05de536068fb None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:21:24.827485 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df4910-4e21-4e3d-8689-05de536068fb None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:21:24.827840 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df4910-4e21-4e3d-8689-05de536068fb None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:21:24.829216 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 739/1473] 10.222.0.24 () {54 vars in 961 bytes} [Thu Apr 7 06:21:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:21:24.834639 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb055c73-6549-4741-9d21-02eebf1da1c0 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:21:24.834932 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb055c73-6549-4741-9d21-02eebf1da1c0 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:21:24.835209 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb055c73-6549-4741-9d21-02eebf1da1c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:21:24.853269 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-cb055c73-6549-4741-9d21-02eebf1da1c0 None None] MFA Rules not processed for user `0ca88debdfcc4a9d918e3b0138a9add1`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:21:24.854447 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-cb055c73-6549-4741-9d21-02eebf1da1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:21:24.860754 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 735/1474] 10.222.0.24 () {58 vars in 1058 bytes} [Thu Apr 7 06:21:24 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:21:24.868217 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df4910-4e21-4e3d-8689-05de536068fb None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:21:24.878466 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df4910-4e21-4e3d-8689-05de536068fb None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:21:24.881872 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a53e6-2ad3-428c-80d7-c93c93477443 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca88debdfcc4a9d918e3b0138a9add1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:21:24.882489 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a53e6-2ad3-428c-80d7-c93c93477443 service glance] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:21:24.882771 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a53e6-2ad3-428c-80d7-c93c93477443 service glance] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:21:24.883045 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a53e6-2ad3-428c-80d7-c93c93477443 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:21:24.891536 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997a53e6-2ad3-428c-80d7-c93c93477443 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:21:24.892963 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997a53e6-2ad3-428c-80d7-c93c93477443 service glance] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:21:24.902524 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 740/1475] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:21:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:21:27.246541 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694008d8-cebc-40f5-9c56-913d20ebc15a None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:21:27.247030 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694008d8-cebc-40f5-9c56-913d20ebc15a None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:21:27.247126 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694008d8-cebc-40f5-9c56-913d20ebc15a None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:21:27.248488 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 736/1476] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:21:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:21:27.253663 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b9d31-9186-412d-a9fc-ac66817e2f32 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:21:27.254084 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b9d31-9186-412d-a9fc-ac66817e2f32 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:21:27.254260 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b9d31-9186-412d-a9fc-ac66817e2f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:21:27.272707 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-9c2b9d31-9186-412d-a9fc-ac66817e2f32 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:21:27.273900 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-9c2b9d31-9186-412d-a9fc-ac66817e2f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:21:27.281737 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 741/1477] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:21:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:21:27.305494 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694008d8-cebc-40f5-9c56-913d20ebc15a None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:21:27.318022 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694008d8-cebc-40f5-9c56-913d20ebc15a None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:21:27.322372 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de574e-876d-4595-8909-437c5037d1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:21:27.323000 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de574e-876d-4595-8909-437c5037d1a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:21:27.323284 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de574e-876d-4595-8909-437c5037d1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:21:27.323558 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de574e-876d-4595-8909-437c5037d1a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:21:27.324324 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6de574e-876d-4595-8909-437c5037d1a8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:21:27.326001 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING py.warnings [None req-d6de574e-876d-4595-8909-437c5037d1a8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 07 06:21:27.326001 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: warnings.warn(msg) Apr 07 06:21:27.326001 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: Apr 07 06:21:27.327125 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6de574e-876d-4595-8909-437c5037d1a8 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:21:27.346037 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 737/1478] 10.222.0.24 () {56 vars in 1108 bytes} [Thu Apr 7 06:21:27 2022] GET /identity/v3/projects => generated 2553 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:21:29.654960 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e09824-d371-4121-8908-69693453b363 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:21:29.655538 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e09824-d371-4121-8908-69693453b363 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:21:29.655538 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e09824-d371-4121-8908-69693453b363 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:21:29.656927 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 742/1479] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:21:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:21:29.663210 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abb57c-8b84-41d0-be3f-163d6773afce None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:21:29.663672 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abb57c-8b84-41d0-be3f-163d6773afce None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:21:29.663822 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abb57c-8b84-41d0-be3f-163d6773afce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:21:29.681731 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-b2abb57c-8b84-41d0-be3f-163d6773afce None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:21:29.682926 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b2abb57c-8b84-41d0-be3f-163d6773afce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:21:29.691164 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 738/1480] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:21:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:21:29.732904 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e09824-d371-4121-8908-69693453b363 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:21:29.748067 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e09824-d371-4121-8908-69693453b363 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:21:29.753450 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c5c0b8-86aa-42c3-9b2a-cec3f36a5b25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cd81f6620f410db450871fb29961f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:21:29.754084 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5c0b8-86aa-42c3-9b2a-cec3f36a5b25 service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:21:29.754376 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5c0b8-86aa-42c3-9b2a-cec3f36a5b25 service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:21:29.754657 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5c0b8-86aa-42c3-9b2a-cec3f36a5b25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:21:29.762758 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c5c0b8-86aa-42c3-9b2a-cec3f36a5b25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:21:29.764405 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c5c0b8-86aa-42c3-9b2a-cec3f36a5b25 service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:21:29.774138 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 743/1481] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:21:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 07 06:21:32.235486 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c633a-0bb8-4926-801f-cda9537f3542 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:21:32.236244 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c633a-0bb8-4926-801f-cda9537f3542 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:21:32.236244 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c633a-0bb8-4926-801f-cda9537f3542 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:21:32.237447 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 739/1482] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:21:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:21:32.243496 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed3d13-cbf5-4a38-a5ca-9cb9862c40f5 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:21:32.243976 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed3d13-cbf5-4a38-a5ca-9cb9862c40f5 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:21:32.244083 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed3d13-cbf5-4a38-a5ca-9cb9862c40f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:21:32.261824 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-22ed3d13-cbf5-4a38-a5ca-9cb9862c40f5 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:21:32.265218 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-22ed3d13-cbf5-4a38-a5ca-9cb9862c40f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:21:32.270643 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 744/1483] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:21:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:21:32.306581 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c633a-0bb8-4926-801f-cda9537f3542 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:21:32.316907 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c633a-0bb8-4926-801f-cda9537f3542 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:21:32.320457 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aeb563-42f5-49ae-82e9-707743d8fc5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:21:32.321087 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aeb563-42f5-49ae-82e9-707743d8fc5e service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:21:32.321371 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aeb563-42f5-49ae-82e9-707743d8fc5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:21:32.321645 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aeb563-42f5-49ae-82e9-707743d8fc5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:21:32.330634 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aeb563-42f5-49ae-82e9-707743d8fc5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:21:32.332095 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aeb563-42f5-49ae-82e9-707743d8fc5e service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:21:32.341843 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 740/1484] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:21:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:21:34.664737 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438aa5d-9a54-4dda-87a2-8b0314c655ed None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:21:34.665309 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438aa5d-9a54-4dda-87a2-8b0314c655ed None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:21:34.665309 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438aa5d-9a54-4dda-87a2-8b0314c655ed None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:21:34.666666 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 745/1485] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:21:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:21:34.672032 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a4bb3-037b-4cf6-a872-0d21e68d182c None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:21:34.672405 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a4bb3-037b-4cf6-a872-0d21e68d182c None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:21:34.672585 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a4bb3-037b-4cf6-a872-0d21e68d182c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:21:34.690312 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-2c3a4bb3-037b-4cf6-a872-0d21e68d182c None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:21:34.691495 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-2c3a4bb3-037b-4cf6-a872-0d21e68d182c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:21:34.699902 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 741/1486] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:21:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:21:34.736665 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8438aa5d-9a54-4dda-87a2-8b0314c655ed None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:21:34.749441 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8438aa5d-9a54-4dda-87a2-8b0314c655ed None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:21:34.752882 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f258f52-7990-49c6-915a-a3fccd840e56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:21:34.753511 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f258f52-7990-49c6-915a-a3fccd840e56 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:21:34.753792 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f258f52-7990-49c6-915a-a3fccd840e56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:21:34.754067 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f258f52-7990-49c6-915a-a3fccd840e56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:21:34.762868 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f258f52-7990-49c6-915a-a3fccd840e56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:21:34.764317 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f258f52-7990-49c6-915a-a3fccd840e56 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:21:34.774399 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 746/1487] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:21:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:21:37.151087 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d897f7-1dd5-4f19-a470-6b955559ca80 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:21:37.151698 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d897f7-1dd5-4f19-a470-6b955559ca80 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:21:37.151698 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d897f7-1dd5-4f19-a470-6b955559ca80 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:21:37.153048 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 742/1488] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:21:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:21:37.158251 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4831d7-f2ab-4c3c-ae72-ac7e077bf1c3 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:21:37.158661 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4831d7-f2ab-4c3c-ae72-ac7e077bf1c3 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:21:37.158800 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4831d7-f2ab-4c3c-ae72-ac7e077bf1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:21:37.177173 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-1f4831d7-f2ab-4c3c-ae72-ac7e077bf1c3 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:21:37.178337 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-1f4831d7-f2ab-4c3c-ae72-ac7e077bf1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:21:37.186820 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 747/1489] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:21:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:21:37.226064 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d897f7-1dd5-4f19-a470-6b955559ca80 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:21:37.236618 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d897f7-1dd5-4f19-a470-6b955559ca80 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:21:37.240942 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b839ec0-3128-44e1-9920-04a321a893d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:21:37.241567 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b839ec0-3128-44e1-9920-04a321a893d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:21:37.241849 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b839ec0-3128-44e1-9920-04a321a893d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:21:37.242121 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b839ec0-3128-44e1-9920-04a321a893d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:21:37.250586 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b839ec0-3128-44e1-9920-04a321a893d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:21:37.252044 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b839ec0-3128-44e1-9920-04a321a893d0 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:21:37.261981 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 743/1490] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:21:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:21:39.877823 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc22e0-a86e-4e49-95ba-89b36564e7ce None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:21:39.878382 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc22e0-a86e-4e49-95ba-89b36564e7ce None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:21:39.878854 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc22e0-a86e-4e49-95ba-89b36564e7ce None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:21:39.880906 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 748/1491] 10.222.0.24 () {54 vars in 926 bytes} [Thu Apr 7 06:21:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 07 06:21:39.886403 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82856b30-bc39-4c5f-a8fa-a53d91bcbed8 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:21:39.886843 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82856b30-bc39-4c5f-a8fa-a53d91bcbed8 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:21:39.886977 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82856b30-bc39-4c5f-a8fa-a53d91bcbed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:21:39.904452 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-82856b30-bc39-4c5f-a8fa-a53d91bcbed8 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:21:39.905621 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-82856b30-bc39-4c5f-a8fa-a53d91bcbed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:21:39.913891 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 744/1492] 10.222.0.24 () {58 vars in 1023 bytes} [Thu Apr 7 06:21:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:21:39.951866 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbc22e0-a86e-4e49-95ba-89b36564e7ce None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:21:39.963110 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbc22e0-a86e-4e49-95ba-89b36564e7ce None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:21:39.966655 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d32980-9998-40da-9223-978b9edb6b43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:21:39.967294 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d32980-9998-40da-9223-978b9edb6b43 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:21:39.967582 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d32980-9998-40da-9223-978b9edb6b43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:21:39.968021 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d32980-9998-40da-9223-978b9edb6b43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:21:39.977347 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d32980-9998-40da-9223-978b9edb6b43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:21:39.978790 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d32980-9998-40da-9223-978b9edb6b43 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:21:39.987945 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 749/1493] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:21:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:23:48.071079 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280224fe-32ad-45f7-83ff-fdae8bc89e61 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:23:48.071648 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280224fe-32ad-45f7-83ff-fdae8bc89e61 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:23:48.071648 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280224fe-32ad-45f7-83ff-fdae8bc89e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:23:48.089782 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-280224fe-32ad-45f7-83ff-fdae8bc89e61 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:23:48.090978 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-280224fe-32ad-45f7-83ff-fdae8bc89e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:23:48.099042 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 745/1494] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:23:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:23:48.107208 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca5d8b-c865-497e-b978-9e19be9d66f3 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:23:48.107703 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca5d8b-c865-497e-b978-9e19be9d66f3 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:23:48.107846 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca5d8b-c865-497e-b978-9e19be9d66f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:23:48.125358 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-24ca5d8b-c865-497e-b978-9e19be9d66f3 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:23:48.132687 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-24ca5d8b-c865-497e-b978-9e19be9d66f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:23:48.134762 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 750/1495] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:23:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:23:48.139421 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280224fe-32ad-45f7-83ff-fdae8bc89e61 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:23:48.149511 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280224fe-32ad-45f7-83ff-fdae8bc89e61 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:23:48.153949 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c643299-1a0a-4550-ac90-403001971066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:23:48.154666 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c643299-1a0a-4550-ac90-403001971066 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:23:48.154946 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c643299-1a0a-4550-ac90-403001971066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:23:48.155219 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c643299-1a0a-4550-ac90-403001971066 admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:23:48.155994 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c643299-1a0a-4550-ac90-403001971066 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:23:48.156300 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c643299-1a0a-4550-ac90-403001971066 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:23:48.157310 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING py.warnings [None req-7c643299-1a0a-4550-ac90-403001971066 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 07 06:23:48.157310 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: warnings.warn(msg) Apr 07 06:23:48.157310 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: Apr 07 06:23:48.158181 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c643299-1a0a-4550-ac90-403001971066 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:23:48.169498 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 746/1496] 10.222.0.24 () {58 vars in 1152 bytes} [Thu Apr 7 06:23:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:23:48.177611 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ca5d8b-c865-497e-b978-9e19be9d66f3 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:23:48.186593 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ca5d8b-c865-497e-b978-9e19be9d66f3 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:23:48.191062 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85eef3d-7589-4344-97dd-20dd35cae0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:23:48.194070 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85eef3d-7589-4344-97dd-20dd35cae0a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:23:48.194070 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85eef3d-7589-4344-97dd-20dd35cae0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:23:48.194070 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85eef3d-7589-4344-97dd-20dd35cae0a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:23:48.194070 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85eef3d-7589-4344-97dd-20dd35cae0a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:23:48.195155 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING py.warnings [None req-e85eef3d-7589-4344-97dd-20dd35cae0a6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 07 06:23:48.195155 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: warnings.warn(msg) Apr 07 06:23:48.195155 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: Apr 07 06:23:48.196386 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85eef3d-7589-4344-97dd-20dd35cae0a6 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:23:48.291635 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 751/1497] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:23:48 2022] POST /identity/v3/projects => generated 379 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:23:48.293121 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c643299-1a0a-4550-ac90-403001971066 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:23:48.303483 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c643299-1a0a-4550-ac90-403001971066 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:23:48.356477 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73dd31d-7f39-4bfa-98e5-f029e2175670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:23:48.357115 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73dd31d-7f39-4bfa-98e5-f029e2175670 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:23:48.357445 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73dd31d-7f39-4bfa-98e5-f029e2175670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:23:48.357726 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73dd31d-7f39-4bfa-98e5-f029e2175670 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:23:48.358446 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73dd31d-7f39-4bfa-98e5-f029e2175670 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:23:48.359459 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING py.warnings [None req-c73dd31d-7f39-4bfa-98e5-f029e2175670 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 07 06:23:48.359459 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: warnings.warn(msg) Apr 07 06:23:48.359459 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: Apr 07 06:23:48.360699 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73dd31d-7f39-4bfa-98e5-f029e2175670 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:23:48.441356 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 747/1498] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:23:48 2022] POST /identity/v3/users => generated 290 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:23:48.446022 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85eef3d-7589-4344-97dd-20dd35cae0a6 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:23:48.456093 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85eef3d-7589-4344-97dd-20dd35cae0a6 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:23:48.460696 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfdc23b-9cff-444f-af77-970209582a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:23:48.461352 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfdc23b-9cff-444f-af77-970209582a4e admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:23:48.461637 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfdc23b-9cff-444f-af77-970209582a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:23:48.461911 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfdc23b-9cff-444f-af77-970209582a4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:23:48.462633 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfdc23b-9cff-444f-af77-970209582a4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:23:48.463666 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING py.warnings [None req-0dfdc23b-9cff-444f-af77-970209582a4e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 07 06:23:48.463666 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: warnings.warn(msg) Apr 07 06:23:48.463666 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: Apr 07 06:23:48.464581 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfdc23b-9cff-444f-af77-970209582a4e admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:23:48.476891 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 752/1499] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:23:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:23:48.480784 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73dd31d-7f39-4bfa-98e5-f029e2175670 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:23:48.491076 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73dd31d-7f39-4bfa-98e5-f029e2175670 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:23:48.495545 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac689641-634b-4bcc-b7a1-2fa200d599f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:23:48.496225 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac689641-634b-4bcc-b7a1-2fa200d599f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:23:48.496508 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac689641-634b-4bcc-b7a1-2fa200d599f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:23:48.496781 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac689641-634b-4bcc-b7a1-2fa200d599f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:23:48.497518 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac689641-634b-4bcc-b7a1-2fa200d599f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:23:48.498519 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING py.warnings [None req-ac689641-634b-4bcc-b7a1-2fa200d599f3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 07 06:23:48.498519 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: warnings.warn(msg) Apr 07 06:23:48.498519 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: Apr 07 06:23:48.499384 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac689641-634b-4bcc-b7a1-2fa200d599f3 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:23:48.514955 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 748/1500] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:23:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:23:48.518934 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfdc23b-9cff-444f-af77-970209582a4e admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:23:48.528563 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfdc23b-9cff-444f-af77-970209582a4e admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:23:48.532920 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c262e8-27a2-40dd-b7b2-f0b805d3a63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:23:48.533785 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c262e8-27a2-40dd-b7b2-f0b805d3a63d admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:23:48.534069 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c262e8-27a2-40dd-b7b2-f0b805d3a63d admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:23:48.534343 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c262e8-27a2-40dd-b7b2-f0b805d3a63d admin admin] PATH_INFO: `/v3/projects/47e0bdc6d42547f483fd71ac8662666b/users/c01fa70873e04e438d22216bf8be270b/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:23:48.548268 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c262e8-27a2-40dd-b7b2-f0b805d3a63d admin admin] RBAC: Authorizing `identity:create_grant(project_id=47e0bdc6d42547f483fd71ac8662666b, user_id=c01fa70873e04e438d22216bf8be270b, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:23:48.549282 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING py.warnings [None req-f7c262e8-27a2-40dd-b7b2-f0b805d3a63d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 07 06:23:48.549282 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: warnings.warn(msg) Apr 07 06:23:48.549282 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: Apr 07 06:23:48.551699 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c262e8-27a2-40dd-b7b2-f0b805d3a63d admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:23:48.636587 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 753/1501] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:23:48 2022] PUT /identity/v3/projects/47e0bdc6d42547f483fd71ac8662666b/users/c01fa70873e04e438d22216bf8be270b/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:23:48.647739 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c6f80-47af-4145-95fa-ab0b474f03d4 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:23:48.648055 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c6f80-47af-4145-95fa-ab0b474f03d4 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:23:48.648335 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c6f80-47af-4145-95fa-ab0b474f03d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:23:48.673781 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-ba2c6f80-47af-4145-95fa-ab0b474f03d4 None None] MFA Rules not processed for user `c01fa70873e04e438d22216bf8be270b`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:23:48.675067 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-ba2c6f80-47af-4145-95fa-ab0b474f03d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:23:48.735684 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 749/1502] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:23:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:23:48.748108 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c262e8-27a2-40dd-b7b2-f0b805d3a63d admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:23:48.815824 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c262e8-27a2-40dd-b7b2-f0b805d3a63d admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:23:48.821247 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9917c452-c56d-4b33-89af-f4ab4ac582c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cd81f6620f410db450871fb29961f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:23:48.821923 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9917c452-c56d-4b33-89af-f4ab4ac582c2 service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:23:48.822207 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9917c452-c56d-4b33-89af-f4ab4ac582c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:23:48.822491 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9917c452-c56d-4b33-89af-f4ab4ac582c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:23:48.829989 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9917c452-c56d-4b33-89af-f4ab4ac582c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:23:48.831551 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9917c452-c56d-4b33-89af-f4ab4ac582c2 service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:23:48.840277 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 754/1503] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:23:48 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:23:48.911279 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3ba8b-2f23-483e-bab8-8b19bb90ec17 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:23:48.911572 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3ba8b-2f23-483e-bab8-8b19bb90ec17 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:23:48.911891 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3ba8b-2f23-483e-bab8-8b19bb90ec17 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:23:48.913217 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 750/1504] 10.222.0.24 () {52 vars in 829 bytes} [Thu Apr 7 06:23:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:23:48.916935 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9917c452-c56d-4b33-89af-f4ab4ac582c2 service nova] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:23:48.975715 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9917c452-c56d-4b33-89af-f4ab4ac582c2 service nova] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:23:48.980288 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b81b5-4734-41c3-ad58-82093b08322c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:23:48.981197 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b81b5-4734-41c3-ad58-82093b08322c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:23:48.981546 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b81b5-4734-41c3-ad58-82093b08322c admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:23:48.981825 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b81b5-4734-41c3-ad58-82093b08322c admin admin] PATH_INFO: `/v3/users/c01fa70873e04e438d22216bf8be270b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:23:48.982982 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b81b5-4734-41c3-ad58-82093b08322c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c01fa70873e04e438d22216bf8be270b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:23:48.984044 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING py.warnings [None req-499b81b5-4734-41c3-ad58-82093b08322c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 07 06:23:48.984044 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: warnings.warn(msg) Apr 07 06:23:48.984044 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: Apr 07 06:23:48.985236 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b81b5-4734-41c3-ad58-82093b08322c admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:23:49.191117 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-499b81b5-4734-41c3-ad58-82093b08322c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c01fa70873e04e438d22216bf8be270b'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:23:49.215386 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-499b81b5-4734-41c3-ad58-82093b08322c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c01fa70873e04e438d22216bf8be270b'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:23:49.293228 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-499b81b5-4734-41c3-ad58-82093b08322c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c01fa70873e04e438d22216bf8be270b'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:23:49.293946 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-499b81b5-4734-41c3-ad58-82093b08322c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c01fa70873e04e438d22216bf8be270b'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:23:49.294565 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-499b81b5-4734-41c3-ad58-82093b08322c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c01fa70873e04e438d22216bf8be270b'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:23:49.314010 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 755/1505] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:23:48 2022] DELETE /identity/v3/users/c01fa70873e04e438d22216bf8be270b => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:23:49.318448 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9d189-127c-4d57-b589-0af54397d56a None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:23:49.318907 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9d189-127c-4d57-b589-0af54397d56a None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:23:49.319012 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9d189-127c-4d57-b589-0af54397d56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:23:49.336340 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-4af9d189-127c-4d57-b589-0af54397d56a None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:23:49.337521 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-4af9d189-127c-4d57-b589-0af54397d56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:23:49.393542 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 751/1506] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:23:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:23:49.403789 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b81b5-4734-41c3-ad58-82093b08322c admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:23:49.405202 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-499b81b5-4734-41c3-ad58-82093b08322c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:23:49.459259 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b81b5-4734-41c3-ad58-82093b08322c admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:23:49.462693 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7cf06f-2c9f-424a-8c1f-e7e95e3c04a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:23:49.463355 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7cf06f-2c9f-424a-8c1f-e7e95e3c04a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:23:49.463640 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7cf06f-2c9f-424a-8c1f-e7e95e3c04a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:23:49.463942 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7cf06f-2c9f-424a-8c1f-e7e95e3c04a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:23:49.472584 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7cf06f-2c9f-424a-8c1f-e7e95e3c04a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:23:49.474025 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7cf06f-2c9f-424a-8c1f-e7e95e3c04a2 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:23:49.483161 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 756/1507] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:23:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:23:49.957490 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af9d189-127c-4d57-b589-0af54397d56a None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:23:49.959416 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-4af9d189-127c-4d57-b589-0af54397d56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:23:49.971593 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af9d189-127c-4d57-b589-0af54397d56a None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:23:49.976319 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0febf49-cfb3-44d2-8924-a4ff1ef3efc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:23:49.977181 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0febf49-cfb3-44d2-8924-a4ff1ef3efc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:23:49.980088 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0febf49-cfb3-44d2-8924-a4ff1ef3efc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:23:49.980088 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0febf49-cfb3-44d2-8924-a4ff1ef3efc1 admin admin] PATH_INFO: `/v3/projects/47e0bdc6d42547f483fd71ac8662666b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:23:49.980088 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0febf49-cfb3-44d2-8924-a4ff1ef3efc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47e0bdc6d42547f483fd71ac8662666b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:23:49.980088 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING py.warnings [None req-e0febf49-cfb3-44d2-8924-a4ff1ef3efc1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 07 06:23:49.980088 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: warnings.warn(msg) Apr 07 06:23:49.980088 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: Apr 07 06:23:49.981237 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0febf49-cfb3-44d2-8924-a4ff1ef3efc1 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:23:50.139652 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-e0febf49-cfb3-44d2-8924-a4ff1ef3efc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47e0bdc6d42547f483fd71ac8662666b', 'request_id': 'req-e0febf49-cfb3-44d2-8924-a4ff1ef3efc1'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:23:50.145444 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-e0febf49-cfb3-44d2-8924-a4ff1ef3efc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47e0bdc6d42547f483fd71ac8662666b', 'request_id': 'req-e0febf49-cfb3-44d2-8924-a4ff1ef3efc1'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:23:50.567650 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-e0febf49-cfb3-44d2-8924-a4ff1ef3efc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47e0bdc6d42547f483fd71ac8662666b', 'request_id': 'req-e0febf49-cfb3-44d2-8924-a4ff1ef3efc1'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:23:50.586499 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-e0febf49-cfb3-44d2-8924-a4ff1ef3efc1 admin admin] The token cache is being invalidate because project 47e0bdc6d42547f483fd71ac8662666b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:23:50.586782 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-e0febf49-cfb3-44d2-8924-a4ff1ef3efc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:23:50.587408 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-e0febf49-cfb3-44d2-8924-a4ff1ef3efc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:23:50.589097 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 752/1508] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:23:49 2022] DELETE /identity/v3/projects/47e0bdc6d42547f483fd71ac8662666b => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:25:30.955087 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbee57-8ad6-40ff-9637-01709f0dbb65 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:25:30.955668 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbee57-8ad6-40ff-9637-01709f0dbb65 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:25:30.955668 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbee57-8ad6-40ff-9637-01709f0dbb65 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:25:30.957115 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 757/1509] 127.0.0.1 () {54 vars in 901 bytes} [Thu Apr 7 06:25:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:25:30.961888 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d86307-3576-45fd-bf6c-299d58ce4028 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:25:30.962335 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d86307-3576-45fd-bf6c-299d58ce4028 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:25:30.962447 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d86307-3576-45fd-bf6c-299d58ce4028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:25:30.980218 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-a5d86307-3576-45fd-bf6c-299d58ce4028 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:25:30.981398 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a5d86307-3576-45fd-bf6c-299d58ce4028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:25:31.037380 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 753/1510] 127.0.0.1 () {58 vars in 998 bytes} [Thu Apr 7 06:25:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:25:31.190800 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cbee57-8ad6-40ff-9637-01709f0dbb65 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:25:31.192512 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-63cbee57-8ad6-40ff-9637-01709f0dbb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:25:31.263192 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cbee57-8ad6-40ff-9637-01709f0dbb65 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:25:31.268836 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442dbaaa-6e74-4037-8373-f3ab97765466 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cd81f6620f410db450871fb29961f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:25:31.269530 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442dbaaa-6e74-4037-8373-f3ab97765466 service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:25:31.269817 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442dbaaa-6e74-4037-8373-f3ab97765466 service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:25:31.270094 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442dbaaa-6e74-4037-8373-f3ab97765466 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:25:31.278436 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442dbaaa-6e74-4037-8373-f3ab97765466 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:25:31.284033 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442dbaaa-6e74-4037-8373-f3ab97765466 service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:25:31.289265 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 758/1511] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:25:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:25:31.858034 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41898a9-8e5e-4887-8bf7-10fceceb9ca7 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:25:31.858239 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41898a9-8e5e-4887-8bf7-10fceceb9ca7 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:25:31.858507 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41898a9-8e5e-4887-8bf7-10fceceb9ca7 None None] PATH_INFO: `/v3` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:25:31.859834 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 754/1512] 10.222.0.25 () {54 vars in 925 bytes} [Thu Apr 7 06:25:31 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:25:31.866642 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e742dd-f351-473c-9f8e-4dbc528e62ed None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:25:31.867038 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e742dd-f351-473c-9f8e-4dbc528e62ed None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:25:31.867381 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e742dd-f351-473c-9f8e-4dbc528e62ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:25:31.885008 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-66e742dd-f351-473c-9f8e-4dbc528e62ed None None] MFA Rules not processed for user `ff35b68665724754a6413bca0030016f`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:25:31.886265 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-66e742dd-f351-473c-9f8e-4dbc528e62ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:25:31.946111 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 759/1513] 10.222.0.25 () {58 vars in 1015 bytes} [Thu Apr 7 06:25:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:25:32.562628 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea74777-877c-40f7-b668-e4e56a66449c None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:25:32.563191 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea74777-877c-40f7-b668-e4e56a66449c None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:25:32.563191 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea74777-877c-40f7-b668-e4e56a66449c None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:25:32.565185 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 755/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Apr 7 06:25:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:25:32.569976 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd344f3-d371-426c-a29b-1669dd25eea5 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:25:32.570353 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd344f3-d371-426c-a29b-1669dd25eea5 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:25:32.570547 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd344f3-d371-426c-a29b-1669dd25eea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:25:32.592247 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-ffd344f3-d371-426c-a29b-1669dd25eea5 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:25:32.593433 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-ffd344f3-d371-426c-a29b-1669dd25eea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:25:32.601113 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 760/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Apr 7 06:25:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:25:32.752606 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea74777-877c-40f7-b668-e4e56a66449c None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:25:32.766713 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea74777-877c-40f7-b668-e4e56a66449c None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:25:32.772115 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b8a88-2643-44fc-81ab-1f6757220b5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cd81f6620f410db450871fb29961f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:25:32.772753 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b8a88-2643-44fc-81ab-1f6757220b5e service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:25:32.773068 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b8a88-2643-44fc-81ab-1f6757220b5e service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:25:32.773347 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b8a88-2643-44fc-81ab-1f6757220b5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:25:32.781509 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2b8a88-2643-44fc-81ab-1f6757220b5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:25:32.783145 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2b8a88-2643-44fc-81ab-1f6757220b5e service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:25:32.792284 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 756/1516] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:25:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:25:36.235997 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15549478-d3d0-47bd-8976-4adecf5a2fdb None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:25:36.236559 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15549478-d3d0-47bd-8976-4adecf5a2fdb None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:25:36.236559 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15549478-d3d0-47bd-8976-4adecf5a2fdb None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:25:36.238296 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 761/1517] 10.222.0.24 () {54 vars in 960 bytes} [Thu Apr 7 06:25:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:25:36.243582 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926deee-3df2-4c9a-be34-8d8bd39212da None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:25:36.244041 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926deee-3df2-4c9a-be34-8d8bd39212da None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:25:36.244177 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926deee-3df2-4c9a-be34-8d8bd39212da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:25:36.261868 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-c926deee-3df2-4c9a-be34-8d8bd39212da None None] MFA Rules not processed for user `ff35b68665724754a6413bca0030016f`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:25:36.263041 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-c926deee-3df2-4c9a-be34-8d8bd39212da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:25:36.271714 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 757/1518] 10.222.0.24 () {58 vars in 1057 bytes} [Thu Apr 7 06:25:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:25:36.278894 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15549478-d3d0-47bd-8976-4adecf5a2fdb None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:25:36.292401 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15549478-d3d0-47bd-8976-4adecf5a2fdb None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:25:36.297220 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9b9a11-70f1-4b2f-9a7a-10b9ed318645 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff35b68665724754a6413bca0030016f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:25:36.297841 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b9a11-70f1-4b2f-9a7a-10b9ed318645 service placement] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:25:36.298123 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b9a11-70f1-4b2f-9a7a-10b9ed318645 service placement] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:25:36.298396 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b9a11-70f1-4b2f-9a7a-10b9ed318645 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:25:36.306468 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9b9a11-70f1-4b2f-9a7a-10b9ed318645 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:25:36.308083 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9b9a11-70f1-4b2f-9a7a-10b9ed318645 service placement] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:25:36.317267 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 762/1519] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:25:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:25:44.478415 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916a40f-8fec-4ab4-8c39-5255d7831fef None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:25:44.479016 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916a40f-8fec-4ab4-8c39-5255d7831fef None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:25:44.479016 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916a40f-8fec-4ab4-8c39-5255d7831fef None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:25:44.480378 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 758/1520] 127.0.0.1 () {54 vars in 901 bytes} [Thu Apr 7 06:25:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:25:44.485318 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca4c2b-8a9d-4a82-b24c-8381136a3860 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:25:44.485763 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca4c2b-8a9d-4a82-b24c-8381136a3860 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:25:44.485872 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca4c2b-8a9d-4a82-b24c-8381136a3860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:25:44.503416 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-0cca4c2b-8a9d-4a82-b24c-8381136a3860 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:25:44.504619 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-0cca4c2b-8a9d-4a82-b24c-8381136a3860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:25:44.512221 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 763/1521] 127.0.0.1 () {58 vars in 998 bytes} [Thu Apr 7 06:25:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:25:44.665349 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916a40f-8fec-4ab4-8c39-5255d7831fef None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:25:44.679235 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916a40f-8fec-4ab4-8c39-5255d7831fef None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:25:44.684527 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca82140-e6cf-47ee-b733-abb0538177b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cd81f6620f410db450871fb29961f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:25:44.685157 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca82140-e6cf-47ee-b733-abb0538177b7 service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:25:44.685447 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca82140-e6cf-47ee-b733-abb0538177b7 service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:25:44.685724 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca82140-e6cf-47ee-b733-abb0538177b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:25:44.693518 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca82140-e6cf-47ee-b733-abb0538177b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:25:44.695102 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca82140-e6cf-47ee-b733-abb0538177b7 service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:25:44.704638 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 759/1522] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:25:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:25:45.982425 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef2566-5c50-4f28-9b8d-9d4d49872a43 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:25:45.982990 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef2566-5c50-4f28-9b8d-9d4d49872a43 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:25:45.982990 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef2566-5c50-4f28-9b8d-9d4d49872a43 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:25:45.984395 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 764/1523] 127.0.0.1 () {54 vars in 901 bytes} [Thu Apr 7 06:25:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:25:45.989483 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf18b5-4259-4322-b271-297a1ce298ab None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:25:45.989894 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf18b5-4259-4322-b271-297a1ce298ab None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:25:45.990049 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf18b5-4259-4322-b271-297a1ce298ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:25:46.007359 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-25bf18b5-4259-4322-b271-297a1ce298ab None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:25:46.008578 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-25bf18b5-4259-4322-b271-297a1ce298ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:25:46.016808 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 760/1524] 127.0.0.1 () {58 vars in 998 bytes} [Thu Apr 7 06:25:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:25:46.167279 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ef2566-5c50-4f28-9b8d-9d4d49872a43 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:25:46.181910 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ef2566-5c50-4f28-9b8d-9d4d49872a43 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:25:46.187180 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f706c9-35ca-4c4e-8908-d85f44eec69a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cd81f6620f410db450871fb29961f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:25:46.187850 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f706c9-35ca-4c4e-8908-d85f44eec69a service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:25:46.188165 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f706c9-35ca-4c4e-8908-d85f44eec69a service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:25:46.188442 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f706c9-35ca-4c4e-8908-d85f44eec69a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:25:46.196243 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f706c9-35ca-4c4e-8908-d85f44eec69a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:25:46.197806 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f706c9-35ca-4c4e-8908-d85f44eec69a service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:25:46.207462 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 765/1525] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:25:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:25:50.350370 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70105c-37fc-423b-bb3c-2952817a764c None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:25:50.350960 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70105c-37fc-423b-bb3c-2952817a764c None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:25:50.350960 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70105c-37fc-423b-bb3c-2952817a764c None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:25:50.352303 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 761/1526] 127.0.0.1 () {54 vars in 916 bytes} [Thu Apr 7 06:25:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:25:50.357388 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea502fb-714e-443d-a31e-4de1b7524bc8 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:25:50.357803 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea502fb-714e-443d-a31e-4de1b7524bc8 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:25:50.357956 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea502fb-714e-443d-a31e-4de1b7524bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:25:50.376261 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-eea502fb-714e-443d-a31e-4de1b7524bc8 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:25:50.377436 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-eea502fb-714e-443d-a31e-4de1b7524bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:25:50.385135 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 766/1527] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Apr 7 06:25:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:25:50.421062 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb70105c-37fc-423b-bb3c-2952817a764c None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:25:50.423347 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-fb70105c-37fc-423b-bb3c-2952817a764c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:25:50.478497 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb70105c-37fc-423b-bb3c-2952817a764c None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:25:50.481993 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4678cb25-39b3-4bed-8852-42980dbd5ab2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:25:50.482626 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678cb25-39b3-4bed-8852-42980dbd5ab2 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:25:50.482909 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678cb25-39b3-4bed-8852-42980dbd5ab2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:25:50.483181 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678cb25-39b3-4bed-8852-42980dbd5ab2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:25:50.492042 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4678cb25-39b3-4bed-8852-42980dbd5ab2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:25:50.493452 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4678cb25-39b3-4bed-8852-42980dbd5ab2 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:25:50.502605 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 762/1528] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:25:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:25:52.782516 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8167b-7ac9-4c4d-a5b2-c42f0ff8aa66 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:25:52.783011 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8167b-7ac9-4c4d-a5b2-c42f0ff8aa66 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:25:52.783116 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8167b-7ac9-4c4d-a5b2-c42f0ff8aa66 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:25:52.784867 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 767/1529] 127.0.0.1 () {54 vars in 916 bytes} [Thu Apr 7 06:25:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:25:52.789930 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cff182-ccfa-4b6c-a3ed-399cdb17916a None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:25:52.790351 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cff182-ccfa-4b6c-a3ed-399cdb17916a None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:25:52.790487 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cff182-ccfa-4b6c-a3ed-399cdb17916a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:25:52.808305 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-e9cff182-ccfa-4b6c-a3ed-399cdb17916a None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:25:52.809640 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-e9cff182-ccfa-4b6c-a3ed-399cdb17916a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:25:52.818024 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 763/1530] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Apr 7 06:25:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:25:52.853031 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc8167b-7ac9-4c4d-a5b2-c42f0ff8aa66 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:25:52.864538 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc8167b-7ac9-4c4d-a5b2-c42f0ff8aa66 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:25:52.868096 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d35f49-ca90-4aa5-b569-bbbb4a7e7568 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:25:52.868735 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d35f49-ca90-4aa5-b569-bbbb4a7e7568 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:25:52.869018 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d35f49-ca90-4aa5-b569-bbbb4a7e7568 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:25:52.869295 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d35f49-ca90-4aa5-b569-bbbb4a7e7568 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:25:52.878694 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d35f49-ca90-4aa5-b569-bbbb4a7e7568 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:25:52.880165 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d35f49-ca90-4aa5-b569-bbbb4a7e7568 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:25:52.889275 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 768/1531] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:25:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 07 06:25:56.673205 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3c508-4842-403e-a5bd-b27cb81f28b4 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:25:56.673777 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3c508-4842-403e-a5bd-b27cb81f28b4 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:25:56.673777 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3c508-4842-403e-a5bd-b27cb81f28b4 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:25:56.677045 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 764/1532] 127.0.0.1 () {54 vars in 916 bytes} [Thu Apr 7 06:25:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:25:56.683995 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b575e-237b-435b-a1ca-63e0696a8433 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:25:56.684421 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b575e-237b-435b-a1ca-63e0696a8433 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:25:56.684554 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b575e-237b-435b-a1ca-63e0696a8433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:25:56.702982 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-f57b575e-237b-435b-a1ca-63e0696a8433 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:25:56.704223 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f57b575e-237b-435b-a1ca-63e0696a8433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:25:56.711841 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 769/1533] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Apr 7 06:25:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:25:56.980160 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d3c508-4842-403e-a5bd-b27cb81f28b4 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:25:56.981809 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-81d3c508-4842-403e-a5bd-b27cb81f28b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:25:57.036846 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d3c508-4842-403e-a5bd-b27cb81f28b4 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:25:57.040353 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd432fa-4264-4057-ac49-3bc5e232c12c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:25:57.040990 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd432fa-4264-4057-ac49-3bc5e232c12c service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:25:57.041276 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd432fa-4264-4057-ac49-3bc5e232c12c service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:25:57.041551 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd432fa-4264-4057-ac49-3bc5e232c12c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:25:57.050683 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd432fa-4264-4057-ac49-3bc5e232c12c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:25:57.052177 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd432fa-4264-4057-ac49-3bc5e232c12c service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:25:57.061211 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 765/1534] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:25:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:25:59.375704 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc82278-1e38-4600-9b0a-4c0d20ff488e None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:25:59.376227 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc82278-1e38-4600-9b0a-4c0d20ff488e None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:25:59.376358 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc82278-1e38-4600-9b0a-4c0d20ff488e None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:25:59.377678 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 770/1535] 127.0.0.1 () {54 vars in 916 bytes} [Thu Apr 7 06:25:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:25:59.382837 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696a6f0-dec2-4a7a-ac26-56c7ad42ee39 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:25:59.383249 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696a6f0-dec2-4a7a-ac26-56c7ad42ee39 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:25:59.383400 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696a6f0-dec2-4a7a-ac26-56c7ad42ee39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:25:59.401170 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-b696a6f0-dec2-4a7a-ac26-56c7ad42ee39 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:25:59.402406 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b696a6f0-dec2-4a7a-ac26-56c7ad42ee39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:25:59.410243 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 766/1536] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Apr 7 06:25:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:25:59.680573 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610988dd-b77e-4636-961d-14a9794db070 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:25:59.680869 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610988dd-b77e-4636-961d-14a9794db070 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:25:59.681152 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610988dd-b77e-4636-961d-14a9794db070 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:25:59.682522 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 771/1537] 10.222.0.24 () {54 vars in 962 bytes} [Thu Apr 7 06:25:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:25:59.687482 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db8281d-282e-406f-9e53-b26c9c3a3651 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:25:59.687844 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db8281d-282e-406f-9e53-b26c9c3a3651 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:25:59.688133 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db8281d-282e-406f-9e53-b26c9c3a3651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:25:59.706166 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-4db8281d-282e-406f-9e53-b26c9c3a3651 None None] MFA Rules not processed for user `0fc81e8151cc4dd2a79d3c6c9d9ceaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:25:59.707346 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-4db8281d-282e-406f-9e53-b26c9c3a3651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:25:59.713744 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 767/1538] 10.222.0.24 () {58 vars in 1059 bytes} [Thu Apr 7 06:25:59 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:25:59.721588 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610988dd-b77e-4636-961d-14a9794db070 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:25:59.731813 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610988dd-b77e-4636-961d-14a9794db070 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:25:59.737875 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b291d-fef1-409d-9863-7bda094092e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:25:59.737875 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b291d-fef1-409d-9863-7bda094092e3 service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:25:59.737875 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b291d-fef1-409d-9863-7bda094092e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:25:59.737875 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b291d-fef1-409d-9863-7bda094092e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:25:59.745505 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b291d-fef1-409d-9863-7bda094092e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:25:59.746914 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b291d-fef1-409d-9863-7bda094092e3 service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:25:59.756460 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 772/1539] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:25:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:27:31.877629 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da60262-683e-49ed-9d4b-20bbdf30aeb7 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:31.878265 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da60262-683e-49ed-9d4b-20bbdf30aeb7 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:31.878265 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da60262-683e-49ed-9d4b-20bbdf30aeb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:31.906355 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-8da60262-683e-49ed-9d4b-20bbdf30aeb7 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:27:31.908020 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-8da60262-683e-49ed-9d4b-20bbdf30aeb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:31.923334 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 768/1540] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:27:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:27:31.932895 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef49d4-7802-431d-9324-8ac213e00525 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:31.933460 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef49d4-7802-431d-9324-8ac213e00525 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:31.933460 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef49d4-7802-431d-9324-8ac213e00525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:31.962184 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-64ef49d4-7802-431d-9324-8ac213e00525 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:27:31.963615 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-64ef49d4-7802-431d-9324-8ac213e00525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:31.982297 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 773/1541] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:27:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:27:31.988194 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da60262-683e-49ed-9d4b-20bbdf30aeb7 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:32.006577 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da60262-683e-49ed-9d4b-20bbdf30aeb7 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:32.016398 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe3716-0bc3-4fd0-9d47-81aec90d892f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:32.017847 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe3716-0bc3-4fd0-9d47-81aec90d892f admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:32.018374 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe3716-0bc3-4fd0-9d47-81aec90d892f admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:32.018878 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe3716-0bc3-4fd0-9d47-81aec90d892f admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:32.019893 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe3716-0bc3-4fd0-9d47-81aec90d892f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:27:32.020440 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe3716-0bc3-4fd0-9d47-81aec90d892f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:32.022384 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe3716-0bc3-4fd0-9d47-81aec90d892f admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:32.043691 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 769/1542] 10.222.0.24 () {58 vars in 1152 bytes} [Thu Apr 7 06:27:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:27:32.053065 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ef49d4-7802-431d-9324-8ac213e00525 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:32.068152 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ef49d4-7802-431d-9324-8ac213e00525 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:32.073596 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052fc446-7ae6-471c-847c-8fce7ccea7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:32.074456 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052fc446-7ae6-471c-847c-8fce7ccea7dc admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:32.074920 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052fc446-7ae6-471c-847c-8fce7ccea7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:32.075361 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052fc446-7ae6-471c-847c-8fce7ccea7dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:32.076256 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052fc446-7ae6-471c-847c-8fce7ccea7dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:32.078508 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052fc446-7ae6-471c-847c-8fce7ccea7dc admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:32.156886 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565cc3b-6f5f-4753-a3e7-072569a03068 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:32.157251 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565cc3b-6f5f-4753-a3e7-072569a03068 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:32.157488 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565cc3b-6f5f-4753-a3e7-072569a03068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:32.178763 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 774/1543] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:27:32 2022] POST /identity/v3/projects => generated 369 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:27:32.183521 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052fc446-7ae6-471c-847c-8fce7ccea7dc admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:32.188764 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-f565cc3b-6f5f-4753-a3e7-072569a03068 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:27:32.190248 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-f565cc3b-6f5f-4753-a3e7-072569a03068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:32.261450 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052fc446-7ae6-471c-847c-8fce7ccea7dc admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:32.266760 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86810dd-5a1b-4698-a79f-433b755c1a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:32.268319 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86810dd-5a1b-4698-a79f-433b755c1a55 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:32.268961 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86810dd-5a1b-4698-a79f-433b755c1a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:32.269406 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86810dd-5a1b-4698-a79f-433b755c1a55 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:32.270274 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86810dd-5a1b-4698-a79f-433b755c1a55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:32.271563 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING py.warnings [None req-b86810dd-5a1b-4698-a79f-433b755c1a55 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 07 06:27:32.271563 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: warnings.warn(msg) Apr 07 06:27:32.271563 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: Apr 07 06:27:32.272883 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86810dd-5a1b-4698-a79f-433b755c1a55 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:32.288675 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 770/1544] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:27:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:27:32.290564 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6ebcf-0c08-402a-856a-a2828487f013 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:32.291079 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6ebcf-0c08-402a-856a-a2828487f013 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:32.291589 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6ebcf-0c08-402a-856a-a2828487f013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:32.311520 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-24b6ebcf-0c08-402a-856a-a2828487f013 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:27:32.313141 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-24b6ebcf-0c08-402a-856a-a2828487f013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:32.322017 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 771/1545] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:27:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:27:32.323617 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45290ed-f4f3-4622-acf2-d3e7d5ebf363 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:32.324202 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45290ed-f4f3-4622-acf2-d3e7d5ebf363 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:32.324948 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45290ed-f4f3-4622-acf2-d3e7d5ebf363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:32.343909 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-b45290ed-f4f3-4622-acf2-d3e7d5ebf363 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:27:32.345113 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b45290ed-f4f3-4622-acf2-d3e7d5ebf363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:32.352393 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 775/1546] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:27:32 2022] POST /identity/v3/users => generated 285 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:27:32.358223 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6bb83e-e2a3-4c89-962b-65984225f159 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:32.358223 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6bb83e-e2a3-4c89-962b-65984225f159 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:32.358223 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6bb83e-e2a3-4c89-962b-65984225f159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:32.358495 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 772/1547] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:27:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:27:32.358495 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c424ab-ddcf-4e08-9619-a2ef036c25a9 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:32.358495 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c424ab-ddcf-4e08-9619-a2ef036c25a9 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:32.358495 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c424ab-ddcf-4e08-9619-a2ef036c25a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:32.373644 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-cd6bb83e-e2a3-4c89-962b-65984225f159 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:27:32.374837 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-cd6bb83e-e2a3-4c89-962b-65984225f159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:32.377300 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-15c424ab-ddcf-4e08-9619-a2ef036c25a9 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:27:32.378566 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-15c424ab-ddcf-4e08-9619-a2ef036c25a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:32.383178 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 776/1548] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:27:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:27:32.384500 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac12cca-b8a8-4a5f-8274-1f8f17d6266c None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:32.384786 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac12cca-b8a8-4a5f-8274-1f8f17d6266c None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:32.385108 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac12cca-b8a8-4a5f-8274-1f8f17d6266c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:32.387509 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 773/1549] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:27:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:27:32.388765 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e70c1-48f0-4b0c-b5ba-a4c92b6ee921 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:32.389053 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e70c1-48f0-4b0c-b5ba-a4c92b6ee921 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:32.389329 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e70c1-48f0-4b0c-b5ba-a4c92b6ee921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:32.403688 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-7ac12cca-b8a8-4a5f-8274-1f8f17d6266c None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:27:32.404914 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-7ac12cca-b8a8-4a5f-8274-1f8f17d6266c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:32.408487 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-b84e70c1-48f0-4b0c-b5ba-a4c92b6ee921 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:27:32.409635 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b84e70c1-48f0-4b0c-b5ba-a4c92b6ee921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:32.413615 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 777/1550] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:27:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:27:32.415033 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6caffe-1db7-4e49-8522-0e3c96246885 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:32.415324 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6caffe-1db7-4e49-8522-0e3c96246885 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:32.416282 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6caffe-1db7-4e49-8522-0e3c96246885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:32.418620 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 774/1551] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:27:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:27:32.418620 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e6cd3-2368-4441-af2b-bf90bdd5012a None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:32.418620 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e6cd3-2368-4441-af2b-bf90bdd5012a None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:32.418620 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e6cd3-2368-4441-af2b-bf90bdd5012a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:32.433759 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-4a6caffe-1db7-4e49-8522-0e3c96246885 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:27:32.434960 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-4a6caffe-1db7-4e49-8522-0e3c96246885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:32.437913 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-f60e6cd3-2368-4441-af2b-bf90bdd5012a None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:27:32.439603 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-f60e6cd3-2368-4441-af2b-bf90bdd5012a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:32.443183 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 778/1552] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:27:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:27:32.444050 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6caffe-1db7-4e49-8522-0e3c96246885 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:32.447662 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 775/1553] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:27:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:27:32.453144 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75347718-a562-4ddd-b4a1-742c8e0a4eaf None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:32.453299 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6caffe-1db7-4e49-8522-0e3c96246885 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:32.453510 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75347718-a562-4ddd-b4a1-742c8e0a4eaf None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:32.453723 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75347718-a562-4ddd-b4a1-742c8e0a4eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:32.458330 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d99a0-2e41-4a67-b506-05c233b44336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:32.458985 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d99a0-2e41-4a67-b506-05c233b44336 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:32.459270 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d99a0-2e41-4a67-b506-05c233b44336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:32.459545 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d99a0-2e41-4a67-b506-05c233b44336 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:32.460379 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d99a0-2e41-4a67-b506-05c233b44336 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:32.461973 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d99a0-2e41-4a67-b506-05c233b44336 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:32.471693 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-75347718-a562-4ddd-b4a1-742c8e0a4eaf None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:27:32.475172 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 779/1554] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:27:32.475305 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-75347718-a562-4ddd-b4a1-742c8e0a4eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:32.475397 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad390f3-d093-4239-8938-10cded47ef55 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:32.475397 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad390f3-d093-4239-8938-10cded47ef55 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:32.475397 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad390f3-d093-4239-8938-10cded47ef55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:32.482276 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 776/1555] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:27:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:27:32.482765 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12efe44e-0fc7-4529-b69b-424d8364a230 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:32.483064 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12efe44e-0fc7-4529-b69b-424d8364a230 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:32.483346 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12efe44e-0fc7-4529-b69b-424d8364a230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:32.492904 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-aad390f3-d093-4239-8938-10cded47ef55 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:27:32.494076 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-aad390f3-d093-4239-8938-10cded47ef55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:32.500850 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-12efe44e-0fc7-4529-b69b-424d8364a230 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:27:32.502353 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 780/1556] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:27:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:27:32.502586 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-12efe44e-0fc7-4529-b69b-424d8364a230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:32.503120 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad390f3-d093-4239-8938-10cded47ef55 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:32.512854 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 777/1557] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:27:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:27:32.513645 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12efe44e-0fc7-4529-b69b-424d8364a230 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:32.514387 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad390f3-d093-4239-8938-10cded47ef55 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:32.519497 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c076f1-bf60-44d2-a49b-009a213d8039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:32.520170 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c076f1-bf60-44d2-a49b-009a213d8039 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:32.520449 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c076f1-bf60-44d2-a49b-009a213d8039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:32.520721 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c076f1-bf60-44d2-a49b-009a213d8039 admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:32.521439 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c076f1-bf60-44d2-a49b-009a213d8039 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:27:32.521740 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c076f1-bf60-44d2-a49b-009a213d8039 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:32.522731 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING py.warnings [None req-a7c076f1-bf60-44d2-a49b-009a213d8039 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 07 06:27:32.522731 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: warnings.warn(msg) Apr 07 06:27:32.522731 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: Apr 07 06:27:32.523399 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12efe44e-0fc7-4529-b69b-424d8364a230 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:32.523596 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c076f1-bf60-44d2-a49b-009a213d8039 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:32.528200 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58595209-fd88-445f-9b5b-0ab1237762b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:32.528849 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58595209-fd88-445f-9b5b-0ab1237762b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:32.529135 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58595209-fd88-445f-9b5b-0ab1237762b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:32.529411 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58595209-fd88-445f-9b5b-0ab1237762b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:32.530166 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58595209-fd88-445f-9b5b-0ab1237762b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:27:32.530478 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58595209-fd88-445f-9b5b-0ab1237762b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:32.532137 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58595209-fd88-445f-9b5b-0ab1237762b9 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:32.534933 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 781/1558] 10.222.0.24 () {58 vars in 1152 bytes} [Thu Apr 7 06:27:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:27:32.535968 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6089b54-e7e3-4bbe-b1ab-aa1350efe55a None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:32.536257 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6089b54-e7e3-4bbe-b1ab-aa1350efe55a None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:32.536543 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6089b54-e7e3-4bbe-b1ab-aa1350efe55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:32.553914 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 778/1559] 10.222.0.24 () {58 vars in 1152 bytes} [Thu Apr 7 06:27:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:27:32.553914 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c2222-da3d-4a70-a576-83264620ed30 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:32.553914 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c2222-da3d-4a70-a576-83264620ed30 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:32.553914 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c2222-da3d-4a70-a576-83264620ed30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:32.560066 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-a6089b54-e7e3-4bbe-b1ab-aa1350efe55a None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:27:32.561305 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a6089b54-e7e3-4bbe-b1ab-aa1350efe55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:32.566097 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-8d8c2222-da3d-4a70-a576-83264620ed30 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:27:32.567301 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-8d8c2222-da3d-4a70-a576-83264620ed30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:32.569545 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 782/1560] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:27:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:27:32.570316 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6089b54-e7e3-4bbe-b1ab-aa1350efe55a None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:32.578769 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 779/1561] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:27:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:27:32.579494 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8c2222-da3d-4a70-a576-83264620ed30 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:32.582996 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6089b54-e7e3-4bbe-b1ab-aa1350efe55a None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:32.587688 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baeda9d-34cc-4800-9907-d3e8fa88f01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:32.588367 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baeda9d-34cc-4800-9907-d3e8fa88f01d admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:32.588654 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baeda9d-34cc-4800-9907-d3e8fa88f01d admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:32.588929 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baeda9d-34cc-4800-9907-d3e8fa88f01d admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:32.589322 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8c2222-da3d-4a70-a576-83264620ed30 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:32.589646 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baeda9d-34cc-4800-9907-d3e8fa88f01d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:32.591275 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baeda9d-34cc-4800-9907-d3e8fa88f01d admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:32.593839 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00abf44f-9cdf-4ff8-951e-042b27b9e18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:32.594496 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abf44f-9cdf-4ff8-951e-042b27b9e18e admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:32.594778 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abf44f-9cdf-4ff8-951e-042b27b9e18e admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:32.595049 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abf44f-9cdf-4ff8-951e-042b27b9e18e admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:32.595875 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00abf44f-9cdf-4ff8-951e-042b27b9e18e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:27:32.596182 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00abf44f-9cdf-4ff8-951e-042b27b9e18e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:32.597743 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00abf44f-9cdf-4ff8-951e-042b27b9e18e admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:32.600946 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 783/1562] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:27:32.601844 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baeda9d-34cc-4800-9907-d3e8fa88f01d admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:32.616202 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 780/1563] 10.222.0.24 () {58 vars in 1152 bytes} [Thu Apr 7 06:27:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:27:32.616202 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00abf44f-9cdf-4ff8-951e-042b27b9e18e admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:32.616481 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baeda9d-34cc-4800-9907-d3e8fa88f01d admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:32.616577 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25895000-cd4d-42a1-8c2b-7489a79e7d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:32.617193 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25895000-cd4d-42a1-8c2b-7489a79e7d28 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:32.617477 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25895000-cd4d-42a1-8c2b-7489a79e7d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:32.617754 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25895000-cd4d-42a1-8c2b-7489a79e7d28 admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:32.618469 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25895000-cd4d-42a1-8c2b-7489a79e7d28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:27:32.618769 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25895000-cd4d-42a1-8c2b-7489a79e7d28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:32.619086 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00abf44f-9cdf-4ff8-951e-042b27b9e18e admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:32.620359 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25895000-cd4d-42a1-8c2b-7489a79e7d28 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:32.623497 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4046b82c-5560-43eb-b0ac-8e2f6789cf3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:32.624151 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046b82c-5560-43eb-b0ac-8e2f6789cf3d admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:32.624437 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046b82c-5560-43eb-b0ac-8e2f6789cf3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:32.624712 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046b82c-5560-43eb-b0ac-8e2f6789cf3d admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:32.625418 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4046b82c-5560-43eb-b0ac-8e2f6789cf3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:27:32.625724 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4046b82c-5560-43eb-b0ac-8e2f6789cf3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:32.627946 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4046b82c-5560-43eb-b0ac-8e2f6789cf3d admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:32.632730 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 784/1564] 10.222.0.24 () {58 vars in 1152 bytes} [Thu Apr 7 06:27:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:27:32.633570 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25895000-cd4d-42a1-8c2b-7489a79e7d28 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:32.639852 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 781/1565] 10.222.0.24 () {58 vars in 1152 bytes} [Thu Apr 7 06:27:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:27:32.640611 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4046b82c-5560-43eb-b0ac-8e2f6789cf3d admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:32.643471 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25895000-cd4d-42a1-8c2b-7489a79e7d28 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:32.648058 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c317996-6b6f-4539-8f8e-3b7acdab6ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:32.648692 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c317996-6b6f-4539-8f8e-3b7acdab6ec2 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:32.648976 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c317996-6b6f-4539-8f8e-3b7acdab6ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:32.649247 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c317996-6b6f-4539-8f8e-3b7acdab6ec2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:32.649928 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c317996-6b6f-4539-8f8e-3b7acdab6ec2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:32.651817 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c317996-6b6f-4539-8f8e-3b7acdab6ec2 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:32.652256 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4046b82c-5560-43eb-b0ac-8e2f6789cf3d admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:32.656659 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96402c-45ed-4d7b-800f-72c85de5b872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:32.657280 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96402c-45ed-4d7b-800f-72c85de5b872 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:32.657568 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96402c-45ed-4d7b-800f-72c85de5b872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:32.657876 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96402c-45ed-4d7b-800f-72c85de5b872 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:32.658549 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df96402c-45ed-4d7b-800f-72c85de5b872 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:32.659539 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING py.warnings [None req-df96402c-45ed-4d7b-800f-72c85de5b872 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 07 06:27:32.659539 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: warnings.warn(msg) Apr 07 06:27:32.659539 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: Apr 07 06:27:32.660737 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df96402c-45ed-4d7b-800f-72c85de5b872 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:32.753615 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 785/1566] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:27:32 2022] POST /identity/v3/projects => generated 373 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:27:32.754798 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c317996-6b6f-4539-8f8e-3b7acdab6ec2 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:32.766771 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 782/1567] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:27:32 2022] POST /identity/v3/projects => generated 389 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:27:32.774884 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96402c-45ed-4d7b-800f-72c85de5b872 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:32.821884 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c317996-6b6f-4539-8f8e-3b7acdab6ec2 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:32.826821 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac31b2-95c1-4a39-b2f0-457d0241b2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:32.827474 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96402c-45ed-4d7b-800f-72c85de5b872 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:32.827605 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac31b2-95c1-4a39-b2f0-457d0241b2f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:32.827769 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac31b2-95c1-4a39-b2f0-457d0241b2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:32.828060 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac31b2-95c1-4a39-b2f0-457d0241b2f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:32.828811 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ac31b2-95c1-4a39-b2f0-457d0241b2f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:27:32.829116 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ac31b2-95c1-4a39-b2f0-457d0241b2f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:32.830839 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ac31b2-95c1-4a39-b2f0-457d0241b2f3 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:32.832293 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dee3e8-a78b-42ed-be39-270b767fbb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:32.832969 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dee3e8-a78b-42ed-be39-270b767fbb88 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:32.835921 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dee3e8-a78b-42ed-be39-270b767fbb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:32.835921 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dee3e8-a78b-42ed-be39-270b767fbb88 admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:32.835921 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dee3e8-a78b-42ed-be39-270b767fbb88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:27:32.835921 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dee3e8-a78b-42ed-be39-270b767fbb88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:32.836273 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dee3e8-a78b-42ed-be39-270b767fbb88 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:32.849171 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 786/1568] 10.222.0.24 () {58 vars in 1152 bytes} [Thu Apr 7 06:27:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:27:32.849171 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac31b2-95c1-4a39-b2f0-457d0241b2f3 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:32.849466 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 783/1569] 10.222.0.24 () {58 vars in 1152 bytes} [Thu Apr 7 06:27:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:27:32.849466 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dee3e8-a78b-42ed-be39-270b767fbb88 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:32.858188 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac31b2-95c1-4a39-b2f0-457d0241b2f3 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:32.863646 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89737969-d85b-4195-b5c8-f30901f73ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:32.866442 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dee3e8-a78b-42ed-be39-270b767fbb88 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:32.866557 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89737969-d85b-4195-b5c8-f30901f73ea5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:32.866557 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89737969-d85b-4195-b5c8-f30901f73ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:32.866557 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89737969-d85b-4195-b5c8-f30901f73ea5 admin admin] PATH_INFO: `/v3/projects/118085a24a17451a9cb3862aa25bb155/users/a9668afac17d443bb92653ddaf28f971/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:32.868822 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc47231b-1b01-4d72-8beb-26088ea9169f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:32.869458 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47231b-1b01-4d72-8beb-26088ea9169f admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:32.869757 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47231b-1b01-4d72-8beb-26088ea9169f admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:32.870160 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47231b-1b01-4d72-8beb-26088ea9169f admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:32.870860 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc47231b-1b01-4d72-8beb-26088ea9169f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:32.872805 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc47231b-1b01-4d72-8beb-26088ea9169f admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:32.879700 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89737969-d85b-4195-b5c8-f30901f73ea5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=118085a24a17451a9cb3862aa25bb155, user_id=a9668afac17d443bb92653ddaf28f971, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:32.882578 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89737969-d85b-4195-b5c8-f30901f73ea5 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:32.945416 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 787/1570] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:27:32 2022] PUT /identity/v3/projects/118085a24a17451a9cb3862aa25bb155/users/a9668afac17d443bb92653ddaf28f971/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:27:32.946440 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89737969-d85b-4195-b5c8-f30901f73ea5 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:32.958741 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 784/1571] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:27:32 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:27:32.960266 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc47231b-1b01-4d72-8beb-26088ea9169f admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:33.012183 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89737969-d85b-4195-b5c8-f30901f73ea5 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:33.016790 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ae872-548f-474b-a513-ad14e6dab548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:33.018051 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ae872-548f-474b-a513-ad14e6dab548 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:33.018335 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ae872-548f-474b-a513-ad14e6dab548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:33.018612 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ae872-548f-474b-a513-ad14e6dab548 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:33.019327 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5ae872-548f-474b-a513-ad14e6dab548 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:33.019516 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc47231b-1b01-4d72-8beb-26088ea9169f admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:33.021256 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5ae872-548f-474b-a513-ad14e6dab548 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:33.024789 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f02ed-9c3d-41d1-bda4-7527e33e20f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:33.025802 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f02ed-9c3d-41d1-bda4-7527e33e20f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:33.025802 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f02ed-9c3d-41d1-bda4-7527e33e20f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:33.025802 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f02ed-9c3d-41d1-bda4-7527e33e20f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:33.026331 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1f02ed-9c3d-41d1-bda4-7527e33e20f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:33.028309 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1f02ed-9c3d-41d1-bda4-7527e33e20f7 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:33.105383 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 788/1572] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:27:32 2022] POST /identity/v3/projects => generated 379 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:27:33.105383 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ae872-548f-474b-a513-ad14e6dab548 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:33.113123 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 785/1573] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:27:32 2022] POST /identity/v3/projects => generated 377 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:27:33.117644 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f02ed-9c3d-41d1-bda4-7527e33e20f7 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:33.163236 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ae872-548f-474b-a513-ad14e6dab548 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:33.175317 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f02ed-9c3d-41d1-bda4-7527e33e20f7 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:33.179912 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da59c9f2-e695-4818-81f4-b4ae151572c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:33.180580 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59c9f2-e695-4818-81f4-b4ae151572c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:33.180870 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59c9f2-e695-4818-81f4-b4ae151572c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:33.181150 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59c9f2-e695-4818-81f4-b4ae151572c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:33.181832 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da59c9f2-e695-4818-81f4-b4ae151572c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:33.183821 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da59c9f2-e695-4818-81f4-b4ae151572c6 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:33.216345 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf56a53-f66d-45ac-be34-94403919cf30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:33.217019 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf56a53-f66d-45ac-be34-94403919cf30 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:33.217301 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf56a53-f66d-45ac-be34-94403919cf30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:33.217576 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf56a53-f66d-45ac-be34-94403919cf30 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:33.218263 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf56a53-f66d-45ac-be34-94403919cf30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:33.220202 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf56a53-f66d-45ac-be34-94403919cf30 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:33.254617 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 786/1574] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:27:33 2022] POST /identity/v3/users => generated 295 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:27:33.255500 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da59c9f2-e695-4818-81f4-b4ae151572c6 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:33.264682 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da59c9f2-e695-4818-81f4-b4ae151572c6 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:33.269186 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e11fb-1944-4e9b-ac33-d5c40933695f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:33.269809 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e11fb-1944-4e9b-ac33-d5c40933695f admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:33.270097 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e11fb-1944-4e9b-ac33-d5c40933695f admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:33.270374 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e11fb-1944-4e9b-ac33-d5c40933695f admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:33.271046 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905e11fb-1944-4e9b-ac33-d5c40933695f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:33.272977 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905e11fb-1944-4e9b-ac33-d5c40933695f admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:33.323289 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 789/1575] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:27:33 2022] POST /identity/v3/users => generated 287 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:27:33.324189 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf56a53-f66d-45ac-be34-94403919cf30 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:33.333904 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf56a53-f66d-45ac-be34-94403919cf30 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:33.338508 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfdeec0-b5cd-4e71-8fb9-539ec7ce73b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:33.339242 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfdeec0-b5cd-4e71-8fb9-539ec7ce73b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:33.339531 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfdeec0-b5cd-4e71-8fb9-539ec7ce73b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:33.339851 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfdeec0-b5cd-4e71-8fb9-539ec7ce73b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:33.340570 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfdeec0-b5cd-4e71-8fb9-539ec7ce73b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:33.342486 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfdeec0-b5cd-4e71-8fb9-539ec7ce73b4 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:33.356161 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 787/1576] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:27:33 2022] POST /identity/v3/projects => generated 405 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:27:33.356161 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192cff2-2b18-46ce-ba11-6c3a69455b1c None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:33.356161 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192cff2-2b18-46ce-ba11-6c3a69455b1c None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:33.356161 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192cff2-2b18-46ce-ba11-6c3a69455b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:33.381450 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-a192cff2-2b18-46ce-ba11-6c3a69455b1c None None] MFA Rules not processed for user `a9668afac17d443bb92653ddaf28f971`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:27:33.382635 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a192cff2-2b18-46ce-ba11-6c3a69455b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:33.417715 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 790/1577] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:27:33 2022] POST /identity/v3/projects => generated 371 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:27:33.417715 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfdeec0-b5cd-4e71-8fb9-539ec7ce73b4 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:33.448550 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 788/1578] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:27:33 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:27:33.449595 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a192cff2-2b18-46ce-ba11-6c3a69455b1c None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:33.475193 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfdeec0-b5cd-4e71-8fb9-539ec7ce73b4 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:33.479776 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e264bec-6ede-408c-940c-b8ddb859344b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:33.480457 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e264bec-6ede-408c-940c-b8ddb859344b admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:33.480745 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e264bec-6ede-408c-940c-b8ddb859344b admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:33.481020 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e264bec-6ede-408c-940c-b8ddb859344b admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:33.481708 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e264bec-6ede-408c-940c-b8ddb859344b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:33.483673 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e264bec-6ede-408c-940c-b8ddb859344b admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:33.509054 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a192cff2-2b18-46ce-ba11-6c3a69455b1c None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:33.513696 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374bfe1f-65b9-4b54-b228-9f4f5074c727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:33.514362 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374bfe1f-65b9-4b54-b228-9f4f5074c727 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:33.514648 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374bfe1f-65b9-4b54-b228-9f4f5074c727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:33.514923 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374bfe1f-65b9-4b54-b228-9f4f5074c727 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:33.515604 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374bfe1f-65b9-4b54-b228-9f4f5074c727 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:33.518255 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374bfe1f-65b9-4b54-b228-9f4f5074c727 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:33.615775 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 791/1579] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:27:33 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:27:33.616535 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e264bec-6ede-408c-940c-b8ddb859344b admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:33.625652 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e264bec-6ede-408c-940c-b8ddb859344b admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:33.630745 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c377e42-ba70-4854-8d74-65444bd0a371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:33.631381 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c377e42-ba70-4854-8d74-65444bd0a371 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:33.631687 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c377e42-ba70-4854-8d74-65444bd0a371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:33.631993 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c377e42-ba70-4854-8d74-65444bd0a371 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:33.632676 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c377e42-ba70-4854-8d74-65444bd0a371 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:33.634585 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c377e42-ba70-4854-8d74-65444bd0a371 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:33.666180 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 789/1580] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:27:33 2022] POST /identity/v3/users => generated 290 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:27:33.667022 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374bfe1f-65b9-4b54-b228-9f4f5074c727 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:33.676623 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374bfe1f-65b9-4b54-b228-9f4f5074c727 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:33.681126 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09686c69-5315-4a1d-b394-fe6f610ae87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:33.681758 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09686c69-5315-4a1d-b394-fe6f610ae87b admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:33.682047 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09686c69-5315-4a1d-b394-fe6f610ae87b admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:33.682327 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09686c69-5315-4a1d-b394-fe6f610ae87b admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:33.683042 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09686c69-5315-4a1d-b394-fe6f610ae87b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:33.684666 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09686c69-5315-4a1d-b394-fe6f610ae87b admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:33.694794 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 790/1581] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:27:33.695559 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09686c69-5315-4a1d-b394-fe6f610ae87b admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:33.704519 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09686c69-5315-4a1d-b394-fe6f610ae87b admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:33.709169 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ba26b9-86d3-465b-9594-104582f35f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:33.710428 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba26b9-86d3-465b-9594-104582f35f19 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:33.710428 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba26b9-86d3-465b-9594-104582f35f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:33.710428 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba26b9-86d3-465b-9594-104582f35f19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:33.710996 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ba26b9-86d3-465b-9594-104582f35f19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:33.712549 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ba26b9-86d3-465b-9594-104582f35f19 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:33.722577 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 791/1582] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:27:33.723423 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ba26b9-86d3-465b-9594-104582f35f19 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:33.732290 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ba26b9-86d3-465b-9594-104582f35f19 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:33.737433 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54222e8-5358-40c9-8226-748e7a70b602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:33.738293 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54222e8-5358-40c9-8226-748e7a70b602 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:33.738665 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54222e8-5358-40c9-8226-748e7a70b602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:33.738948 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54222e8-5358-40c9-8226-748e7a70b602 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:33.739612 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54222e8-5358-40c9-8226-748e7a70b602 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:33.741537 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54222e8-5358-40c9-8226-748e7a70b602 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:33.746021 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 792/1583] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:27:33 2022] POST /identity/v3/users => generated 289 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:27:33.746688 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c377e42-ba70-4854-8d74-65444bd0a371 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:33.756862 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c377e42-ba70-4854-8d74-65444bd0a371 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:33.761734 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9d58e-62f1-446b-8af2-43eb3c6c7bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:33.767974 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9d58e-62f1-446b-8af2-43eb3c6c7bf2 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:33.767974 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9d58e-62f1-446b-8af2-43eb3c6c7bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:33.767974 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9d58e-62f1-446b-8af2-43eb3c6c7bf2 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:33.767974 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e9d58e-62f1-446b-8af2-43eb3c6c7bf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:33.767974 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e9d58e-62f1-446b-8af2-43eb3c6c7bf2 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:33.854374 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 792/1584] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:27:33 2022] POST /identity/v3/users => generated 303 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:27:33.855103 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54222e8-5358-40c9-8226-748e7a70b602 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:33.864765 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54222e8-5358-40c9-8226-748e7a70b602 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:33.869357 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67440218-1b7e-4861-b0ca-9f12bee9bd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:33.869925 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67440218-1b7e-4861-b0ca-9f12bee9bd4b admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:33.870214 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67440218-1b7e-4861-b0ca-9f12bee9bd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:33.870490 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67440218-1b7e-4861-b0ca-9f12bee9bd4b admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:33.871162 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67440218-1b7e-4861-b0ca-9f12bee9bd4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:33.873209 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67440218-1b7e-4861-b0ca-9f12bee9bd4b admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:33.878033 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 793/1585] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:27:33 2022] POST /identity/v3/users => generated 286 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:27:33.878925 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9d58e-62f1-446b-8af2-43eb3c6c7bf2 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:33.888460 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9d58e-62f1-446b-8af2-43eb3c6c7bf2 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:33.893734 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704feb63-ab90-40fa-8447-43e7681dc405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:33.894385 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704feb63-ab90-40fa-8447-43e7681dc405 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:33.895876 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704feb63-ab90-40fa-8447-43e7681dc405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:33.895876 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704feb63-ab90-40fa-8447-43e7681dc405 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:33.895876 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704feb63-ab90-40fa-8447-43e7681dc405 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:33.897386 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704feb63-ab90-40fa-8447-43e7681dc405 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:33.908936 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 794/1586] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:27:33.909888 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704feb63-ab90-40fa-8447-43e7681dc405 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:33.918948 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704feb63-ab90-40fa-8447-43e7681dc405 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:33.923411 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dd7705-b33d-4559-9094-57c1821f5616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:33.924625 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dd7705-b33d-4559-9094-57c1821f5616 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:33.924625 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dd7705-b33d-4559-9094-57c1821f5616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:33.924951 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dd7705-b33d-4559-9094-57c1821f5616 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:33.925377 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dd7705-b33d-4559-9094-57c1821f5616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:33.926974 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dd7705-b33d-4559-9094-57c1821f5616 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:33.936620 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 795/1587] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:27:33.937613 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dd7705-b33d-4559-9094-57c1821f5616 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:33.947110 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dd7705-b33d-4559-9094-57c1821f5616 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:33.951909 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ee119-4d47-4ede-bdd9-6b083439925f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:33.952514 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ee119-4d47-4ede-bdd9-6b083439925f admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:33.952796 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ee119-4d47-4ede-bdd9-6b083439925f admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:33.962407 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ee119-4d47-4ede-bdd9-6b083439925f admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:33.962407 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2ee119-4d47-4ede-bdd9-6b083439925f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:33.962407 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2ee119-4d47-4ede-bdd9-6b083439925f admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:33.962704 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 793/1588] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:27:33 2022] POST /identity/v3/projects => generated 367 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:27:33.962704 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67440218-1b7e-4861-b0ca-9f12bee9bd4b admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:33.969022 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 796/1589] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:27:33.969022 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ee119-4d47-4ede-bdd9-6b083439925f admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:33.977453 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ee119-4d47-4ede-bdd9-6b083439925f admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:34.020117 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67440218-1b7e-4861-b0ca-9f12bee9bd4b admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:34.024771 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e293e4d7-5ab6-41b3-a9eb-7dba5e4ad4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:34.025443 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e293e4d7-5ab6-41b3-a9eb-7dba5e4ad4ff admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:34.025729 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e293e4d7-5ab6-41b3-a9eb-7dba5e4ad4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:34.026004 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e293e4d7-5ab6-41b3-a9eb-7dba5e4ad4ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:34.026733 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e293e4d7-5ab6-41b3-a9eb-7dba5e4ad4ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:34.028435 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e293e4d7-5ab6-41b3-a9eb-7dba5e4ad4ff admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:34.030977 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae637e8-6021-47f4-9a19-57acb20f2abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:34.031641 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae637e8-6021-47f4-9a19-57acb20f2abd admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:34.031961 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae637e8-6021-47f4-9a19-57acb20f2abd admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:34.032243 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae637e8-6021-47f4-9a19-57acb20f2abd admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:34.032972 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae637e8-6021-47f4-9a19-57acb20f2abd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:34.034547 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae637e8-6021-47f4-9a19-57acb20f2abd admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:34.038046 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 794/1590] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:27:34.038844 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e293e4d7-5ab6-41b3-a9eb-7dba5e4ad4ff admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:34.044547 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 797/1591] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:27:34.045269 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae637e8-6021-47f4-9a19-57acb20f2abd admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:34.048409 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e293e4d7-5ab6-41b3-a9eb-7dba5e4ad4ff admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:34.052918 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd4afc-5fe8-497b-b6d3-d9dcb954f86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:34.053555 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd4afc-5fe8-497b-b6d3-d9dcb954f86f admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:34.053840 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd4afc-5fe8-497b-b6d3-d9dcb954f86f admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:34.054113 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd4afc-5fe8-497b-b6d3-d9dcb954f86f admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:34.054685 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae637e8-6021-47f4-9a19-57acb20f2abd admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:34.054832 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dd4afc-5fe8-497b-b6d3-d9dcb954f86f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:34.056446 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dd4afc-5fe8-497b-b6d3-d9dcb954f86f admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:34.059222 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b02c4-fa6d-4420-9d79-9bb378e5465e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:34.059882 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b02c4-fa6d-4420-9d79-9bb378e5465e admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:34.060170 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b02c4-fa6d-4420-9d79-9bb378e5465e admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:34.060471 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b02c4-fa6d-4420-9d79-9bb378e5465e admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:34.061179 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068b02c4-fa6d-4420-9d79-9bb378e5465e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:34.062771 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068b02c4-fa6d-4420-9d79-9bb378e5465e admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:34.067017 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 795/1592] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:27:34.068611 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd4afc-5fe8-497b-b6d3-d9dcb954f86f admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:34.078779 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd4afc-5fe8-497b-b6d3-d9dcb954f86f admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:34.082262 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 798/1593] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:27:34.082262 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b02c4-fa6d-4420-9d79-9bb378e5465e admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:34.086558 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07917e9-a353-492e-9fa8-bb7a6e9aad75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:34.087235 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07917e9-a353-492e-9fa8-bb7a6e9aad75 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:34.087517 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07917e9-a353-492e-9fa8-bb7a6e9aad75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:34.087963 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07917e9-a353-492e-9fa8-bb7a6e9aad75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:34.088571 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07917e9-a353-492e-9fa8-bb7a6e9aad75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:34.090217 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07917e9-a353-492e-9fa8-bb7a6e9aad75 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:34.090345 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b02c4-fa6d-4420-9d79-9bb378e5465e admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:34.098387 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1eed49-dd49-40c4-acaf-8d3a2909b744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:34.099039 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1eed49-dd49-40c4-acaf-8d3a2909b744 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:34.099327 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1eed49-dd49-40c4-acaf-8d3a2909b744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:34.099605 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1eed49-dd49-40c4-acaf-8d3a2909b744 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:34.100373 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1eed49-dd49-40c4-acaf-8d3a2909b744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:34.101595 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 796/1594] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:27:34.102124 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1eed49-dd49-40c4-acaf-8d3a2909b744 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:34.102442 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07917e9-a353-492e-9fa8-bb7a6e9aad75 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:34.113553 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07917e9-a353-492e-9fa8-bb7a6e9aad75 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:34.113770 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 799/1595] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:27:34.114578 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1eed49-dd49-40c4-acaf-8d3a2909b744 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:34.121286 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b4ffe3-cfd6-4f60-989a-eafd187b1160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:34.122023 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4ffe3-cfd6-4f60-989a-eafd187b1160 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:34.122360 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4ffe3-cfd6-4f60-989a-eafd187b1160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:34.122590 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4ffe3-cfd6-4f60-989a-eafd187b1160 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:34.123289 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b4ffe3-cfd6-4f60-989a-eafd187b1160 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:34.123931 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1eed49-dd49-40c4-acaf-8d3a2909b744 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:34.125249 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b4ffe3-cfd6-4f60-989a-eafd187b1160 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:34.129288 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bca2c0e-57f8-4a59-958e-a715b65b07c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:34.129590 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca2c0e-57f8-4a59-958e-a715b65b07c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:34.129877 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca2c0e-57f8-4a59-958e-a715b65b07c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:34.130157 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca2c0e-57f8-4a59-958e-a715b65b07c9 admin admin] PATH_INFO: `/v3/projects/15de816e94a54017b0b809f20d84b492/users/eb071251b5b74ab8b03e312de3bc945e/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:34.144939 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bca2c0e-57f8-4a59-958e-a715b65b07c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15de816e94a54017b0b809f20d84b492, user_id=eb071251b5b74ab8b03e312de3bc945e, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:34.147733 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bca2c0e-57f8-4a59-958e-a715b65b07c9 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:34.209284 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 797/1596] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:27:34 2022] POST /identity/v3/users => generated 290 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:27:34.210227 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b4ffe3-cfd6-4f60-989a-eafd187b1160 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:34.219711 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b4ffe3-cfd6-4f60-989a-eafd187b1160 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:34.226679 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 800/1597] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:27:34 2022] PUT /identity/v3/projects/15de816e94a54017b0b809f20d84b492/users/eb071251b5b74ab8b03e312de3bc945e/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:27:34.228296 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bca2c0e-57f8-4a59-958e-a715b65b07c9 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:34.282311 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8dfa32-cff7-4c0f-9862-d708c4a62241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:34.283874 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8dfa32-cff7-4c0f-9862-d708c4a62241 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:34.284161 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8dfa32-cff7-4c0f-9862-d708c4a62241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:34.284436 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8dfa32-cff7-4c0f-9862-d708c4a62241 admin admin] PATH_INFO: `/v3/projects/33d7440ad8764522adff946e9601c33d/users/932ccf4c79d5426fb875ed572d69f161/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:34.291594 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bca2c0e-57f8-4a59-958e-a715b65b07c9 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:34.296214 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e77a73-90f0-44dc-ba40-1aa773fc31a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:34.296885 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e77a73-90f0-44dc-ba40-1aa773fc31a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:34.297175 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e77a73-90f0-44dc-ba40-1aa773fc31a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:34.297455 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e77a73-90f0-44dc-ba40-1aa773fc31a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:34.298212 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e77a73-90f0-44dc-ba40-1aa773fc31a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:34.298417 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8dfa32-cff7-4c0f-9862-d708c4a62241 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33d7440ad8764522adff946e9601c33d, user_id=932ccf4c79d5426fb875ed572d69f161, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:34.299448 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING py.warnings [None req-dd8dfa32-cff7-4c0f-9862-d708c4a62241 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 07 06:27:34.299448 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: warnings.warn(msg) Apr 07 06:27:34.299448 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: Apr 07 06:27:34.299919 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e77a73-90f0-44dc-ba40-1aa773fc31a3 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:34.301438 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8dfa32-cff7-4c0f-9862-d708c4a62241 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:34.309535 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 801/1598] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:27:34.310335 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e77a73-90f0-44dc-ba40-1aa773fc31a3 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:34.319313 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e77a73-90f0-44dc-ba40-1aa773fc31a3 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:34.323842 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90574a9-4e46-4b70-b688-98b56177a42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:34.324466 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90574a9-4e46-4b70-b688-98b56177a42b admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:34.324747 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90574a9-4e46-4b70-b688-98b56177a42b admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:34.325044 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90574a9-4e46-4b70-b688-98b56177a42b admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:34.325719 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90574a9-4e46-4b70-b688-98b56177a42b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:34.327270 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90574a9-4e46-4b70-b688-98b56177a42b admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:34.337739 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 802/1599] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:27:34.338513 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90574a9-4e46-4b70-b688-98b56177a42b admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:34.348120 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90574a9-4e46-4b70-b688-98b56177a42b admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:34.352703 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784be878-2659-4ab1-a037-d64489b8c6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:34.353307 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784be878-2659-4ab1-a037-d64489b8c6f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:34.355628 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784be878-2659-4ab1-a037-d64489b8c6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:34.355628 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784be878-2659-4ab1-a037-d64489b8c6f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:34.355628 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784be878-2659-4ab1-a037-d64489b8c6f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:34.356084 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784be878-2659-4ab1-a037-d64489b8c6f4 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:34.365763 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 803/1600] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:27:34.366539 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784be878-2659-4ab1-a037-d64489b8c6f4 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:34.375678 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784be878-2659-4ab1-a037-d64489b8c6f4 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:34.380242 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0661ad23-1ebb-4744-b82f-284732f674e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:34.384399 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0661ad23-1ebb-4744-b82f-284732f674e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:34.384399 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0661ad23-1ebb-4744-b82f-284732f674e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:34.384399 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0661ad23-1ebb-4744-b82f-284732f674e2 admin admin] PATH_INFO: `/v3/projects/e654563225464c6c925e0f97b63a12d7/users/c9ac85053def476489ee1843bbd02316/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:34.385732 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 798/1601] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:27:34 2022] PUT /identity/v3/projects/33d7440ad8764522adff946e9601c33d/users/932ccf4c79d5426fb875ed572d69f161/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:27:34.396102 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8dfa32-cff7-4c0f-9862-d708c4a62241 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:34.397497 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0661ad23-1ebb-4744-b82f-284732f674e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e654563225464c6c925e0f97b63a12d7, user_id=c9ac85053def476489ee1843bbd02316, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:34.400192 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0661ad23-1ebb-4744-b82f-284732f674e2 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:34.446243 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8dfa32-cff7-4c0f-9862-d708c4a62241 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:34.450779 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4bf0be-28c8-4bf0-967d-c1ad68a914c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:34.451662 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4bf0be-28c8-4bf0-967d-c1ad68a914c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:34.451973 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4bf0be-28c8-4bf0-967d-c1ad68a914c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:34.453182 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4bf0be-28c8-4bf0-967d-c1ad68a914c3 admin admin] PATH_INFO: `/v3/projects/d3e8ec8942464f8abbafbd48b6f1f61f/users/5a3762215c1d48159d160625fe9d8dce/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:34.465223 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4bf0be-28c8-4bf0-967d-c1ad68a914c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3e8ec8942464f8abbafbd48b6f1f61f, user_id=5a3762215c1d48159d160625fe9d8dce, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:34.467949 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4bf0be-28c8-4bf0-967d-c1ad68a914c3 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:34.478773 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 804/1602] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:27:34 2022] PUT /identity/v3/projects/e654563225464c6c925e0f97b63a12d7/users/c9ac85053def476489ee1843bbd02316/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:27:34.479798 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0661ad23-1ebb-4744-b82f-284732f674e2 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:34.538990 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0661ad23-1ebb-4744-b82f-284732f674e2 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:34.543511 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1003d8-d977-411d-b272-33fb9859cb26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:34.544193 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1003d8-d977-411d-b272-33fb9859cb26 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:34.544556 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1003d8-d977-411d-b272-33fb9859cb26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:34.544839 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1003d8-d977-411d-b272-33fb9859cb26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:34.545555 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1003d8-d977-411d-b272-33fb9859cb26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:34.547126 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1003d8-d977-411d-b272-33fb9859cb26 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:34.557210 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 805/1603] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:27:34.560533 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb1007-160f-49bb-93c2-1174a3826a81 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:34.560533 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb1007-160f-49bb-93c2-1174a3826a81 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:34.560533 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb1007-160f-49bb-93c2-1174a3826a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:34.561431 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 799/1604] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:27:34 2022] PUT /identity/v3/projects/d3e8ec8942464f8abbafbd48b6f1f61f/users/5a3762215c1d48159d160625fe9d8dce/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:27:34.562434 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4bf0be-28c8-4bf0-967d-c1ad68a914c3 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:34.576466 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-80eb1007-160f-49bb-93c2-1174a3826a81 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:27:34.577645 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-80eb1007-160f-49bb-93c2-1174a3826a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:34.621422 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4bf0be-28c8-4bf0-967d-c1ad68a914c3 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:34.625943 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65cd82-1753-4b8a-b4e4-8feedc76690b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:34.627382 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65cd82-1753-4b8a-b4e4-8feedc76690b admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:34.627665 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65cd82-1753-4b8a-b4e4-8feedc76690b admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:34.627964 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65cd82-1753-4b8a-b4e4-8feedc76690b admin admin] PATH_INFO: `/v3/projects/a0889ebfa7d7493ba7e12b13516d4fb7/users/9dfc8205c02f4f83bafdac7217b3e685/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:34.632931 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 806/1605] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:27:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:27:34.633820 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb1007-160f-49bb-93c2-1174a3826a81 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:34.642896 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb1007-160f-49bb-93c2-1174a3826a81 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:34.644812 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf65cd82-1753-4b8a-b4e4-8feedc76690b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0889ebfa7d7493ba7e12b13516d4fb7, user_id=9dfc8205c02f4f83bafdac7217b3e685, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:34.647447 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41696da-f103-47d8-a621-c487cb910f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:34.647609 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf65cd82-1753-4b8a-b4e4-8feedc76690b admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:34.648430 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41696da-f103-47d8-a621-c487cb910f65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:34.648716 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41696da-f103-47d8-a621-c487cb910f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:34.648988 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41696da-f103-47d8-a621-c487cb910f65 admin admin] PATH_INFO: `/v3/projects/3ca5bd0c2c2e470f8beec7845d73a775/users/3cab2e53c1a44d9eab8a55a4223c787f/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:34.663450 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41696da-f103-47d8-a621-c487cb910f65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ca5bd0c2c2e470f8beec7845d73a775, user_id=3cab2e53c1a44d9eab8a55a4223c787f, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:34.666101 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41696da-f103-47d8-a621-c487cb910f65 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:34.740207 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 800/1606] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:27:34 2022] PUT /identity/v3/projects/a0889ebfa7d7493ba7e12b13516d4fb7/users/9dfc8205c02f4f83bafdac7217b3e685/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:27:34.741081 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65cd82-1753-4b8a-b4e4-8feedc76690b admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:34.745939 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 807/1607] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:27:34 2022] PUT /identity/v3/projects/3ca5bd0c2c2e470f8beec7845d73a775/users/3cab2e53c1a44d9eab8a55a4223c787f/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:27:34.747272 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b7a83-1fc2-4ad7-8f63-fdee5af4b1a7 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:34.747566 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b7a83-1fc2-4ad7-8f63-fdee5af4b1a7 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:34.747864 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b7a83-1fc2-4ad7-8f63-fdee5af4b1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:34.775080 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-4d2b7a83-1fc2-4ad7-8f63-fdee5af4b1a7 None None] MFA Rules not processed for user `932ccf4c79d5426fb875ed572d69f161`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:27:34.776342 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-4d2b7a83-1fc2-4ad7-8f63-fdee5af4b1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:34.810096 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65cd82-1753-4b8a-b4e4-8feedc76690b admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:34.842233 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 808/1608] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:27:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:27:34.845110 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60eaa8-31d4-4aca-ae35-68a39ec8ac6a None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:34.845422 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60eaa8-31d4-4aca-ae35-68a39ec8ac6a None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:34.845679 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60eaa8-31d4-4aca-ae35-68a39ec8ac6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:34.863709 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-4b60eaa8-31d4-4aca-ae35-68a39ec8ac6a None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:27:34.864917 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-4b60eaa8-31d4-4aca-ae35-68a39ec8ac6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:34.865965 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33415d1-b743-465c-9c3b-71e38a417e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:34.866893 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33415d1-b743-465c-9c3b-71e38a417e27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:34.867184 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33415d1-b743-465c-9c3b-71e38a417e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:34.867460 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33415d1-b743-465c-9c3b-71e38a417e27 admin admin] PATH_INFO: `/v3/projects/1e510320308c46b08fd88b221dfe59b3/users/a559bf12ba744f44a379d08a29d28932/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:34.875575 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 809/1609] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:27:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:27:34.875575 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b60eaa8-31d4-4aca-ae35-68a39ec8ac6a None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:34.881749 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33415d1-b743-465c-9c3b-71e38a417e27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e510320308c46b08fd88b221dfe59b3, user_id=a559bf12ba744f44a379d08a29d28932, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:34.884048 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b60eaa8-31d4-4aca-ae35-68a39ec8ac6a None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:34.884391 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33415d1-b743-465c-9c3b-71e38a417e27 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:34.888795 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e0d031-0d29-46ed-827a-259bf5e324af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:34.889673 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0d031-0d29-46ed-827a-259bf5e324af admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:34.889958 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0d031-0d29-46ed-827a-259bf5e324af admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:34.890233 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0d031-0d29-46ed-827a-259bf5e324af admin admin] PATH_INFO: `/v3/projects/751a6448e493479bbb67a5cb41731575/users/233e5678f55e44e1a9f0d06bdd6a6c45/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:34.904254 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e0d031-0d29-46ed-827a-259bf5e324af admin admin] RBAC: Authorizing `identity:create_grant(project_id=751a6448e493479bbb67a5cb41731575, user_id=233e5678f55e44e1a9f0d06bdd6a6c45, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:34.906964 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e0d031-0d29-46ed-827a-259bf5e324af admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:34.985907 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 801/1610] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:27:34 2022] PUT /identity/v3/projects/1e510320308c46b08fd88b221dfe59b3/users/a559bf12ba744f44a379d08a29d28932/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:27:34.988100 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80d709-3671-48e9-9bdd-1d526b5204bd None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:34.988385 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80d709-3671-48e9-9bdd-1d526b5204bd None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:34.988659 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80d709-3671-48e9-9bdd-1d526b5204bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:35.003362 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 810/1611] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:27:34 2022] PUT /identity/v3/projects/751a6448e493479bbb67a5cb41731575/users/233e5678f55e44e1a9f0d06bdd6a6c45/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:27:35.004543 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e0d031-0d29-46ed-827a-259bf5e324af admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:35.005184 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-8f80d709-3671-48e9-9bdd-1d526b5204bd None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:27:35.006389 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-8f80d709-3671-48e9-9bdd-1d526b5204bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:35.058118 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e0d031-0d29-46ed-827a-259bf5e324af admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:35.061756 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bbfb24-ff6b-469a-9f44-370eb7e67a8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:35.062402 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bbfb24-ff6b-469a-9f44-370eb7e67a8f service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:35.065683 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bbfb24-ff6b-469a-9f44-370eb7e67a8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:35.065824 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 802/1612] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:27:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:27:35.065957 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bbfb24-ff6b-469a-9f44-370eb7e67a8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:35.066062 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b538af-e4a1-4172-90b4-ad030608ee31 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:35.066062 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b538af-e4a1-4172-90b4-ad030608ee31 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:35.066062 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b538af-e4a1-4172-90b4-ad030608ee31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:35.075786 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bbfb24-ff6b-469a-9f44-370eb7e67a8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:35.077244 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bbfb24-ff6b-469a-9f44-370eb7e67a8f service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:35.082650 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-c2b538af-e4a1-4172-90b4-ad030608ee31 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:27:35.083867 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-c2b538af-e4a1-4172-90b4-ad030608ee31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:35.087107 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 811/1613] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:27:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:27:35.088350 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb6711-a50c-42fc-98cc-158094434d5b None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:35.088638 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb6711-a50c-42fc-98cc-158094434d5b None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:35.088914 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb6711-a50c-42fc-98cc-158094434d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:35.091854 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 803/1614] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:27:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:27:35.093413 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baaba79-4383-4d71-8213-5cadc1292b46 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:35.093705 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baaba79-4383-4d71-8213-5cadc1292b46 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:35.093986 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baaba79-4383-4d71-8213-5cadc1292b46 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:35.095674 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 804/1615] 10.222.0.24 () {54 vars in 960 bytes} [Thu Apr 7 06:27:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:27:35.096362 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baaba79-4383-4d71-8213-5cadc1292b46 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:35.114122 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baaba79-4383-4d71-8213-5cadc1292b46 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:35.118078 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145bc4d-ab7c-4d2e-b98b-7b1e5798c26d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:35.118727 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145bc4d-ab7c-4d2e-b98b-7b1e5798c26d service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:35.118831 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-10bb6711-a50c-42fc-98cc-158094434d5b None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:27:35.119015 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145bc4d-ab7c-4d2e-b98b-7b1e5798c26d service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:35.119297 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145bc4d-ab7c-4d2e-b98b-7b1e5798c26d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:35.120038 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-10bb6711-a50c-42fc-98cc-158094434d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:35.128268 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 812/1616] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:27:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:27:35.129501 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f37f3-e51f-4388-88f4-2c427ec9a722 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:35.129759 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f145bc4d-ab7c-4d2e-b98b-7b1e5798c26d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:35.129886 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f37f3-e51f-4388-88f4-2c427ec9a722 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:35.130054 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f37f3-e51f-4388-88f4-2c427ec9a722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:35.132363 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f145bc4d-ab7c-4d2e-b98b-7b1e5798c26d service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:35.142343 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 805/1617] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:27:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:27:35.143040 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145bc4d-ab7c-4d2e-b98b-7b1e5798c26d service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:35.152689 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145bc4d-ab7c-4d2e-b98b-7b1e5798c26d service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:35.157488 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b09ed5-43ba-433c-950a-b79cc93c42cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:35.158212 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b09ed5-43ba-433c-950a-b79cc93c42cb admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:35.158497 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b09ed5-43ba-433c-950a-b79cc93c42cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:35.158769 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b09ed5-43ba-433c-950a-b79cc93c42cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:35.159267 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-2c1f37f3-e51f-4388-88f4-2c427ec9a722 None None] MFA Rules not processed for user `a559bf12ba744f44a379d08a29d28932`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:27:35.159497 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b09ed5-43ba-433c-950a-b79cc93c42cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:35.160643 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-2c1f37f3-e51f-4388-88f4-2c427ec9a722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:35.161436 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b09ed5-43ba-433c-950a-b79cc93c42cb admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:35.174931 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 806/1618] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:27:35.174931 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b09ed5-43ba-433c-950a-b79cc93c42cb admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:35.184118 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b09ed5-43ba-433c-950a-b79cc93c42cb admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:35.188472 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc0410-fabc-46b2-96a5-d1e9dff71f20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:35.189752 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc0410-fabc-46b2-96a5-d1e9dff71f20 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:35.189955 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc0410-fabc-46b2-96a5-d1e9dff71f20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:35.190267 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc0410-fabc-46b2-96a5-d1e9dff71f20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:35.201436 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bc0410-fabc-46b2-96a5-d1e9dff71f20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:35.202978 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bc0410-fabc-46b2-96a5-d1e9dff71f20 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:35.213687 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 807/1619] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:27:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:27:35.214559 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc0410-fabc-46b2-96a5-d1e9dff71f20 service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:35.215923 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-80bc0410-fabc-46b2-96a5-d1e9dff71f20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:35.226919 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc0410-fabc-46b2-96a5-d1e9dff71f20 service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:35.230829 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f14590-adf2-4041-888f-cbae4d9426c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:35.231346 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f14590-adf2-4041-888f-cbae4d9426c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:35.231635 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f14590-adf2-4041-888f-cbae4d9426c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:35.231946 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f14590-adf2-4041-888f-cbae4d9426c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:35.240130 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 813/1620] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:27:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:27:35.241573 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed62d9-baf6-4b0d-aed6-b167f5a2eb36 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:35.241862 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed62d9-baf6-4b0d-aed6-b167f5a2eb36 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:35.242149 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed62d9-baf6-4b0d-aed6-b167f5a2eb36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:35.248192 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f14590-adf2-4041-888f-cbae4d9426c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:35.250022 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f14590-adf2-4041-888f-cbae4d9426c0 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:35.261535 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 808/1621] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:27:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:27:35.262227 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f14590-adf2-4041-888f-cbae4d9426c0 service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:35.263010 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-d1ed62d9-baf6-4b0d-aed6-b167f5a2eb36 None None] MFA Rules not processed for user `02cd81f6620f410db450871fb29961f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:27:35.264295 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d1ed62d9-baf6-4b0d-aed6-b167f5a2eb36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:35.271371 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f14590-adf2-4041-888f-cbae4d9426c0 service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:35.275577 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2cfa1-cfc1-424c-ad57-66c6586d82cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:35.276314 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2cfa1-cfc1-424c-ad57-66c6586d82cc service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:35.276594 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2cfa1-cfc1-424c-ad57-66c6586d82cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:35.276877 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2cfa1-cfc1-424c-ad57-66c6586d82cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:35.287583 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e2cfa1-cfc1-424c-ad57-66c6586d82cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:35.289224 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e2cfa1-cfc1-424c-ad57-66c6586d82cc service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:35.300615 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 809/1622] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:27:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:27:35.301588 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2cfa1-cfc1-424c-ad57-66c6586d82cc service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:35.311198 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2cfa1-cfc1-424c-ad57-66c6586d82cc service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:35.318359 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757708ba-07e6-475f-a8ad-3a3cc4e1066b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:35.319265 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757708ba-07e6-475f-a8ad-3a3cc4e1066b admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:35.322079 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757708ba-07e6-475f-a8ad-3a3cc4e1066b admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:35.322079 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757708ba-07e6-475f-a8ad-3a3cc4e1066b admin admin] PATH_INFO: `/v3/projects/751a6448e493479bbb67a5cb41731575/users/233e5678f55e44e1a9f0d06bdd6a6c45/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:35.324201 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757708ba-07e6-475f-a8ad-3a3cc4e1066b admin admin] RBAC: Authorizing `identity:create_grant(project_id=751a6448e493479bbb67a5cb41731575, user_id=233e5678f55e44e1a9f0d06bdd6a6c45, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:35.328404 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757708ba-07e6-475f-a8ad-3a3cc4e1066b admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:35.351809 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 810/1623] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:27:35 2022] PUT /identity/v3/projects/751a6448e493479bbb67a5cb41731575/users/233e5678f55e44e1a9f0d06bdd6a6c45/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:27:35.351809 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757708ba-07e6-475f-a8ad-3a3cc4e1066b admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:35.370836 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 814/1624] 10.222.0.24 () {58 vars in 1057 bytes} [Thu Apr 7 06:27:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:27:35.373089 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90fc725-d6eb-45ad-8708-3c3048e644ef None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:35.373539 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90fc725-d6eb-45ad-8708-3c3048e644ef None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:35.373984 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90fc725-d6eb-45ad-8708-3c3048e644ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:35.413966 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-f90fc725-d6eb-45ad-8708-3c3048e644ef None None] MFA Rules not processed for user `233e5678f55e44e1a9f0d06bdd6a6c45`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:27:35.415891 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f90fc725-d6eb-45ad-8708-3c3048e644ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:35.437799 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757708ba-07e6-475f-a8ad-3a3cc4e1066b admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:35.447942 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2f45d6-9b1b-4302-9be5-cec7b1129e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:35.447942 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f45d6-9b1b-4302-9be5-cec7b1129e90 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:35.447942 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f45d6-9b1b-4302-9be5-cec7b1129e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:35.447942 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f45d6-9b1b-4302-9be5-cec7b1129e90 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:35.448285 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2f45d6-9b1b-4302-9be5-cec7b1129e90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:35.450048 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2f45d6-9b1b-4302-9be5-cec7b1129e90 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:35.500349 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 815/1625] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:27:35 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:27:35.501345 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90fc725-d6eb-45ad-8708-3c3048e644ef None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:35.547933 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 811/1626] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:27:35 2022] POST /identity/v3/projects => generated 371 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:27:35.547933 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2f45d6-9b1b-4302-9be5-cec7b1129e90 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:35.586501 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90fc725-d6eb-45ad-8708-3c3048e644ef None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:35.624964 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2f45d6-9b1b-4302-9be5-cec7b1129e90 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:35.629719 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df2f58-458d-4a45-b358-be21dd4a13a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:35.630446 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df2f58-458d-4a45-b358-be21dd4a13a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:35.640651 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df2f58-458d-4a45-b358-be21dd4a13a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:35.640651 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df2f58-458d-4a45-b358-be21dd4a13a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:35.660989 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ebe4d-ff6f-4bfb-8326-dfc0d5e04637 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cd81f6620f410db450871fb29961f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:35.661973 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ebe4d-ff6f-4bfb-8326-dfc0d5e04637 service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:35.662265 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ebe4d-ff6f-4bfb-8326-dfc0d5e04637 service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:35.662855 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ebe4d-ff6f-4bfb-8326-dfc0d5e04637 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:35.705783 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3df2f58-458d-4a45-b358-be21dd4a13a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:35.707292 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3df2f58-458d-4a45-b358-be21dd4a13a2 service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:35.718553 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 812/1627] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:27:35 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:27:35.728946 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223ebe4d-ff6f-4bfb-8326-dfc0d5e04637 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:35.730067 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df2f58-458d-4a45-b358-be21dd4a13a2 service cinder] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:35.730717 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223ebe4d-ff6f-4bfb-8326-dfc0d5e04637 service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:35.741824 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 816/1628] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:27:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:27:35.836988 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df2f58-458d-4a45-b358-be21dd4a13a2 service cinder] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:35.841612 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7bada-0794-41f0-86b6-0931202c9323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:35.842293 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7bada-0794-41f0-86b6-0931202c9323 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:35.842580 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7bada-0794-41f0-86b6-0931202c9323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:35.846114 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7bada-0794-41f0-86b6-0931202c9323 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:35.846114 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c7bada-0794-41f0-86b6-0931202c9323 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:35.846114 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c7bada-0794-41f0-86b6-0931202c9323 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:35.975463 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 813/1629] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:27:35 2022] POST /identity/v3/users => generated 292 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:27:35.979779 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ebe4d-ff6f-4bfb-8326-dfc0d5e04637 service nova] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:35.996554 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ebe4d-ff6f-4bfb-8326-dfc0d5e04637 service nova] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:36.015600 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6dcb0b-a36e-4d40-b5b8-867528b0c2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:36.016345 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6dcb0b-a36e-4d40-b5b8-867528b0c2b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:36.016634 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6dcb0b-a36e-4d40-b5b8-867528b0c2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:36.016912 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6dcb0b-a36e-4d40-b5b8-867528b0c2b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:36.018721 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6dcb0b-a36e-4d40-b5b8-867528b0c2b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:36.020295 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6dcb0b-a36e-4d40-b5b8-867528b0c2b6 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:36.058598 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 817/1630] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:27:36.062451 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7bada-0794-41f0-86b6-0931202c9323 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:36.072337 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817354b-0c71-4c0d-b39d-1794253c62d9 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:36.078690 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817354b-0c71-4c0d-b39d-1794253c62d9 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:36.078690 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817354b-0c71-4c0d-b39d-1794253c62d9 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:36.078690 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 818/1631] 10.222.0.24 () {54 vars in 912 bytes} [Thu Apr 7 06:27:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 07 06:27:36.081765 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7bada-0794-41f0-86b6-0931202c9323 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:36.083017 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e9044d-05f3-42ea-8737-256e2a01e3c2 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:36.083531 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e9044d-05f3-42ea-8737-256e2a01e3c2 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:36.084213 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e9044d-05f3-42ea-8737-256e2a01e3c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:36.107572 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce987101-4699-46b0-b655-4b2da437c2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:36.112564 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce987101-4699-46b0-b655-4b2da437c2ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:36.113461 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce987101-4699-46b0-b655-4b2da437c2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:36.116580 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce987101-4699-46b0-b655-4b2da437c2ae admin admin] PATH_INFO: `/v3/projects/7d5c26ec071c4c0ca925c6f74dc6386b/users/8b97090f91db4fff9359ef70a06ad968/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:36.125599 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-69e9044d-05f3-42ea-8737-256e2a01e3c2 None None] MFA Rules not processed for user `02cd81f6620f410db450871fb29961f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:27:36.125599 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-69e9044d-05f3-42ea-8737-256e2a01e3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:36.145271 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce987101-4699-46b0-b655-4b2da437c2ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d5c26ec071c4c0ca925c6f74dc6386b, user_id=8b97090f91db4fff9359ef70a06ad968, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:36.159942 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 819/1632] 10.222.0.24 () {58 vars in 1009 bytes} [Thu Apr 7 06:27:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:27:36.160159 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce987101-4699-46b0-b655-4b2da437c2ae admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:36.171245 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e9044d-05f3-42ea-8737-256e2a01e3c2 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:36.188346 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e9044d-05f3-42ea-8737-256e2a01e3c2 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:36.188802 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681e726c-9788-4b9a-9f26-2449cff3da2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:36.190208 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e726c-9788-4b9a-9f26-2449cff3da2a service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:36.190674 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e726c-9788-4b9a-9f26-2449cff3da2a service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:36.191139 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e726c-9788-4b9a-9f26-2449cff3da2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:36.202591 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681e726c-9788-4b9a-9f26-2449cff3da2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:36.204515 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681e726c-9788-4b9a-9f26-2449cff3da2a service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:36.230893 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 820/1633] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:27:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 07 06:27:36.252206 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 814/1634] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:27:36 2022] PUT /identity/v3/projects/7d5c26ec071c4c0ca925c6f74dc6386b/users/8b97090f91db4fff9359ef70a06ad968/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:27:36.259713 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681e726c-9788-4b9a-9f26-2449cff3da2a service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:36.272931 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681e726c-9788-4b9a-9f26-2449cff3da2a service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:36.347251 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d2b7d-2e7e-4a8f-bada-53b86829cbc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:36.348221 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d2b7d-2e7e-4a8f-bada-53b86829cbc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:36.348578 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d2b7d-2e7e-4a8f-bada-53b86829cbc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:36.348994 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d2b7d-2e7e-4a8f-bada-53b86829cbc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:36.349801 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158d2b7d-2e7e-4a8f-bada-53b86829cbc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:36.352627 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158d2b7d-2e7e-4a8f-bada-53b86829cbc3 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:36.369934 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 821/1635] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:27:36.370566 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce987101-4699-46b0-b655-4b2da437c2ae admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:36.383526 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce987101-4699-46b0-b655-4b2da437c2ae admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:36.397494 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19da16ec-4270-4cba-8e0e-8f4d3ba92a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:36.400408 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da16ec-4270-4cba-8e0e-8f4d3ba92a05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:36.400408 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da16ec-4270-4cba-8e0e-8f4d3ba92a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:36.400408 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da16ec-4270-4cba-8e0e-8f4d3ba92a05 admin admin] PATH_INFO: `/v3/projects/7d5c26ec071c4c0ca925c6f74dc6386b/users/8b97090f91db4fff9359ef70a06ad968/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:36.406626 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19da16ec-4270-4cba-8e0e-8f4d3ba92a05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d5c26ec071c4c0ca925c6f74dc6386b, user_id=8b97090f91db4fff9359ef70a06ad968, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:36.411422 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19da16ec-4270-4cba-8e0e-8f4d3ba92a05 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:36.439873 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 815/1636] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:27:36 2022] PUT /identity/v3/projects/7d5c26ec071c4c0ca925c6f74dc6386b/users/8b97090f91db4fff9359ef70a06ad968/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:27:36.451574 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513e0bb-fbbd-40a5-8370-0dea68671728 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:36.451574 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513e0bb-fbbd-40a5-8370-0dea68671728 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:36.451937 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513e0bb-fbbd-40a5-8370-0dea68671728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:36.522299 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-2513e0bb-fbbd-40a5-8370-0dea68671728 None None] MFA Rules not processed for user `8b97090f91db4fff9359ef70a06ad968`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:27:36.523801 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-2513e0bb-fbbd-40a5-8370-0dea68671728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:36.649945 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 822/1637] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:27:36 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:27:36.766524 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19da16ec-4270-4cba-8e0e-8f4d3ba92a05 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:36.831292 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19da16ec-4270-4cba-8e0e-8f4d3ba92a05 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:36.835999 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8936ed-ebba-4a80-b671-7244da3930b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:36.836766 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8936ed-ebba-4a80-b671-7244da3930b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:36.837117 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8936ed-ebba-4a80-b671-7244da3930b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:36.837466 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8936ed-ebba-4a80-b671-7244da3930b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:36.848454 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8936ed-ebba-4a80-b671-7244da3930b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:36.849984 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8936ed-ebba-4a80-b671-7244da3930b8 service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:36.867308 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 816/1638] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:27:36 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:27:37.496743 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a327a7-bbed-4864-9e5e-38c4b1a42a14 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:37.497271 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a327a7-bbed-4864-9e5e-38c4b1a42a14 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:37.497375 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a327a7-bbed-4864-9e5e-38c4b1a42a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:37.588253 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-76a327a7-bbed-4864-9e5e-38c4b1a42a14 None None] MFA Rules not processed for user `3cab2e53c1a44d9eab8a55a4223c787f`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:27:37.593682 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-76a327a7-bbed-4864-9e5e-38c4b1a42a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:37.743984 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 823/1639] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:27:37 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:27:37.749609 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8936ed-ebba-4a80-b671-7244da3930b8 service cinder] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:37.772213 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6567a68f-5706-46e9-ae52-8ef65d6386e6 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:37.773914 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6567a68f-5706-46e9-ae52-8ef65d6386e6 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:37.774092 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6567a68f-5706-46e9-ae52-8ef65d6386e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:37.860701 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-6567a68f-5706-46e9-ae52-8ef65d6386e6 None None] MFA Rules not processed for user `5a3762215c1d48159d160625fe9d8dce`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:27:37.865150 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-6567a68f-5706-46e9-ae52-8ef65d6386e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:37.883659 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8936ed-ebba-4a80-b671-7244da3930b8 service cinder] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:37.896184 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649cb58-87e6-437e-af9f-311313008423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:37.896864 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649cb58-87e6-437e-af9f-311313008423 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:37.905836 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649cb58-87e6-437e-af9f-311313008423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:37.905836 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649cb58-87e6-437e-af9f-311313008423 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:37.905836 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c649cb58-87e6-437e-af9f-311313008423 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:37.905836 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c649cb58-87e6-437e-af9f-311313008423 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:38.019826 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 824/1640] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:27:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:27:38.035170 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15583199-41c1-4754-bbdf-661d232607f5 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:38.035463 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15583199-41c1-4754-bbdf-661d232607f5 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:38.035695 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15583199-41c1-4754-bbdf-661d232607f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:38.053097 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 817/1641] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:27:37 2022] POST /identity/v3/projects => generated 405 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:27:38.059668 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649cb58-87e6-437e-af9f-311313008423 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:38.061248 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-15583199-41c1-4754-bbdf-661d232607f5 None None] MFA Rules not processed for user `5a3762215c1d48159d160625fe9d8dce`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:27:38.062824 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-15583199-41c1-4754-bbdf-661d232607f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:38.129246 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 825/1642] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:27:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:27:38.133267 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f971650-c86a-49bb-9020-7ac38d6095bc None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:38.133584 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f971650-c86a-49bb-9020-7ac38d6095bc None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:38.133835 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f971650-c86a-49bb-9020-7ac38d6095bc None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:38.145408 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 826/1643] 10.222.0.24 () {54 vars in 960 bytes} [Thu Apr 7 06:27:38 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:27:38.145408 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f971650-c86a-49bb-9020-7ac38d6095bc None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:38.217269 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649cb58-87e6-437e-af9f-311313008423 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:38.223695 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e5e9dd-5f36-4193-87e4-dedfdbac8dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:38.224775 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e5e9dd-5f36-4193-87e4-dedfdbac8dac admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:38.225313 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e5e9dd-5f36-4193-87e4-dedfdbac8dac admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:38.226458 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e5e9dd-5f36-4193-87e4-dedfdbac8dac admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:38.227507 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e5e9dd-5f36-4193-87e4-dedfdbac8dac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:38.229756 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e5e9dd-5f36-4193-87e4-dedfdbac8dac admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:38.272938 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f971650-c86a-49bb-9020-7ac38d6095bc None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:38.278712 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef68ba-f683-4434-af05-4b7574c18298 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cd81f6620f410db450871fb29961f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:38.279383 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef68ba-f683-4434-af05-4b7574c18298 service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:38.279689 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef68ba-f683-4434-af05-4b7574c18298 service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:38.279984 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef68ba-f683-4434-af05-4b7574c18298 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:38.289373 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddef68ba-f683-4434-af05-4b7574c18298 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:38.291156 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddef68ba-f683-4434-af05-4b7574c18298 service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:38.301399 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 827/1644] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:27:38 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:27:38.302707 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293d0b0-b249-4074-837b-88c55bbbf047 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:38.303006 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293d0b0-b249-4074-837b-88c55bbbf047 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:38.303296 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293d0b0-b249-4074-837b-88c55bbbf047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:38.323984 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-4293d0b0-b249-4074-837b-88c55bbbf047 None None] MFA Rules not processed for user `02cd81f6620f410db450871fb29961f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:27:38.325199 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-4293d0b0-b249-4074-837b-88c55bbbf047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:38.344768 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 828/1645] 10.222.0.24 () {58 vars in 1057 bytes} [Thu Apr 7 06:27:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:27:38.346835 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d14ea-9252-46ee-8794-cb3987a8fb3f None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:38.347564 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d14ea-9252-46ee-8794-cb3987a8fb3f None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:38.347564 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d14ea-9252-46ee-8794-cb3987a8fb3f None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:38.353336 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 818/1646] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:27:38 2022] POST /identity/v3/users => generated 309 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:27:38.358584 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d16ab-66ba-420f-a18e-718a2cf04984 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:38.358731 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 829/1647] 10.222.0.24 () {54 vars in 912 bytes} [Thu Apr 7 06:27:38 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:27:38.358827 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d16ab-66ba-420f-a18e-718a2cf04984 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:38.358827 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d16ab-66ba-420f-a18e-718a2cf04984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:38.358993 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d14ea-9252-46ee-8794-cb3987a8fb3f None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:38.383285 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d14ea-9252-46ee-8794-cb3987a8fb3f None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:38.389127 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06653ec9-a141-4d3c-b24b-27a8bd4c87ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:38.389821 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06653ec9-a141-4d3c-b24b-27a8bd4c87ef admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:38.390332 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06653ec9-a141-4d3c-b24b-27a8bd4c87ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:38.390869 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06653ec9-a141-4d3c-b24b-27a8bd4c87ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:38.391954 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06653ec9-a141-4d3c-b24b-27a8bd4c87ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:38.394309 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06653ec9-a141-4d3c-b24b-27a8bd4c87ef admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:38.415130 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 830/1648] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:27:38.416263 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06653ec9-a141-4d3c-b24b-27a8bd4c87ef admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:38.419258 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-756d16ab-66ba-420f-a18e-718a2cf04984 None None] MFA Rules not processed for user `02cd81f6620f410db450871fb29961f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:27:38.420684 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-756d16ab-66ba-420f-a18e-718a2cf04984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:38.444896 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 819/1649] 10.222.0.24 () {58 vars in 1009 bytes} [Thu Apr 7 06:27:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:27:38.446671 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06653ec9-a141-4d3c-b24b-27a8bd4c87ef admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:38.460150 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d16ab-66ba-420f-a18e-718a2cf04984 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:38.472006 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04845e52-af87-4bf4-9e27-659abe85a978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:38.472916 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04845e52-af87-4bf4-9e27-659abe85a978 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:38.473671 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04845e52-af87-4bf4-9e27-659abe85a978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:38.473671 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04845e52-af87-4bf4-9e27-659abe85a978 admin admin] PATH_INFO: `/v3/projects/7fd0e568dcf24a26b61ef6b2ef16496c/users/904f18109a1d45579e433ea6c246741c/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:38.513637 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04845e52-af87-4bf4-9e27-659abe85a978 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fd0e568dcf24a26b61ef6b2ef16496c, user_id=904f18109a1d45579e433ea6c246741c, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:38.516365 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04845e52-af87-4bf4-9e27-659abe85a978 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:38.592582 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d16ab-66ba-420f-a18e-718a2cf04984 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:38.596943 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b666a7-3f7e-46d5-94f3-4eeecb68e3d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:38.597693 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b666a7-3f7e-46d5-94f3-4eeecb68e3d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:38.598670 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b666a7-3f7e-46d5-94f3-4eeecb68e3d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:38.598670 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b666a7-3f7e-46d5-94f3-4eeecb68e3d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:38.610123 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b666a7-3f7e-46d5-94f3-4eeecb68e3d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:38.611711 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b666a7-3f7e-46d5-94f3-4eeecb68e3d1 service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:38.625391 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 820/1650] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:27:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:27:38.626240 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 831/1651] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:27:38 2022] PUT /identity/v3/projects/7fd0e568dcf24a26b61ef6b2ef16496c/users/904f18109a1d45579e433ea6c246741c/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:27:38.629854 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b666a7-3f7e-46d5-94f3-4eeecb68e3d1 service cinder] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:38.630680 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04845e52-af87-4bf4-9e27-659abe85a978 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:38.641394 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b666a7-3f7e-46d5-94f3-4eeecb68e3d1 service cinder] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:38.765109 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04845e52-af87-4bf4-9e27-659abe85a978 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:38.773811 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a3d0b-78d7-47f7-8e19-a0dd21a59f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:38.774931 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a3d0b-78d7-47f7-8e19-a0dd21a59f6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:38.775224 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a3d0b-78d7-47f7-8e19-a0dd21a59f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:38.775505 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a3d0b-78d7-47f7-8e19-a0dd21a59f6c admin admin] PATH_INFO: `/v3/users/a559bf12ba744f44a379d08a29d28932` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:38.780102 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043a3d0b-78d7-47f7-8e19-a0dd21a59f6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a559bf12ba744f44a379d08a29d28932)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:38.782291 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: WARNING py.warnings [None req-043a3d0b-78d7-47f7-8e19-a0dd21a59f6c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 07 06:27:38.782291 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: warnings.warn(msg) Apr 07 06:27:38.782291 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: Apr 07 06:27:38.784673 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043a3d0b-78d7-47f7-8e19-a0dd21a59f6c admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:38.785549 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56643c3b-43a5-46d7-9ae8-e5e61608871c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:38.787913 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56643c3b-43a5-46d7-9ae8-e5e61608871c admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:38.788527 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56643c3b-43a5-46d7-9ae8-e5e61608871c admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:38.788862 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56643c3b-43a5-46d7-9ae8-e5e61608871c admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:38.790192 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56643c3b-43a5-46d7-9ae8-e5e61608871c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:38.791762 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56643c3b-43a5-46d7-9ae8-e5e61608871c admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:38.826347 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 832/1652] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 07 06:27:38.831369 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56643c3b-43a5-46d7-9ae8-e5e61608871c admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:38.855406 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56643c3b-43a5-46d7-9ae8-e5e61608871c admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:38.869643 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f621618f-b7d1-4df0-8d9c-ee4528da59e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:38.870614 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621618f-b7d1-4df0-8d9c-ee4528da59e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:38.870894 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621618f-b7d1-4df0-8d9c-ee4528da59e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:38.871192 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621618f-b7d1-4df0-8d9c-ee4528da59e8 admin admin] PATH_INFO: `/v3/projects/7fd0e568dcf24a26b61ef6b2ef16496c/users/904f18109a1d45579e433ea6c246741c/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:38.874650 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f621618f-b7d1-4df0-8d9c-ee4528da59e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fd0e568dcf24a26b61ef6b2ef16496c, user_id=904f18109a1d45579e433ea6c246741c, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:38.884286 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f621618f-b7d1-4df0-8d9c-ee4528da59e8 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:38.904897 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 833/1653] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:27:38 2022] PUT /identity/v3/projects/7fd0e568dcf24a26b61ef6b2ef16496c/users/904f18109a1d45579e433ea6c246741c/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:27:39.136687 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-043a3d0b-78d7-47f7-8e19-a0dd21a59f6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a559bf12ba744f44a379d08a29d28932'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:39.137722 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-043a3d0b-78d7-47f7-8e19-a0dd21a59f6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a559bf12ba744f44a379d08a29d28932'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:39.288608 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-043a3d0b-78d7-47f7-8e19-a0dd21a59f6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a559bf12ba744f44a379d08a29d28932'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:39.289470 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-043a3d0b-78d7-47f7-8e19-a0dd21a59f6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a559bf12ba744f44a379d08a29d28932'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:39.328334 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-043a3d0b-78d7-47f7-8e19-a0dd21a59f6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a559bf12ba744f44a379d08a29d28932'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:39.339265 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df7db0-4e81-4e26-8bbd-d1cb82a412d9 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:39.339265 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df7db0-4e81-4e26-8bbd-d1cb82a412d9 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:39.339265 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df7db0-4e81-4e26-8bbd-d1cb82a412d9 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:39.339974 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 834/1654] 10.222.0.24 () {54 vars in 912 bytes} [Thu Apr 7 06:27:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 07 06:27:39.352842 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3fb3f-c13d-4cb8-a6f1-337e48a41165 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:39.353139 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3fb3f-c13d-4cb8-a6f1-337e48a41165 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:39.353419 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3fb3f-c13d-4cb8-a6f1-337e48a41165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:39.365065 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 821/1655] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:27:38 2022] DELETE /identity/v3/users/a559bf12ba744f44a379d08a29d28932 => generated 0 bytes in 739 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:27:39.374376 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d2b1fc-23b7-43ff-a6ed-a7ec727b1b7f None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:39.374679 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d2b1fc-23b7-43ff-a6ed-a7ec727b1b7f None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:39.374968 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d2b1fc-23b7-43ff-a6ed-a7ec727b1b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:39.413951 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-d4d2b1fc-23b7-43ff-a6ed-a7ec727b1b7f None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:27:39.416985 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d4d2b1fc-23b7-43ff-a6ed-a7ec727b1b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:39.427076 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-bcc3fb3f-c13d-4cb8-a6f1-337e48a41165 None None] MFA Rules not processed for user `bb7f549fd26e4642828d4f476aef0239`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:27:39.428387 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-bcc3fb3f-c13d-4cb8-a6f1-337e48a41165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:39.531807 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 835/1656] 10.222.0.24 () {58 vars in 1009 bytes} [Thu Apr 7 06:27:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:27:39.565821 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 822/1657] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:27:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:27:39.587028 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc3fb3f-c13d-4cb8-a6f1-337e48a41165 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:39.587585 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d2b1fc-23b7-43ff-a6ed-a7ec727b1b7f None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:39.589746 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-bcc3fb3f-c13d-4cb8-a6f1-337e48a41165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:39.590558 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d4d2b1fc-23b7-43ff-a6ed-a7ec727b1b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:39.608594 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d2b1fc-23b7-43ff-a6ed-a7ec727b1b7f None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:39.611136 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc3fb3f-c13d-4cb8-a6f1-337e48a41165 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:39.615259 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f64b0-0e03-4b2f-957d-ce066cf3bcdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:39.616525 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f64b0-0e03-4b2f-957d-ce066cf3bcdb service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:39.616825 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f64b0-0e03-4b2f-957d-ce066cf3bcdb service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:39.616934 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2337cc-94e4-45de-8184-a9042930dfa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:39.617106 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f64b0-0e03-4b2f-957d-ce066cf3bcdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:39.617941 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2337cc-94e4-45de-8184-a9042930dfa3 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:39.618409 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2337cc-94e4-45de-8184-a9042930dfa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:39.618874 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2337cc-94e4-45de-8184-a9042930dfa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:39.635191 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2337cc-94e4-45de-8184-a9042930dfa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:39.637112 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2337cc-94e4-45de-8184-a9042930dfa3 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:39.649975 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9f64b0-0e03-4b2f-957d-ce066cf3bcdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:39.652353 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9f64b0-0e03-4b2f-957d-ce066cf3bcdb service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:39.656459 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 836/1658] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:27:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:27:39.699105 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 823/1659] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:27:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:27:40.312307 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2337cc-94e4-45de-8184-a9042930dfa3 service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:40.314409 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-3e2337cc-94e4-45de-8184-a9042930dfa3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:40.355238 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2337cc-94e4-45de-8184-a9042930dfa3 service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:40.367913 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7414fa5d-afb1-44ae-8209-06f3fc89497a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:40.368821 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414fa5d-afb1-44ae-8209-06f3fc89497a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:40.369109 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414fa5d-afb1-44ae-8209-06f3fc89497a admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:40.372065 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414fa5d-afb1-44ae-8209-06f3fc89497a admin admin] PATH_INFO: `/v3/users/a9668afac17d443bb92653ddaf28f971` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:40.381576 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7414fa5d-afb1-44ae-8209-06f3fc89497a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9668afac17d443bb92653ddaf28f971)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:40.386675 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7414fa5d-afb1-44ae-8209-06f3fc89497a admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:40.708441 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7414fa5d-afb1-44ae-8209-06f3fc89497a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9668afac17d443bb92653ddaf28f971'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:40.724428 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7414fa5d-afb1-44ae-8209-06f3fc89497a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9668afac17d443bb92653ddaf28f971'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:40.765626 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e72cb-0a73-4e72-8d00-3ab2c739918e None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:40.766922 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e72cb-0a73-4e72-8d00-3ab2c739918e None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:40.768347 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e72cb-0a73-4e72-8d00-3ab2c739918e None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:40.770655 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 824/1660] 10.222.0.24 () {54 vars in 960 bytes} [Thu Apr 7 06:27:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:27:40.780461 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05daca58-f574-4b45-a1ef-a15d1ce93384 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:40.780972 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05daca58-f574-4b45-a1ef-a15d1ce93384 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:40.781429 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05daca58-f574-4b45-a1ef-a15d1ce93384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:40.839713 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-05daca58-f574-4b45-a1ef-a15d1ce93384 None None] MFA Rules not processed for user `ff35b68665724754a6413bca0030016f`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:27:40.841229 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7414fa5d-afb1-44ae-8209-06f3fc89497a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9668afac17d443bb92653ddaf28f971'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:40.842034 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-05daca58-f574-4b45-a1ef-a15d1ce93384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:40.847807 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7414fa5d-afb1-44ae-8209-06f3fc89497a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9668afac17d443bb92653ddaf28f971'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:40.848707 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7414fa5d-afb1-44ae-8209-06f3fc89497a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9668afac17d443bb92653ddaf28f971'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:40.873815 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 837/1661] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:27:40 2022] DELETE /identity/v3/users/a9668afac17d443bb92653ddaf28f971 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:27:40.875783 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5fdc5e-8d79-4721-9d5b-10230a93d2ad None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:40.881632 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5fdc5e-8d79-4721-9d5b-10230a93d2ad None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:40.881632 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5fdc5e-8d79-4721-9d5b-10230a93d2ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:40.922560 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-bb5fdc5e-8d79-4721-9d5b-10230a93d2ad None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:27:40.929095 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-bb5fdc5e-8d79-4721-9d5b-10230a93d2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:40.992838 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 825/1662] 10.222.0.24 () {58 vars in 1057 bytes} [Thu Apr 7 06:27:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:27:41.003534 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05daca58-f574-4b45-a1ef-a15d1ce93384 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:41.024050 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05daca58-f574-4b45-a1ef-a15d1ce93384 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:41.116066 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 838/1663] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:27:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:27:41.131106 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5fdc5e-8d79-4721-9d5b-10230a93d2ad None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:41.133460 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-bb5fdc5e-8d79-4721-9d5b-10230a93d2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:41.216620 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24999aa1-ea54-4d3b-b63b-3810fc96e622 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff35b68665724754a6413bca0030016f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:41.218284 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24999aa1-ea54-4d3b-b63b-3810fc96e622 service placement] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:41.219429 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24999aa1-ea54-4d3b-b63b-3810fc96e622 service placement] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:41.219893 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24999aa1-ea54-4d3b-b63b-3810fc96e622 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:41.226168 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-24999aa1-ea54-4d3b-b63b-3810fc96e622 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:41.272030 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24999aa1-ea54-4d3b-b63b-3810fc96e622 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:41.274089 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24999aa1-ea54-4d3b-b63b-3810fc96e622 service placement] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:41.282936 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5fdc5e-8d79-4721-9d5b-10230a93d2ad None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:41.294109 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d6983-d1b3-4deb-b559-9252ac227ae5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:41.294638 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 826/1664] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:27:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 07 06:27:41.295543 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d6983-d1b3-4deb-b559-9252ac227ae5 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:41.296106 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d6983-d1b3-4deb-b559-9252ac227ae5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:41.297087 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d6983-d1b3-4deb-b559-9252ac227ae5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:41.340404 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83d6983-d1b3-4deb-b559-9252ac227ae5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:41.344242 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83d6983-d1b3-4deb-b559-9252ac227ae5 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:41.376587 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 839/1665] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:27:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:27:41.521869 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24999aa1-ea54-4d3b-b63b-3810fc96e622 service placement] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:41.523283 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-24999aa1-ea54-4d3b-b63b-3810fc96e622 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:41.551702 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d6983-d1b3-4deb-b559-9252ac227ae5 service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:41.553123 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a83d6983-d1b3-4deb-b559-9252ac227ae5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:41.570020 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24999aa1-ea54-4d3b-b63b-3810fc96e622 service placement] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:41.605000 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d6983-d1b3-4deb-b559-9252ac227ae5 service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:41.606400 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b81389-04fe-412b-a1ad-83833b6f4846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:41.607631 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b81389-04fe-412b-a1ad-83833b6f4846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:41.607949 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b81389-04fe-412b-a1ad-83833b6f4846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:41.608243 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b81389-04fe-412b-a1ad-83833b6f4846 admin admin] PATH_INFO: `/v3/projects/1e510320308c46b08fd88b221dfe59b3` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:41.609862 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b81389-04fe-412b-a1ad-83833b6f4846 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e510320308c46b08fd88b221dfe59b3)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:41.611896 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b81389-04fe-412b-a1ad-83833b6f4846 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:41.621158 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae648e3-c1ac-4a57-acd6-ca8a2488d747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:41.622241 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae648e3-c1ac-4a57-acd6-ca8a2488d747 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:41.622530 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae648e3-c1ac-4a57-acd6-ca8a2488d747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:41.622804 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae648e3-c1ac-4a57-acd6-ca8a2488d747 admin admin] PATH_INFO: `/v3/users/932ccf4c79d5426fb875ed572d69f161` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:41.630476 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae648e3-c1ac-4a57-acd6-ca8a2488d747 admin admin] RBAC: Authorizing `identity:delete_user(user_id=932ccf4c79d5426fb875ed572d69f161)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:41.632467 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae648e3-c1ac-4a57-acd6-ca8a2488d747 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:41.839370 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-56b81389-04fe-412b-a1ad-83833b6f4846 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e510320308c46b08fd88b221dfe59b3', 'request_id': 'req-56b81389-04fe-412b-a1ad-83833b6f4846'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:41.862674 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-56b81389-04fe-412b-a1ad-83833b6f4846 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e510320308c46b08fd88b221dfe59b3', 'request_id': 'req-56b81389-04fe-412b-a1ad-83833b6f4846'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:41.977996 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-bae648e3-c1ac-4a57-acd6-ca8a2488d747 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '932ccf4c79d5426fb875ed572d69f161'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:42.004328 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-bae648e3-c1ac-4a57-acd6-ca8a2488d747 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '932ccf4c79d5426fb875ed572d69f161'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:42.020347 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-56b81389-04fe-412b-a1ad-83833b6f4846 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e510320308c46b08fd88b221dfe59b3', 'request_id': 'req-56b81389-04fe-412b-a1ad-83833b6f4846'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:42.036993 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-56b81389-04fe-412b-a1ad-83833b6f4846 admin admin] The token cache is being invalidate because project 1e510320308c46b08fd88b221dfe59b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:27:42.037344 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-56b81389-04fe-412b-a1ad-83833b6f4846 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:42.040460 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-56b81389-04fe-412b-a1ad-83833b6f4846 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:42.048734 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 827/1666] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:27:41 2022] DELETE /identity/v3/projects/1e510320308c46b08fd88b221dfe59b3 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:27:42.052613 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b81389-04fe-412b-a1ad-83833b6f4846 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:42.054359 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-56b81389-04fe-412b-a1ad-83833b6f4846 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:42.114142 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-bae648e3-c1ac-4a57-acd6-ca8a2488d747 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '932ccf4c79d5426fb875ed572d69f161'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:42.114768 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-bae648e3-c1ac-4a57-acd6-ca8a2488d747 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '932ccf4c79d5426fb875ed572d69f161'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:42.117532 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-bae648e3-c1ac-4a57-acd6-ca8a2488d747 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '932ccf4c79d5426fb875ed572d69f161'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:42.149092 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b81389-04fe-412b-a1ad-83833b6f4846 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:42.155526 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7283927-f14b-4537-b845-b118df02ffaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:42.156695 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7283927-f14b-4537-b845-b118df02ffaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:42.157024 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7283927-f14b-4537-b845-b118df02ffaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:42.157308 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7283927-f14b-4537-b845-b118df02ffaa admin admin] PATH_INFO: `/v3/users/8b97090f91db4fff9359ef70a06ad968` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:42.158751 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7283927-f14b-4537-b845-b118df02ffaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b97090f91db4fff9359ef70a06ad968)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:42.161737 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7283927-f14b-4537-b845-b118df02ffaa admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:42.169440 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 840/1667] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:27:41 2022] DELETE /identity/v3/users/932ccf4c79d5426fb875ed572d69f161 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:27:42.177405 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edfabcd-ab89-4f53-a8a1-eeef769423ee None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:42.177958 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edfabcd-ab89-4f53-a8a1-eeef769423ee None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:42.178400 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edfabcd-ab89-4f53-a8a1-eeef769423ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:42.257203 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-9edfabcd-ab89-4f53-a8a1-eeef769423ee None None] MFA Rules not processed for user `904f18109a1d45579e433ea6c246741c`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:27:42.260105 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-9edfabcd-ab89-4f53-a8a1-eeef769423ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:42.421334 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-c7283927-f14b-4537-b845-b118df02ffaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b97090f91db4fff9359ef70a06ad968'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:42.423182 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-c7283927-f14b-4537-b845-b118df02ffaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b97090f91db4fff9359ef70a06ad968'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:42.440442 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 841/1668] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:27:42 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:27:42.451348 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431df7e1-683c-41bd-8489-308f113775a7 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:42.451726 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431df7e1-683c-41bd-8489-308f113775a7 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:42.452111 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431df7e1-683c-41bd-8489-308f113775a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:42.473889 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-431df7e1-683c-41bd-8489-308f113775a7 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:27:42.475213 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-431df7e1-683c-41bd-8489-308f113775a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:42.494498 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-c7283927-f14b-4537-b845-b118df02ffaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b97090f91db4fff9359ef70a06ad968'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:42.495202 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-c7283927-f14b-4537-b845-b118df02ffaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b97090f91db4fff9359ef70a06ad968'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:42.527152 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-c7283927-f14b-4537-b845-b118df02ffaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b97090f91db4fff9359ef70a06ad968'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:42.563375 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 828/1669] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:27:42 2022] DELETE /identity/v3/users/8b97090f91db4fff9359ef70a06ad968 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:27:42.607097 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 842/1670] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:27:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:27:42.641265 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7283927-f14b-4537-b845-b118df02ffaa admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:42.643877 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-c7283927-f14b-4537-b845-b118df02ffaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:42.799677 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7283927-f14b-4537-b845-b118df02ffaa admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:42.808287 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db71ff2-379a-45c1-85c7-f03e285a5a10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:42.816254 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db71ff2-379a-45c1-85c7-f03e285a5a10 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:42.823022 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db71ff2-379a-45c1-85c7-f03e285a5a10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:42.823022 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db71ff2-379a-45c1-85c7-f03e285a5a10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:42.948852 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db71ff2-379a-45c1-85c7-f03e285a5a10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:42.950547 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db71ff2-379a-45c1-85c7-f03e285a5a10 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:42.969768 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 829/1671] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:27:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:27:43.282267 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431df7e1-683c-41bd-8489-308f113775a7 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:43.284327 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-431df7e1-683c-41bd-8489-308f113775a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:43.310552 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431df7e1-683c-41bd-8489-308f113775a7 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:43.316805 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103b0bf-8823-4926-b0b4-f500213fd10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:43.318025 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103b0bf-8823-4926-b0b4-f500213fd10f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:43.318481 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103b0bf-8823-4926-b0b4-f500213fd10f admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:43.319046 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103b0bf-8823-4926-b0b4-f500213fd10f admin admin] PATH_INFO: `/v3/projects/118085a24a17451a9cb3862aa25bb155` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:43.320674 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a103b0bf-8823-4926-b0b4-f500213fd10f admin admin] RBAC: Authorizing `identity:delete_project(project_id=118085a24a17451a9cb3862aa25bb155)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:43.322150 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: WARNING py.warnings [None req-a103b0bf-8823-4926-b0b4-f500213fd10f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 07 06:27:43.322150 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: warnings.warn(msg) Apr 07 06:27:43.322150 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: Apr 07 06:27:43.325695 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a103b0bf-8823-4926-b0b4-f500213fd10f admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:43.509385 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a103b0bf-8823-4926-b0b4-f500213fd10f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '118085a24a17451a9cb3862aa25bb155', 'request_id': 'req-a103b0bf-8823-4926-b0b4-f500213fd10f'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:43.545540 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a103b0bf-8823-4926-b0b4-f500213fd10f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '118085a24a17451a9cb3862aa25bb155', 'request_id': 'req-a103b0bf-8823-4926-b0b4-f500213fd10f'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:43.616187 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a103b0bf-8823-4926-b0b4-f500213fd10f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '118085a24a17451a9cb3862aa25bb155', 'request_id': 'req-a103b0bf-8823-4926-b0b4-f500213fd10f'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:43.661666 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a103b0bf-8823-4926-b0b4-f500213fd10f admin admin] The token cache is being invalidate because project 118085a24a17451a9cb3862aa25bb155 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:27:43.662180 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a103b0bf-8823-4926-b0b4-f500213fd10f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:43.664800 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a103b0bf-8823-4926-b0b4-f500213fd10f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:43.667100 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 843/1672] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:27:43 2022] DELETE /identity/v3/projects/118085a24a17451a9cb3862aa25bb155 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:27:43.671713 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db71ff2-379a-45c1-85c7-f03e285a5a10 service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:43.685526 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db71ff2-379a-45c1-85c7-f03e285a5a10 service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:43.799689 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0b0107-f3b3-4cc9-8afb-edddb005dca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:43.800612 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b0107-f3b3-4cc9-8afb-edddb005dca9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:43.801162 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b0107-f3b3-4cc9-8afb-edddb005dca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:43.801454 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b0107-f3b3-4cc9-8afb-edddb005dca9 admin admin] PATH_INFO: `/v3/users/233e5678f55e44e1a9f0d06bdd6a6c45` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:43.804191 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0b0107-f3b3-4cc9-8afb-edddb005dca9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=233e5678f55e44e1a9f0d06bdd6a6c45)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:43.806946 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0b0107-f3b3-4cc9-8afb-edddb005dca9 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:44.084281 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ed0b0107-f3b3-4cc9-8afb-edddb005dca9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '233e5678f55e44e1a9f0d06bdd6a6c45'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:44.086303 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ed0b0107-f3b3-4cc9-8afb-edddb005dca9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '233e5678f55e44e1a9f0d06bdd6a6c45'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:44.203157 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ed0b0107-f3b3-4cc9-8afb-edddb005dca9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '233e5678f55e44e1a9f0d06bdd6a6c45'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:44.204018 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ed0b0107-f3b3-4cc9-8afb-edddb005dca9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '233e5678f55e44e1a9f0d06bdd6a6c45'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:44.264131 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ed0b0107-f3b3-4cc9-8afb-edddb005dca9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '233e5678f55e44e1a9f0d06bdd6a6c45'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:44.301420 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 830/1673] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:27:43 2022] DELETE /identity/v3/users/233e5678f55e44e1a9f0d06bdd6a6c45 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:27:44.333269 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103b0bf-8823-4926-b0b4-f500213fd10f admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:44.334901 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a103b0bf-8823-4926-b0b4-f500213fd10f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:44.372721 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103b0bf-8823-4926-b0b4-f500213fd10f admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:44.531792 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b175ce-591a-4516-90f9-c7528ea37196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:44.532764 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b175ce-591a-4516-90f9-c7528ea37196 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:44.533051 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b175ce-591a-4516-90f9-c7528ea37196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:44.533331 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b175ce-591a-4516-90f9-c7528ea37196 admin admin] PATH_INFO: `/v3/projects/7d5c26ec071c4c0ca925c6f74dc6386b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:44.537529 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b175ce-591a-4516-90f9-c7528ea37196 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d5c26ec071c4c0ca925c6f74dc6386b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:44.539595 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b175ce-591a-4516-90f9-c7528ea37196 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:44.750779 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-73b175ce-591a-4516-90f9-c7528ea37196 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d5c26ec071c4c0ca925c6f74dc6386b', 'request_id': 'req-73b175ce-591a-4516-90f9-c7528ea37196'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:44.777934 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-73b175ce-591a-4516-90f9-c7528ea37196 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d5c26ec071c4c0ca925c6f74dc6386b', 'request_id': 'req-73b175ce-591a-4516-90f9-c7528ea37196'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:44.923448 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-73b175ce-591a-4516-90f9-c7528ea37196 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d5c26ec071c4c0ca925c6f74dc6386b', 'request_id': 'req-73b175ce-591a-4516-90f9-c7528ea37196'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:44.942625 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-73b175ce-591a-4516-90f9-c7528ea37196 admin admin] The token cache is being invalidate because project 7d5c26ec071c4c0ca925c6f74dc6386b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:27:44.945777 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-73b175ce-591a-4516-90f9-c7528ea37196 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:44.946830 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-73b175ce-591a-4516-90f9-c7528ea37196 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:44.951453 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 844/1674] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:27:44 2022] DELETE /identity/v3/projects/7d5c26ec071c4c0ca925c6f74dc6386b => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:27:44.956093 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862b56f-dc83-40c3-9c4a-4b4d54541a94 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:44.956359 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862b56f-dc83-40c3-9c4a-4b4d54541a94 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:44.956610 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862b56f-dc83-40c3-9c4a-4b4d54541a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:44.992008 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-8862b56f-dc83-40c3-9c4a-4b4d54541a94 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:27:44.993268 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-8862b56f-dc83-40c3-9c4a-4b4d54541a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:45.130790 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 831/1675] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:27:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:27:45.138528 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe854c8-0318-4ba9-aef7-c2d69f2c7607 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:45.138876 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe854c8-0318-4ba9-aef7-c2d69f2c7607 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:45.139109 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe854c8-0318-4ba9-aef7-c2d69f2c7607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:45.174087 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-ffe854c8-0318-4ba9-aef7-c2d69f2c7607 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:27:45.179789 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-ffe854c8-0318-4ba9-aef7-c2d69f2c7607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:45.198354 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 845/1676] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:27:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:27:45.202302 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8862b56f-dc83-40c3-9c4a-4b4d54541a94 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:45.216098 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8862b56f-dc83-40c3-9c4a-4b4d54541a94 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:45.232374 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da4bcf5-39d6-4b2b-89c2-9a904e83274a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:45.232374 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4bcf5-39d6-4b2b-89c2-9a904e83274a admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:45.232374 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4bcf5-39d6-4b2b-89c2-9a904e83274a admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:45.232374 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4bcf5-39d6-4b2b-89c2-9a904e83274a admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:45.232685 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da4bcf5-39d6-4b2b-89c2-9a904e83274a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:27:45.232685 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da4bcf5-39d6-4b2b-89c2-9a904e83274a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:45.237778 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da4bcf5-39d6-4b2b-89c2-9a904e83274a admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:45.286980 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 832/1677] 10.222.0.24 () {58 vars in 1152 bytes} [Thu Apr 7 06:27:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:27:45.291649 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe854c8-0318-4ba9-aef7-c2d69f2c7607 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:45.319274 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe854c8-0318-4ba9-aef7-c2d69f2c7607 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:45.331119 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccae5dc-2ff7-4e9c-940f-2c8558e733d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:45.332077 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccae5dc-2ff7-4e9c-940f-2c8558e733d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:45.332525 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccae5dc-2ff7-4e9c-940f-2c8558e733d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:45.332948 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccae5dc-2ff7-4e9c-940f-2c8558e733d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:45.333904 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccae5dc-2ff7-4e9c-940f-2c8558e733d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:45.337441 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccae5dc-2ff7-4e9c-940f-2c8558e733d4 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:45.508245 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da4bcf5-39d6-4b2b-89c2-9a904e83274a admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:45.517568 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 846/1678] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:27:45 2022] POST /identity/v3/projects => generated 365 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:27:45.520392 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da4bcf5-39d6-4b2b-89c2-9a904e83274a admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:45.621386 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989d2969-30cb-4d08-bdef-f1fb7ceb8845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:45.622325 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d2969-30cb-4d08-bdef-f1fb7ceb8845 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:45.622747 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d2969-30cb-4d08-bdef-f1fb7ceb8845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:45.623159 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d2969-30cb-4d08-bdef-f1fb7ceb8845 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:45.628754 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989d2969-30cb-4d08-bdef-f1fb7ceb8845 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:45.631020 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989d2969-30cb-4d08-bdef-f1fb7ceb8845 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:45.752645 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccae5dc-2ff7-4e9c-940f-2c8558e733d4 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:45.760930 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 833/1679] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:27:45 2022] POST /identity/v3/users => generated 283 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:27:45.777953 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccae5dc-2ff7-4e9c-940f-2c8558e733d4 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:45.783673 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96922d30-cb23-4aa6-91ba-e28319003f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:45.784563 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96922d30-cb23-4aa6-91ba-e28319003f06 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:45.785350 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96922d30-cb23-4aa6-91ba-e28319003f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:45.785915 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96922d30-cb23-4aa6-91ba-e28319003f06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:45.786959 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96922d30-cb23-4aa6-91ba-e28319003f06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:45.788853 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96922d30-cb23-4aa6-91ba-e28319003f06 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:45.816207 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989d2969-30cb-4d08-bdef-f1fb7ceb8845 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:45.827162 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 847/1680] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:27:45 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:27:45.827897 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989d2969-30cb-4d08-bdef-f1fb7ceb8845 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:45.834643 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd414d5d-b3e7-4777-833c-dcc8a9891489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:45.835525 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd414d5d-b3e7-4777-833c-dcc8a9891489 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:45.835993 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd414d5d-b3e7-4777-833c-dcc8a9891489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:45.836466 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd414d5d-b3e7-4777-833c-dcc8a9891489 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:45.838327 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd414d5d-b3e7-4777-833c-dcc8a9891489 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:45.840223 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd414d5d-b3e7-4777-833c-dcc8a9891489 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:45.858496 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96922d30-cb23-4aa6-91ba-e28319003f06 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:45.866466 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 834/1681] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:27:45 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:27:45.870992 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96922d30-cb23-4aa6-91ba-e28319003f06 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:45.877625 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fab991-3907-468e-b191-614c7e191cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:45.878714 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fab991-3907-468e-b191-614c7e191cb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:45.879517 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fab991-3907-468e-b191-614c7e191cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:45.879981 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fab991-3907-468e-b191-614c7e191cb6 admin admin] PATH_INFO: `/v3/projects/5f38ef56c5fe44679764a8d97f28112b/users/c7e328938e014639abc9343af76804bd/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:45.899127 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fab991-3907-468e-b191-614c7e191cb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f38ef56c5fe44679764a8d97f28112b, user_id=c7e328938e014639abc9343af76804bd, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:45.903717 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fab991-3907-468e-b191-614c7e191cb6 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:46.047457 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3459a-ff0b-47a7-8be8-9974c042cb3d None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:46.047941 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3459a-ff0b-47a7-8be8-9974c042cb3d None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:46.048851 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3459a-ff0b-47a7-8be8-9974c042cb3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:46.050468 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 848/1682] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:27:45 2022] PUT /identity/v3/projects/5f38ef56c5fe44679764a8d97f28112b/users/c7e328938e014639abc9343af76804bd/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:27:46.095211 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-e5f3459a-ff0b-47a7-8be8-9974c042cb3d None None] MFA Rules not processed for user `c7e328938e014639abc9343af76804bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:27:46.097736 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-e5f3459a-ff0b-47a7-8be8-9974c042cb3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:46.114462 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da739a-ba48-4273-bda6-559396d11625 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:46.114922 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da739a-ba48-4273-bda6-559396d11625 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:46.115327 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da739a-ba48-4273-bda6-559396d11625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:46.154443 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-d2da739a-ba48-4273-bda6-559396d11625 None None] MFA Rules not processed for user `f4435fb14c3844728531af63993f78c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:27:46.159893 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d2da739a-ba48-4273-bda6-559396d11625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:46.293514 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 835/1683] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:27:46 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:27:46.295713 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f3459a-ff0b-47a7-8be8-9974c042cb3d None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:46.332556 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 849/1684] 10.222.0.24 () {58 vars in 1009 bytes} [Thu Apr 7 06:27:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:27:46.398578 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f3459a-ff0b-47a7-8be8-9974c042cb3d None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:46.406556 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0976715-22a1-46df-a51a-a03c7b2fd474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:46.406556 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0976715-22a1-46df-a51a-a03c7b2fd474 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:46.406556 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0976715-22a1-46df-a51a-a03c7b2fd474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:46.406556 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0976715-22a1-46df-a51a-a03c7b2fd474 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:46.408096 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0976715-22a1-46df-a51a-a03c7b2fd474 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:46.409052 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da739a-ba48-4273-bda6-559396d11625 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:46.410369 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0976715-22a1-46df-a51a-a03c7b2fd474 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:46.411452 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d2da739a-ba48-4273-bda6-559396d11625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:46.439776 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da739a-ba48-4273-bda6-559396d11625 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:46.447564 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c803e691-d5ff-460a-be42-1fd65861b037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:46.449216 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803e691-d5ff-460a-be42-1fd65861b037 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:46.449817 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803e691-d5ff-460a-be42-1fd65861b037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:46.450029 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803e691-d5ff-460a-be42-1fd65861b037 admin admin] PATH_INFO: `/v3/projects/33d7440ad8764522adff946e9601c33d` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:46.452338 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c803e691-d5ff-460a-be42-1fd65861b037 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33d7440ad8764522adff946e9601c33d)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:46.454686 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c803e691-d5ff-460a-be42-1fd65861b037 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:46.576433 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 836/1685] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:27:46 2022] POST /identity/v3/projects => generated 361 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:27:46.584429 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0976715-22a1-46df-a51a-a03c7b2fd474 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:46.734976 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-c803e691-d5ff-460a-be42-1fd65861b037 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33d7440ad8764522adff946e9601c33d', 'request_id': 'req-c803e691-d5ff-460a-be42-1fd65861b037'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:46.752389 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-c803e691-d5ff-460a-be42-1fd65861b037 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33d7440ad8764522adff946e9601c33d', 'request_id': 'req-c803e691-d5ff-460a-be42-1fd65861b037'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:46.764861 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0976715-22a1-46df-a51a-a03c7b2fd474 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:46.867320 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-c803e691-d5ff-460a-be42-1fd65861b037 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33d7440ad8764522adff946e9601c33d', 'request_id': 'req-c803e691-d5ff-460a-be42-1fd65861b037'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:46.890593 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-c803e691-d5ff-460a-be42-1fd65861b037 admin admin] The token cache is being invalidate because project 33d7440ad8764522adff946e9601c33d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:27:46.892539 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-c803e691-d5ff-460a-be42-1fd65861b037 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:46.893712 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-c803e691-d5ff-460a-be42-1fd65861b037 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:46.898249 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 850/1686] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:27:46 2022] DELETE /identity/v3/projects/33d7440ad8764522adff946e9601c33d => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:27:46.900253 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c803e691-d5ff-460a-be42-1fd65861b037 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:46.902523 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c803e691-d5ff-460a-be42-1fd65861b037 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:46.924707 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8e148-fd23-41fd-91bd-781d78afb632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:46.927136 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8e148-fd23-41fd-91bd-781d78afb632 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:46.927367 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8e148-fd23-41fd-91bd-781d78afb632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:46.927655 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8e148-fd23-41fd-91bd-781d78afb632 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:46.932258 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd8e148-fd23-41fd-91bd-781d78afb632 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:46.935303 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd8e148-fd23-41fd-91bd-781d78afb632 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:47.094854 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 837/1687] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:27:46 2022] POST /identity/v3/users => generated 287 bytes in 508 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:27:47.094854 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8e148-fd23-41fd-91bd-781d78afb632 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:47.095624 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c803e691-d5ff-460a-be42-1fd65861b037 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:47.102325 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-0fd8e148-fd23-41fd-91bd-781d78afb632 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:47.113643 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4bd008-0a52-4efc-b346-d5c8a6ad82ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:47.127420 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4bd008-0a52-4efc-b346-d5c8a6ad82ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:47.128087 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4bd008-0a52-4efc-b346-d5c8a6ad82ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:47.128586 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4bd008-0a52-4efc-b346-d5c8a6ad82ec admin admin] PATH_INFO: `/v3/projects/751a6448e493479bbb67a5cb41731575` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:47.130586 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4bd008-0a52-4efc-b346-d5c8a6ad82ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=751a6448e493479bbb67a5cb41731575)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:47.135127 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4bd008-0a52-4efc-b346-d5c8a6ad82ec admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:47.147662 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8e148-fd23-41fd-91bd-781d78afb632 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:47.164573 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b5d3f-4705-430b-812e-fa4461cb40e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:47.165831 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b5d3f-4705-430b-812e-fa4461cb40e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:47.166064 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b5d3f-4705-430b-812e-fa4461cb40e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:47.166344 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b5d3f-4705-430b-812e-fa4461cb40e0 admin admin] PATH_INFO: `/v3/users/3cab2e53c1a44d9eab8a55a4223c787f` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:47.171774 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712b5d3f-4705-430b-812e-fa4461cb40e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cab2e53c1a44d9eab8a55a4223c787f)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:47.191186 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712b5d3f-4705-430b-812e-fa4461cb40e0 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:47.358431 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2d4bd008-0a52-4efc-b346-d5c8a6ad82ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '751a6448e493479bbb67a5cb41731575', 'request_id': 'req-2d4bd008-0a52-4efc-b346-d5c8a6ad82ec'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:47.369356 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2d4bd008-0a52-4efc-b346-d5c8a6ad82ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '751a6448e493479bbb67a5cb41731575', 'request_id': 'req-2d4bd008-0a52-4efc-b346-d5c8a6ad82ec'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:47.461880 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-712b5d3f-4705-430b-812e-fa4461cb40e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cab2e53c1a44d9eab8a55a4223c787f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:47.462487 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-712b5d3f-4705-430b-812e-fa4461cb40e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cab2e53c1a44d9eab8a55a4223c787f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:47.468639 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2d4bd008-0a52-4efc-b346-d5c8a6ad82ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '751a6448e493479bbb67a5cb41731575', 'request_id': 'req-2d4bd008-0a52-4efc-b346-d5c8a6ad82ec'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:47.483157 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2d4bd008-0a52-4efc-b346-d5c8a6ad82ec admin admin] The token cache is being invalidate because project 751a6448e493479bbb67a5cb41731575 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:27:47.483463 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2d4bd008-0a52-4efc-b346-d5c8a6ad82ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:47.484887 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2d4bd008-0a52-4efc-b346-d5c8a6ad82ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:47.496117 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 851/1688] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:27:46 2022] DELETE /identity/v3/projects/751a6448e493479bbb67a5cb41731575 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:27:47.497903 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17d922-06e1-4465-84bd-1cde3a3adec0 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:47.499364 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17d922-06e1-4465-84bd-1cde3a3adec0 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:47.499662 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17d922-06e1-4465-84bd-1cde3a3adec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:47.542329 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-7a17d922-06e1-4465-84bd-1cde3a3adec0 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:27:47.543602 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-7a17d922-06e1-4465-84bd-1cde3a3adec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:47.558885 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-712b5d3f-4705-430b-812e-fa4461cb40e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cab2e53c1a44d9eab8a55a4223c787f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:47.558885 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-712b5d3f-4705-430b-812e-fa4461cb40e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cab2e53c1a44d9eab8a55a4223c787f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:47.582638 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-712b5d3f-4705-430b-812e-fa4461cb40e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cab2e53c1a44d9eab8a55a4223c787f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:47.616663 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 838/1689] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:27:47 2022] DELETE /identity/v3/users/3cab2e53c1a44d9eab8a55a4223c787f => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:27:47.617693 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b5d3f-4705-430b-812e-fa4461cb40e0 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:47.624067 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-712b5d3f-4705-430b-812e-fa4461cb40e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:47.699212 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 852/1690] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:27:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:27:47.707606 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17d922-06e1-4465-84bd-1cde3a3adec0 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:47.709463 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-7a17d922-06e1-4465-84bd-1cde3a3adec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:47.737697 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17d922-06e1-4465-84bd-1cde3a3adec0 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:47.839109 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b5d3f-4705-430b-812e-fa4461cb40e0 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:47.852423 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be08a3e3-643f-4898-afdf-42091acbb453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:47.852523 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5150a9e7-bd64-475a-b95d-7263c193f987 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4abbb8c5324b7babd69e3b4473b3e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:47.852606 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08a3e3-643f-4898-afdf-42091acbb453 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:47.852688 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150a9e7-bd64-475a-b95d-7263c193f987 service swift] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:47.852688 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150a9e7-bd64-475a-b95d-7263c193f987 service swift] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:47.852806 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08a3e3-643f-4898-afdf-42091acbb453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:47.853369 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08a3e3-643f-4898-afdf-42091acbb453 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:47.854063 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150a9e7-bd64-475a-b95d-7263c193f987 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:47.855990 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be08a3e3-643f-4898-afdf-42091acbb453 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:47.860030 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be08a3e3-643f-4898-afdf-42091acbb453 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:47.863176 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-5150a9e7-bd64-475a-b95d-7263c193f987 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:47.875394 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 853/1691] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:27:47.877213 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eea2a6-1b66-4ffa-bd87-f6128904ec88 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:47.881060 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eea2a6-1b66-4ffa-bd87-f6128904ec88 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:47.881060 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eea2a6-1b66-4ffa-bd87-f6128904ec88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:47.923030 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-f2eea2a6-1b66-4ffa-bd87-f6128904ec88 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:27:47.925645 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f2eea2a6-1b66-4ffa-bd87-f6128904ec88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:47.947896 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 854/1692] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:27:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:27:47.949224 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c5acab-9397-4285-b57c-2b32cfc4cfd5 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:47.949512 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c5acab-9397-4285-b57c-2b32cfc4cfd5 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:47.953500 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c5acab-9397-4285-b57c-2b32cfc4cfd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:47.965412 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5150a9e7-bd64-475a-b95d-7263c193f987 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:47.967373 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5150a9e7-bd64-475a-b95d-7263c193f987 service swift] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:47.978150 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 839/1693] 10.222.0.24 () {60 vars in 1384 bytes} [Thu Apr 7 06:27:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 07 06:27:47.979283 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5150a9e7-bd64-475a-b95d-7263c193f987 service swift] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:48.021108 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-53c5acab-9397-4285-b57c-2b32cfc4cfd5 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:27:48.050346 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-53c5acab-9397-4285-b57c-2b32cfc4cfd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:48.075641 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5150a9e7-bd64-475a-b95d-7263c193f987 service swift] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:48.116616 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 855/1694] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:27:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:27:48.118389 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bc7990-38e2-4f9e-926e-012224e99827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:48.120500 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc7990-38e2-4f9e-926e-012224e99827 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:48.125280 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833283a0-87d6-47d1-8559-5dd66e0a2075 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:48.125990 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc7990-38e2-4f9e-926e-012224e99827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:48.127645 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc7990-38e2-4f9e-926e-012224e99827 admin admin] PATH_INFO: `/v3/projects/3eed173bed384c2c99856f2be57cdcf1/users/78f63209d6fa402182b2b02f86d71129/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:48.129557 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833283a0-87d6-47d1-8559-5dd66e0a2075 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:48.130105 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833283a0-87d6-47d1-8559-5dd66e0a2075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:48.180804 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bc7990-38e2-4f9e-926e-012224e99827 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eed173bed384c2c99856f2be57cdcf1, user_id=78f63209d6fa402182b2b02f86d71129, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:48.196615 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bc7990-38e2-4f9e-926e-012224e99827 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:48.206273 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-833283a0-87d6-47d1-8559-5dd66e0a2075 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:27:48.217907 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-833283a0-87d6-47d1-8559-5dd66e0a2075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:48.241567 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 856/1695] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:27:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:27:48.242757 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833283a0-87d6-47d1-8559-5dd66e0a2075 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:48.267538 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833283a0-87d6-47d1-8559-5dd66e0a2075 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:48.283969 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eb6d40-51aa-4b0e-b372-7a0996cf68e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:48.284895 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb6d40-51aa-4b0e-b372-7a0996cf68e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:48.285289 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb6d40-51aa-4b0e-b372-7a0996cf68e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:48.285670 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb6d40-51aa-4b0e-b372-7a0996cf68e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:48.286972 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eb6d40-51aa-4b0e-b372-7a0996cf68e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:27:48.288080 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eb6d40-51aa-4b0e-b372-7a0996cf68e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:48.290756 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eb6d40-51aa-4b0e-b372-7a0996cf68e2 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:48.309171 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 840/1696] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:27:47 2022] PUT /identity/v3/projects/3eed173bed384c2c99856f2be57cdcf1/users/78f63209d6fa402182b2b02f86d71129/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:27:48.310139 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bc7990-38e2-4f9e-926e-012224e99827 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:48.338634 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 857/1697] 10.222.0.24 () {58 vars in 1152 bytes} [Thu Apr 7 06:27:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:27:48.340831 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eb6d40-51aa-4b0e-b372-7a0996cf68e2 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:48.370549 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eb6d40-51aa-4b0e-b372-7a0996cf68e2 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:48.581829 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61507d7c-9a68-4fa2-8df4-888e14a514bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:48.582511 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61507d7c-9a68-4fa2-8df4-888e14a514bf admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:48.582834 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61507d7c-9a68-4fa2-8df4-888e14a514bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:48.583115 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61507d7c-9a68-4fa2-8df4-888e14a514bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:48.584010 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61507d7c-9a68-4fa2-8df4-888e14a514bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:48.585804 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61507d7c-9a68-4fa2-8df4-888e14a514bf admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:48.588501 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bc7990-38e2-4f9e-926e-012224e99827 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:48.594769 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13475fe1-df8c-4473-a803-80d83678af09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:48.596875 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13475fe1-df8c-4473-a803-80d83678af09 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:48.597556 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13475fe1-df8c-4473-a803-80d83678af09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:48.598058 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13475fe1-df8c-4473-a803-80d83678af09 admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:48.599909 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13475fe1-df8c-4473-a803-80d83678af09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:27:48.601066 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13475fe1-df8c-4473-a803-80d83678af09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:48.603713 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13475fe1-df8c-4473-a803-80d83678af09 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:48.625202 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 858/1698] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:27:48 2022] GET /identity/v3/roles => generated 1420 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:27:48.627442 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61507d7c-9a68-4fa2-8df4-888e14a514bf admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:48.649554 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61507d7c-9a68-4fa2-8df4-888e14a514bf admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:48.651367 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 841/1699] 10.222.0.24 () {58 vars in 1152 bytes} [Thu Apr 7 06:27:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:27:48.655388 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13475fe1-df8c-4473-a803-80d83678af09 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:48.663140 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e5758-e122-4ebe-a050-ed2e504da29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:48.664086 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e5758-e122-4ebe-a050-ed2e504da29e admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:48.664384 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e5758-e122-4ebe-a050-ed2e504da29e admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:48.664668 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e5758-e122-4ebe-a050-ed2e504da29e admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:48.669826 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366e5758-e122-4ebe-a050-ed2e504da29e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:48.669826 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366e5758-e122-4ebe-a050-ed2e504da29e admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:48.689916 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13475fe1-df8c-4473-a803-80d83678af09 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:48.701582 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e09962c-7cd8-4ff7-9a2f-e621af567c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:48.702765 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e09962c-7cd8-4ff7-9a2f-e621af567c98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:48.703667 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e09962c-7cd8-4ff7-9a2f-e621af567c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:48.704648 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e09962c-7cd8-4ff7-9a2f-e621af567c98 admin admin] PATH_INFO: `/v3/projects/3eed173bed384c2c99856f2be57cdcf1/users/78f63209d6fa402182b2b02f86d71129/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:48.713911 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e09962c-7cd8-4ff7-9a2f-e621af567c98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eed173bed384c2c99856f2be57cdcf1, user_id=78f63209d6fa402182b2b02f86d71129, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:48.719531 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e09962c-7cd8-4ff7-9a2f-e621af567c98 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:48.741751 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 842/1700] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:27:48 2022] PUT /identity/v3/projects/3eed173bed384c2c99856f2be57cdcf1/users/78f63209d6fa402182b2b02f86d71129/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:27:48.743971 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e09962c-7cd8-4ff7-9a2f-e621af567c98 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:48.808894 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 859/1701] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:27:48 2022] POST /identity/v3/projects => generated 365 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:27:48.813267 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e34b8e9-76e0-42a3-8c5e-2bb1e5ac5126 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:48.818021 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e34b8e9-76e0-42a3-8c5e-2bb1e5ac5126 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:48.818333 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e34b8e9-76e0-42a3-8c5e-2bb1e5ac5126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:48.909515 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-1e34b8e9-76e0-42a3-8c5e-2bb1e5ac5126 None None] MFA Rules not processed for user `78f63209d6fa402182b2b02f86d71129`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:27:48.915337 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-1e34b8e9-76e0-42a3-8c5e-2bb1e5ac5126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:48.918372 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e09962c-7cd8-4ff7-9a2f-e621af567c98 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:49.083314 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b2a605-3875-4394-8205-06ba5b481320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:49.089510 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2a605-3875-4394-8205-06ba5b481320 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:49.089809 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2a605-3875-4394-8205-06ba5b481320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:49.090093 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2a605-3875-4394-8205-06ba5b481320 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:49.092782 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b2a605-3875-4394-8205-06ba5b481320 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:49.094840 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b2a605-3875-4394-8205-06ba5b481320 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:49.203888 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 860/1702] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:27:48 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:27:49.205996 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e34b8e9-76e0-42a3-8c5e-2bb1e5ac5126 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:49.247181 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e34b8e9-76e0-42a3-8c5e-2bb1e5ac5126 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:49.271273 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 843/1703] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:27:48 2022] POST /identity/v3/projects => generated 399 bytes in 528 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:27:49.274310 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b2a605-3875-4394-8205-06ba5b481320 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:49.275716 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e820447-cd31-480e-8c0a-7162a8509837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:49.281948 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e820447-cd31-480e-8c0a-7162a8509837 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:49.282250 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e820447-cd31-480e-8c0a-7162a8509837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:49.282899 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-00b2a605-3875-4394-8205-06ba5b481320 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:49.283080 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e820447-cd31-480e-8c0a-7162a8509837 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:49.283883 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e820447-cd31-480e-8c0a-7162a8509837 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:49.298651 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e820447-cd31-480e-8c0a-7162a8509837 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:49.518346 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b2a605-3875-4394-8205-06ba5b481320 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:49.518346 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddab568-6e42-4d64-b4af-1c5c56cac2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:49.518346 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddab568-6e42-4d64-b4af-1c5c56cac2c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:49.518346 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddab568-6e42-4d64-b4af-1c5c56cac2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:49.519340 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddab568-6e42-4d64-b4af-1c5c56cac2c5 admin admin] PATH_INFO: `/v3/projects/3ca5bd0c2c2e470f8beec7845d73a775` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:49.519340 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddab568-6e42-4d64-b4af-1c5c56cac2c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ca5bd0c2c2e470f8beec7845d73a775)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:49.519340 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddab568-6e42-4d64-b4af-1c5c56cac2c5 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:49.552298 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 861/1704] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:27:49 2022] POST /identity/v3/users => generated 283 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:27:49.569590 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e820447-cd31-480e-8c0a-7162a8509837 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:49.569590 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-3e820447-cd31-480e-8c0a-7162a8509837 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:49.705067 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e820447-cd31-480e-8c0a-7162a8509837 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:49.811576 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b03822-a30e-4016-9cbd-6ce7177690bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:49.812298 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b03822-a30e-4016-9cbd-6ce7177690bb service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:49.812589 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b03822-a30e-4016-9cbd-6ce7177690bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:49.813015 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b03822-a30e-4016-9cbd-6ce7177690bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:49.922772 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-eddab568-6e42-4d64-b4af-1c5c56cac2c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ca5bd0c2c2e470f8beec7845d73a775', 'request_id': 'req-eddab568-6e42-4d64-b4af-1c5c56cac2c5'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:49.929692 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-eddab568-6e42-4d64-b4af-1c5c56cac2c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ca5bd0c2c2e470f8beec7845d73a775', 'request_id': 'req-eddab568-6e42-4d64-b4af-1c5c56cac2c5'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:49.933073 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b03822-a30e-4016-9cbd-6ce7177690bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:49.934553 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b03822-a30e-4016-9cbd-6ce7177690bb service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:49.946065 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 862/1705] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:27:49 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:27:49.962970 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b03822-a30e-4016-9cbd-6ce7177690bb service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:50.004065 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b03822-a30e-4016-9cbd-6ce7177690bb service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:50.014283 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-eddab568-6e42-4d64-b4af-1c5c56cac2c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ca5bd0c2c2e470f8beec7845d73a775', 'request_id': 'req-eddab568-6e42-4d64-b4af-1c5c56cac2c5'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:50.035189 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-eddab568-6e42-4d64-b4af-1c5c56cac2c5 admin admin] The token cache is being invalidate because project 3ca5bd0c2c2e470f8beec7845d73a775 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:27:50.035608 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-eddab568-6e42-4d64-b4af-1c5c56cac2c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:50.036765 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-eddab568-6e42-4d64-b4af-1c5c56cac2c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:50.046775 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 844/1706] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:27:49 2022] DELETE /identity/v3/projects/3ca5bd0c2c2e470f8beec7845d73a775 => generated 0 bytes in 771 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:27:50.048030 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddab568-6e42-4d64-b4af-1c5c56cac2c5 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:50.052066 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-eddab568-6e42-4d64-b4af-1c5c56cac2c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:50.180646 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73da7eb-e97b-499a-944c-18ddd69cec3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:50.181801 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73da7eb-e97b-499a-944c-18ddd69cec3e admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:50.182300 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73da7eb-e97b-499a-944c-18ddd69cec3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:50.182761 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73da7eb-e97b-499a-944c-18ddd69cec3e admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:50.183660 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73da7eb-e97b-499a-944c-18ddd69cec3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:50.186178 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73da7eb-e97b-499a-944c-18ddd69cec3e admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:50.304268 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddab568-6e42-4d64-b4af-1c5c56cac2c5 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:50.306125 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 863/1707] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:27:49 2022] POST /identity/v3/users => generated 300 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:27:50.306951 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73da7eb-e97b-499a-944c-18ddd69cec3e admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:50.312242 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f73da7eb-e97b-499a-944c-18ddd69cec3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:50.334404 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737d6649-c4e0-48df-b068-da107ca3fecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:50.335088 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d6649-c4e0-48df-b068-da107ca3fecf admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:50.335383 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d6649-c4e0-48df-b068-da107ca3fecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:50.335659 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d6649-c4e0-48df-b068-da107ca3fecf admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:50.336437 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737d6649-c4e0-48df-b068-da107ca3fecf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:50.338178 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737d6649-c4e0-48df-b068-da107ca3fecf admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:50.338836 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73da7eb-e97b-499a-944c-18ddd69cec3e admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:50.360375 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c9b636-52a3-4933-99b6-b5a74bdd8ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:50.361287 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c9b636-52a3-4933-99b6-b5a74bdd8ac7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:50.361678 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c9b636-52a3-4933-99b6-b5a74bdd8ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:50.362203 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c9b636-52a3-4933-99b6-b5a74bdd8ac7 admin admin] PATH_INFO: `/v3/users/904f18109a1d45579e433ea6c246741c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:50.367873 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c9b636-52a3-4933-99b6-b5a74bdd8ac7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=904f18109a1d45579e433ea6c246741c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:50.374743 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c9b636-52a3-4933-99b6-b5a74bdd8ac7 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:50.386312 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 845/1708] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:27:50.387339 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737d6649-c4e0-48df-b068-da107ca3fecf admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:50.394383 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-737d6649-c4e0-48df-b068-da107ca3fecf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:50.438174 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737d6649-c4e0-48df-b068-da107ca3fecf admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:50.453602 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f598913-ec86-42e1-89fd-039b945df4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:50.456576 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f598913-ec86-42e1-89fd-039b945df4c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:50.457040 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f598913-ec86-42e1-89fd-039b945df4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:50.457491 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f598913-ec86-42e1-89fd-039b945df4c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:50.464307 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f598913-ec86-42e1-89fd-039b945df4c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:50.466716 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f598913-ec86-42e1-89fd-039b945df4c6 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:50.484047 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 846/1709] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:27:50.485202 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f598913-ec86-42e1-89fd-039b945df4c6 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:50.506500 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f598913-ec86-42e1-89fd-039b945df4c6 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:50.518965 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af796dbc-d9a5-499f-a369-0120dcb4210d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:50.522828 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af796dbc-d9a5-499f-a369-0120dcb4210d admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:50.523580 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af796dbc-d9a5-499f-a369-0120dcb4210d admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:50.525654 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af796dbc-d9a5-499f-a369-0120dcb4210d admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:50.532476 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af796dbc-d9a5-499f-a369-0120dcb4210d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:50.532476 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af796dbc-d9a5-499f-a369-0120dcb4210d admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:50.572586 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 847/1710] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:27:50.573855 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af796dbc-d9a5-499f-a369-0120dcb4210d admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:50.591046 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af796dbc-d9a5-499f-a369-0120dcb4210d admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:50.619908 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee07fd7-4f98-49ad-86cf-bf2cf112c49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:50.620607 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee07fd7-4f98-49ad-86cf-bf2cf112c49c admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:50.620892 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee07fd7-4f98-49ad-86cf-bf2cf112c49c admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:50.621169 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee07fd7-4f98-49ad-86cf-bf2cf112c49c admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:50.621919 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee07fd7-4f98-49ad-86cf-bf2cf112c49c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:50.623546 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee07fd7-4f98-49ad-86cf-bf2cf112c49c admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:50.649551 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 848/1711] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:27:50.649860 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf3482-6eae-4e01-875e-d68da0b942ac None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:50.649984 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-43c9b636-52a3-4933-99b6-b5a74bdd8ac7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '904f18109a1d45579e433ea6c246741c'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:50.650069 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf3482-6eae-4e01-875e-d68da0b942ac None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:50.652596 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf3482-6eae-4e01-875e-d68da0b942ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:50.682766 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-43c9b636-52a3-4933-99b6-b5a74bdd8ac7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '904f18109a1d45579e433ea6c246741c'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:50.699547 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-9ecf3482-6eae-4e01-875e-d68da0b942ac None None] MFA Rules not processed for user `bb7f549fd26e4642828d4f476aef0239`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:27:50.710457 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-9ecf3482-6eae-4e01-875e-d68da0b942ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:50.785859 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-43c9b636-52a3-4933-99b6-b5a74bdd8ac7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '904f18109a1d45579e433ea6c246741c'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:50.786383 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-43c9b636-52a3-4933-99b6-b5a74bdd8ac7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '904f18109a1d45579e433ea6c246741c'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:50.787014 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-43c9b636-52a3-4933-99b6-b5a74bdd8ac7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '904f18109a1d45579e433ea6c246741c'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:50.811387 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 864/1712] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:27:50 2022] DELETE /identity/v3/users/904f18109a1d45579e433ea6c246741c => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:27:50.829188 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c9b636-52a3-4933-99b6-b5a74bdd8ac7 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:50.834628 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-43c9b636-52a3-4933-99b6-b5a74bdd8ac7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:50.900264 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 849/1713] 10.222.0.25 () {58 vars in 1015 bytes} [Thu Apr 7 06:27:50 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:27:50.901236 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf3482-6eae-4e01-875e-d68da0b942ac None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:50.923292 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-9ecf3482-6eae-4e01-875e-d68da0b942ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:50.980009 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf3482-6eae-4e01-875e-d68da0b942ac None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:51.207550 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c9b636-52a3-4933-99b6-b5a74bdd8ac7 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:51.229350 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a00cb0d-59d0-4ac9-ae42-5ceaee5615fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:51.237325 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00cb0d-59d0-4ac9-ae42-5ceaee5615fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:51.239862 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00cb0d-59d0-4ac9-ae42-5ceaee5615fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:51.240875 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00cb0d-59d0-4ac9-ae42-5ceaee5615fc admin admin] PATH_INFO: `/v3/projects/5b45a467bac44680a790b4d3336e6daa/users/5cb15f24e9794d6494a910b139cdbc9c/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:51.263358 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cdf434-a42c-4df9-a4a0-1f64c8ba8a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:51.264372 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cdf434-a42c-4df9-a4a0-1f64c8ba8a19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:51.264661 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cdf434-a42c-4df9-a4a0-1f64c8ba8a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:51.264951 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cdf434-a42c-4df9-a4a0-1f64c8ba8a19 admin admin] PATH_INFO: `/v3/projects/30b4938efa144fc894f48a438830318e/users/144e001a72904e5ba28c80970e07319b/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:51.300554 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a00cb0d-59d0-4ac9-ae42-5ceaee5615fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b45a467bac44680a790b4d3336e6daa, user_id=5cb15f24e9794d6494a910b139cdbc9c, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:51.308949 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a00cb0d-59d0-4ac9-ae42-5ceaee5615fc admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:51.318488 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cdf434-a42c-4df9-a4a0-1f64c8ba8a19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30b4938efa144fc894f48a438830318e, user_id=144e001a72904e5ba28c80970e07319b, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:51.335254 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cdf434-a42c-4df9-a4a0-1f64c8ba8a19 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:51.433175 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 865/1714] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:27:50 2022] PUT /identity/v3/projects/5b45a467bac44680a790b4d3336e6daa/users/5cb15f24e9794d6494a910b139cdbc9c/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:27:51.433175 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd1fee-f469-4d7f-a587-03dfde761b10 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:51.433175 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd1fee-f469-4d7f-a587-03dfde761b10 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:51.433175 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd1fee-f469-4d7f-a587-03dfde761b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:51.433826 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 850/1715] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:27:50 2022] PUT /identity/v3/projects/30b4938efa144fc894f48a438830318e/users/144e001a72904e5ba28c80970e07319b/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:27:51.446104 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cdf434-a42c-4df9-a4a0-1f64c8ba8a19 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:51.450025 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-88cdf434-a42c-4df9-a4a0-1f64c8ba8a19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:51.539913 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-21cd1fee-f469-4d7f-a587-03dfde761b10 None None] MFA Rules not processed for user `9dfc8205c02f4f83bafdac7217b3e685`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:27:51.539913 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-21cd1fee-f469-4d7f-a587-03dfde761b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:51.623912 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cdf434-a42c-4df9-a4a0-1f64c8ba8a19 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:51.740641 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 866/1716] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:27:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:27:51.743877 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d8f4e-6587-4310-af1b-3d862773d620 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:51.743877 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d8f4e-6587-4310-af1b-3d862773d620 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:51.743877 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d8f4e-6587-4310-af1b-3d862773d620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:51.750677 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd67aa1-25dc-4800-b6eb-8e9fae4fe596 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:51.752299 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd67aa1-25dc-4800-b6eb-8e9fae4fe596 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:51.752687 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd67aa1-25dc-4800-b6eb-8e9fae4fe596 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:51.753042 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd67aa1-25dc-4800-b6eb-8e9fae4fe596 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:51.764061 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd67aa1-25dc-4800-b6eb-8e9fae4fe596 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:51.766007 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd67aa1-25dc-4800-b6eb-8e9fae4fe596 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:51.792469 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 851/1717] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:27:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:27:51.795598 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa7a16b-649e-4e6d-8ad4-8ed56f1df951 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:51.797429 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa7a16b-649e-4e6d-8ad4-8ed56f1df951 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:51.797621 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa7a16b-649e-4e6d-8ad4-8ed56f1df951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:51.832579 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-af5d8f4e-6587-4310-af1b-3d862773d620 None None] MFA Rules not processed for user `5cb15f24e9794d6494a910b139cdbc9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:27:51.834202 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-af5d8f4e-6587-4310-af1b-3d862773d620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:51.874163 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-6aa7a16b-649e-4e6d-8ad4-8ed56f1df951 None None] MFA Rules not processed for user `144e001a72904e5ba28c80970e07319b`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:27:51.878384 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-6aa7a16b-649e-4e6d-8ad4-8ed56f1df951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:51.954369 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 867/1718] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:27:51 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:27:51.955824 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d8f4e-6587-4310-af1b-3d862773d620 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:51.957635 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-af5d8f4e-6587-4310-af1b-3d862773d620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:52.057793 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d8f4e-6587-4310-af1b-3d862773d620 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:52.067374 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8dbb62-33ba-47b6-a14b-da0e17fd4921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:52.071632 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8dbb62-33ba-47b6-a14b-da0e17fd4921 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:52.072610 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8dbb62-33ba-47b6-a14b-da0e17fd4921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:52.073811 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8dbb62-33ba-47b6-a14b-da0e17fd4921 admin admin] PATH_INFO: `/v3/users/c7e328938e014639abc9343af76804bd` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:52.077893 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8dbb62-33ba-47b6-a14b-da0e17fd4921 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7e328938e014639abc9343af76804bd)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:52.081686 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8dbb62-33ba-47b6-a14b-da0e17fd4921 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:52.109956 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 852/1719] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:27:51 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:27:52.109956 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa7a16b-649e-4e6d-8ad4-8ed56f1df951 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:52.113713 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-6aa7a16b-649e-4e6d-8ad4-8ed56f1df951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:52.152163 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa7a16b-649e-4e6d-8ad4-8ed56f1df951 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:52.161571 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39078e0c-5669-43ae-a89c-a9504bb6ad65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:52.161571 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39078e0c-5669-43ae-a89c-a9504bb6ad65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:52.161571 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39078e0c-5669-43ae-a89c-a9504bb6ad65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:52.161571 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39078e0c-5669-43ae-a89c-a9504bb6ad65 admin admin] PATH_INFO: `/v3/projects/7fd0e568dcf24a26b61ef6b2ef16496c` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:52.163032 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39078e0c-5669-43ae-a89c-a9504bb6ad65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fd0e568dcf24a26b61ef6b2ef16496c)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:52.165518 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39078e0c-5669-43ae-a89c-a9504bb6ad65 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:52.390619 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-ea8dbb62-33ba-47b6-a14b-da0e17fd4921 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7e328938e014639abc9343af76804bd'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:52.409118 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-ea8dbb62-33ba-47b6-a14b-da0e17fd4921 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7e328938e014639abc9343af76804bd'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:52.454026 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-39078e0c-5669-43ae-a89c-a9504bb6ad65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fd0e568dcf24a26b61ef6b2ef16496c', 'request_id': 'req-39078e0c-5669-43ae-a89c-a9504bb6ad65'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:52.483469 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-39078e0c-5669-43ae-a89c-a9504bb6ad65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fd0e568dcf24a26b61ef6b2ef16496c', 'request_id': 'req-39078e0c-5669-43ae-a89c-a9504bb6ad65'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:52.531224 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-ea8dbb62-33ba-47b6-a14b-da0e17fd4921 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7e328938e014639abc9343af76804bd'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:52.531950 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-ea8dbb62-33ba-47b6-a14b-da0e17fd4921 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7e328938e014639abc9343af76804bd'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:52.534676 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-ea8dbb62-33ba-47b6-a14b-da0e17fd4921 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7e328938e014639abc9343af76804bd'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:52.568341 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 868/1720] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:27:51 2022] DELETE /identity/v3/users/c7e328938e014639abc9343af76804bd => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:27:52.569296 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8dbb62-33ba-47b6-a14b-da0e17fd4921 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:52.572910 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-ea8dbb62-33ba-47b6-a14b-da0e17fd4921 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:52.614819 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-39078e0c-5669-43ae-a89c-a9504bb6ad65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fd0e568dcf24a26b61ef6b2ef16496c', 'request_id': 'req-39078e0c-5669-43ae-a89c-a9504bb6ad65'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:52.644591 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-39078e0c-5669-43ae-a89c-a9504bb6ad65 admin admin] The token cache is being invalidate because project 7fd0e568dcf24a26b61ef6b2ef16496c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:27:52.644900 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-39078e0c-5669-43ae-a89c-a9504bb6ad65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:52.654373 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-39078e0c-5669-43ae-a89c-a9504bb6ad65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:52.661021 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 853/1721] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:27:52 2022] DELETE /identity/v3/projects/7fd0e568dcf24a26b61ef6b2ef16496c => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:27:52.664674 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39078e0c-5669-43ae-a89c-a9504bb6ad65 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:52.668630 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-39078e0c-5669-43ae-a89c-a9504bb6ad65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:52.871679 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39078e0c-5669-43ae-a89c-a9504bb6ad65 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:52.877339 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8dbb62-33ba-47b6-a14b-da0e17fd4921 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:52.896277 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6281580-9fbb-4de6-b6f8-d2c008288c67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cd81f6620f410db450871fb29961f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:52.897357 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6281580-9fbb-4de6-b6f8-d2c008288c67 service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:52.897652 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6281580-9fbb-4de6-b6f8-d2c008288c67 service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:52.897931 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6281580-9fbb-4de6-b6f8-d2c008288c67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:52.905071 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d6281580-9fbb-4de6-b6f8-d2c008288c67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:52.990851 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2903e5-fe7d-4312-8951-801f1193f0eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:52.991535 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2903e5-fe7d-4312-8951-801f1193f0eb service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:52.991910 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2903e5-fe7d-4312-8951-801f1193f0eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:52.992189 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2903e5-fe7d-4312-8951-801f1193f0eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:52.997411 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-df2903e5-fe7d-4312-8951-801f1193f0eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:53.104083 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6281580-9fbb-4de6-b6f8-d2c008288c67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:53.105753 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6281580-9fbb-4de6-b6f8-d2c008288c67 service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:53.127382 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2903e5-fe7d-4312-8951-801f1193f0eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:53.131846 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2903e5-fe7d-4312-8951-801f1193f0eb service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:53.149610 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 854/1722] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:27:52 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:27:53.152592 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 869/1723] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:27:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:27:53.178649 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2903e5-fe7d-4312-8951-801f1193f0eb service cinder] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:53.180130 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d94ec2-482a-4dfd-80a8-f242628e4a0d None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:53.180395 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d94ec2-482a-4dfd-80a8-f242628e4a0d None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:53.180697 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d94ec2-482a-4dfd-80a8-f242628e4a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:53.185930 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-df2903e5-fe7d-4312-8951-801f1193f0eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:53.288738 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-07d94ec2-482a-4dfd-80a8-f242628e4a0d None None] MFA Rules not processed for user `eb071251b5b74ab8b03e312de3bc945e`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:27:53.300512 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-07d94ec2-482a-4dfd-80a8-f242628e4a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:53.389619 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2903e5-fe7d-4312-8951-801f1193f0eb service cinder] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:53.404304 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d203f-b090-4023-9243-bc185790c3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:53.405101 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d203f-b090-4023-9243-bc185790c3ab admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:53.405423 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d203f-b090-4023-9243-bc185790c3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:53.405810 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d203f-b090-4023-9243-bc185790c3ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:53.406574 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d203f-b090-4023-9243-bc185790c3ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:53.409630 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d203f-b090-4023-9243-bc185790c3ab admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:53.554003 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 855/1724] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:27:53 2022] POST /identity/v3/projects => generated 399 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:27:53.565577 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d4b0b-f8fb-409d-9c24-79459a6c0d01 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:53.566167 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d4b0b-f8fb-409d-9c24-79459a6c0d01 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:53.566626 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d4b0b-f8fb-409d-9c24-79459a6c0d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:53.600684 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-ce8d4b0b-f8fb-409d-9c24-79459a6c0d01 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:27:53.602147 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-ce8d4b0b-f8fb-409d-9c24-79459a6c0d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:53.626024 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 870/1725] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:27:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 448 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:27:53.629239 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42444bdc-31c3-429d-ba91-21786129604a None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:53.629472 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42444bdc-31c3-429d-ba91-21786129604a None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:53.629766 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42444bdc-31c3-429d-ba91-21786129604a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:53.716078 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-42444bdc-31c3-429d-ba91-21786129604a None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:27:53.716078 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-42444bdc-31c3-429d-ba91-21786129604a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:53.779221 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 856/1726] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:27:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:27:53.779221 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d4b0b-f8fb-409d-9c24-79459a6c0d01 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:53.800179 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d4b0b-f8fb-409d-9c24-79459a6c0d01 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:53.807834 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66155bd5-84b7-40e3-8e0f-15b8bf24f734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:53.812996 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66155bd5-84b7-40e3-8e0f-15b8bf24f734 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:53.812996 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66155bd5-84b7-40e3-8e0f-15b8bf24f734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:53.812996 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66155bd5-84b7-40e3-8e0f-15b8bf24f734 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:53.812996 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66155bd5-84b7-40e3-8e0f-15b8bf24f734 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:53.812996 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66155bd5-84b7-40e3-8e0f-15b8bf24f734 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:53.943982 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 871/1727] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:27:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:27:53.945021 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42444bdc-31c3-429d-ba91-21786129604a None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:53.948232 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-42444bdc-31c3-429d-ba91-21786129604a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:53.953561 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 857/1728] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:27:53 2022] POST /identity/v3/users => generated 306 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:27:53.954551 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66155bd5-84b7-40e3-8e0f-15b8bf24f734 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:53.962996 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-66155bd5-84b7-40e3-8e0f-15b8bf24f734 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:54.124924 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66155bd5-84b7-40e3-8e0f-15b8bf24f734 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:54.137579 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e408ca0-bce3-44d5-84aa-1b00e94a7a59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:54.138288 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e408ca0-bce3-44d5-84aa-1b00e94a7a59 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:54.138580 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e408ca0-bce3-44d5-84aa-1b00e94a7a59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:54.138865 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e408ca0-bce3-44d5-84aa-1b00e94a7a59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:54.143819 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42444bdc-31c3-429d-ba91-21786129604a None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:54.160647 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcdff31-742c-40c5-9aff-bc1fe4b974ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cd81f6620f410db450871fb29961f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:54.163264 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcdff31-742c-40c5-9aff-bc1fe4b974ec service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:54.163560 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcdff31-742c-40c5-9aff-bc1fe4b974ec service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:54.163906 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcdff31-742c-40c5-9aff-bc1fe4b974ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:54.169487 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e408ca0-bce3-44d5-84aa-1b00e94a7a59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:54.170969 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e408ca0-bce3-44d5-84aa-1b00e94a7a59 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:54.186885 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 858/1729] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:27:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:27:54.188574 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0ce5e-2948-48b6-bcc3-3501b46f8423 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:54.188891 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0ce5e-2948-48b6-bcc3-3501b46f8423 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:54.189125 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0ce5e-2948-48b6-bcc3-3501b46f8423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:54.251455 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-faf0ce5e-2948-48b6-bcc3-3501b46f8423 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:27:54.253980 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-faf0ce5e-2948-48b6-bcc3-3501b46f8423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:54.299930 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 859/1730] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:27:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:27:54.301088 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf0ce5e-2948-48b6-bcc3-3501b46f8423 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:54.334671 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf0ce5e-2948-48b6-bcc3-3501b46f8423 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:54.361048 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcdff31-742c-40c5-9aff-bc1fe4b974ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:54.362815 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcdff31-742c-40c5-9aff-bc1fe4b974ec service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:54.380363 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a73d55-2bab-4788-b577-c4c7da7274b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:54.383222 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a73d55-2bab-4788-b577-c4c7da7274b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:54.383475 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a73d55-2bab-4788-b577-c4c7da7274b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:54.383776 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a73d55-2bab-4788-b577-c4c7da7274b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:54.387785 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 872/1731] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:27:53 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:27:54.389322 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92065613-f9f8-456d-bb15-d8e5cac8ed62 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:54.389637 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92065613-f9f8-456d-bb15-d8e5cac8ed62 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:54.392875 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a73d55-2bab-4788-b577-c4c7da7274b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:54.396808 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a73d55-2bab-4788-b577-c4c7da7274b8 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:54.411702 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92065613-f9f8-456d-bb15-d8e5cac8ed62 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:54.413513 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 873/1732] 10.222.0.24 () {54 vars in 921 bytes} [Thu Apr 7 06:27:54 2022] GET /identity => generated 270 bytes in 25 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:27:54.414384 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92065613-f9f8-456d-bb15-d8e5cac8ed62 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:54.492303 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 860/1733] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:27:54 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:27:54.493123 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92065613-f9f8-456d-bb15-d8e5cac8ed62 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:54.498688 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a73d55-2bab-4788-b577-c4c7da7274b8 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:54.517189 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf4fc9f-5941-432e-a1c2-63c72795bdf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:54.517992 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4fc9f-5941-432e-a1c2-63c72795bdf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:54.518345 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4fc9f-5941-432e-a1c2-63c72795bdf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:54.518630 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4fc9f-5941-432e-a1c2-63c72795bdf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:54.519378 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf4fc9f-5941-432e-a1c2-63c72795bdf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:27:54.519723 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf4fc9f-5941-432e-a1c2-63c72795bdf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:54.529420 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a73d55-2bab-4788-b577-c4c7da7274b8 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:54.533241 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf4fc9f-5941-432e-a1c2-63c72795bdf0 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:54.582085 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 874/1734] 10.222.0.24 () {58 vars in 1152 bytes} [Thu Apr 7 06:27:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:27:54.582271 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76487b9-3ac7-49f8-9e7c-1befdab5eeb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:54.582519 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a808acae-54fd-418d-941d-9f347f888fa9 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:54.597102 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a808acae-54fd-418d-941d-9f347f888fa9 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:54.597102 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a808acae-54fd-418d-941d-9f347f888fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:54.597932 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76487b9-3ac7-49f8-9e7c-1befdab5eeb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:54.597932 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76487b9-3ac7-49f8-9e7c-1befdab5eeb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:54.597932 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76487b9-3ac7-49f8-9e7c-1befdab5eeb5 admin admin] PATH_INFO: `/v3/projects/34e6a4891023445d9723606fd2d6f3f3/users/c69d3f7bf6a7471da99ff8226b085a5d/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:54.623683 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-a808acae-54fd-418d-941d-9f347f888fa9 None None] MFA Rules not processed for user `02cd81f6620f410db450871fb29961f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:27:54.627053 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a808acae-54fd-418d-941d-9f347f888fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:54.667650 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 875/1735] 10.222.0.24 () {58 vars in 1018 bytes} [Thu Apr 7 06:27:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:27:54.668947 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a808acae-54fd-418d-941d-9f347f888fa9 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:54.701449 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76487b9-3ac7-49f8-9e7c-1befdab5eeb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34e6a4891023445d9723606fd2d6f3f3, user_id=c69d3f7bf6a7471da99ff8226b085a5d, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:54.702928 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a808acae-54fd-418d-941d-9f347f888fa9 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:54.728409 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76487b9-3ac7-49f8-9e7c-1befdab5eeb5 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:54.742681 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84ed9b-9008-4e44-b2ab-bf544096ac09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:54.743494 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84ed9b-9008-4e44-b2ab-bf544096ac09 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:54.743921 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84ed9b-9008-4e44-b2ab-bf544096ac09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:54.744899 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84ed9b-9008-4e44-b2ab-bf544096ac09 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:54.746481 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af84ed9b-9008-4e44-b2ab-bf544096ac09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:54.752419 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af84ed9b-9008-4e44-b2ab-bf544096ac09 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:54.855241 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 861/1736] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:27:54 2022] PUT /identity/v3/projects/34e6a4891023445d9723606fd2d6f3f3/users/c69d3f7bf6a7471da99ff8226b085a5d/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:27:54.859377 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76487b9-3ac7-49f8-9e7c-1befdab5eeb5 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:54.967954 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 876/1737] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:27:54 2022] POST /identity/v3/projects => generated 363 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:27:54.974864 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84ed9b-9008-4e44-b2ab-bf544096ac09 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:55.066384 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76487b9-3ac7-49f8-9e7c-1befdab5eeb5 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:55.133069 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84ed9b-9008-4e44-b2ab-bf544096ac09 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:55.147305 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2bedf4-9f06-4e23-b92c-714410795309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:55.155010 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2bedf4-9f06-4e23-b92c-714410795309 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:55.155304 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2bedf4-9f06-4e23-b92c-714410795309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:55.155617 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2bedf4-9f06-4e23-b92c-714410795309 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:55.165290 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2bedf4-9f06-4e23-b92c-714410795309 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:55.171107 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2bedf4-9f06-4e23-b92c-714410795309 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:55.278257 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600d32db-f240-4b15-a6e1-61825c63d524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:55.278257 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d32db-f240-4b15-a6e1-61825c63d524 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:55.278882 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d32db-f240-4b15-a6e1-61825c63d524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:55.278882 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d32db-f240-4b15-a6e1-61825c63d524 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:55.284017 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600d32db-f240-4b15-a6e1-61825c63d524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:55.286016 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600d32db-f240-4b15-a6e1-61825c63d524 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:55.307508 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 877/1738] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:27:54 2022] POST /identity/v3/users => generated 282 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:27:55.310305 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2bedf4-9f06-4e23-b92c-714410795309 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:55.356090 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 862/1739] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:27:54 2022] GET /identity/v3/roles => generated 1420 bytes in 495 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:27:55.357592 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600d32db-f240-4b15-a6e1-61825c63d524 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:55.393845 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600d32db-f240-4b15-a6e1-61825c63d524 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:55.413542 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e9102-be2e-4851-aa9c-864d31457078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:55.413542 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e9102-be2e-4851-aa9c-864d31457078 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:55.413542 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e9102-be2e-4851-aa9c-864d31457078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:55.415810 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e9102-be2e-4851-aa9c-864d31457078 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:55.416932 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684e9102-be2e-4851-aa9c-864d31457078 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:55.421161 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684e9102-be2e-4851-aa9c-864d31457078 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:55.454275 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 863/1740] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:27:55.464642 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e9102-be2e-4851-aa9c-864d31457078 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:55.493905 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e9102-be2e-4851-aa9c-864d31457078 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:55.514171 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f355cd5e-6ab6-45f0-b400-58aa6cf7591c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:55.515394 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355cd5e-6ab6-45f0-b400-58aa6cf7591c admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:55.515780 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355cd5e-6ab6-45f0-b400-58aa6cf7591c admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:55.516144 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355cd5e-6ab6-45f0-b400-58aa6cf7591c admin admin] PATH_INFO: `/v3/projects/34e6a4891023445d9723606fd2d6f3f3/users/c69d3f7bf6a7471da99ff8226b085a5d/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:55.519529 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2bedf4-9f06-4e23-b92c-714410795309 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:55.524570 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f355cd5e-6ab6-45f0-b400-58aa6cf7591c admin admin] RBAC: Authorizing `identity:create_grant(project_id=34e6a4891023445d9723606fd2d6f3f3, user_id=c69d3f7bf6a7471da99ff8226b085a5d, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:55.536016 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f355cd5e-6ab6-45f0-b400-58aa6cf7591c admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:55.563349 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc9b816-63e1-4dd7-a0df-3ba99f113e94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cd81f6620f410db450871fb29961f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:55.564903 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9b816-63e1-4dd7-a0df-3ba99f113e94 service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:55.565185 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9b816-63e1-4dd7-a0df-3ba99f113e94 service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:55.565663 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9b816-63e1-4dd7-a0df-3ba99f113e94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:55.582673 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc9b816-63e1-4dd7-a0df-3ba99f113e94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:55.586424 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc9b816-63e1-4dd7-a0df-3ba99f113e94 service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:55.592167 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 864/1741] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:27:55 2022] PUT /identity/v3/projects/34e6a4891023445d9723606fd2d6f3f3/users/c69d3f7bf6a7471da99ff8226b085a5d/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:27:55.593213 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f355cd5e-6ab6-45f0-b400-58aa6cf7591c admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:55.616203 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 878/1742] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:27:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:27:55.618850 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd033f0b-2ef5-4e4f-b1f0-648431b0a56f None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:55.619068 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd033f0b-2ef5-4e4f-b1f0-648431b0a56f None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:55.627719 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd033f0b-2ef5-4e4f-b1f0-648431b0a56f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:55.701156 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-dd033f0b-2ef5-4e4f-b1f0-648431b0a56f None None] MFA Rules not processed for user `c69d3f7bf6a7471da99ff8226b085a5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:27:55.701156 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-dd033f0b-2ef5-4e4f-b1f0-648431b0a56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:55.807855 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f355cd5e-6ab6-45f0-b400-58aa6cf7591c admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:55.820119 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd1aa8-c609-4fc2-8a54-6e55096cca24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:55.820974 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd1aa8-c609-4fc2-8a54-6e55096cca24 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:55.821325 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd1aa8-c609-4fc2-8a54-6e55096cca24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:55.821612 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd1aa8-c609-4fc2-8a54-6e55096cca24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:55.822368 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdd1aa8-c609-4fc2-8a54-6e55096cca24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:55.826478 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdd1aa8-c609-4fc2-8a54-6e55096cca24 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:55.861444 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 865/1743] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:27:55.864719 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd1aa8-c609-4fc2-8a54-6e55096cca24 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:55.890285 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd1aa8-c609-4fc2-8a54-6e55096cca24 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:55.902783 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f8fed3-cec4-4468-94ef-6808f016a3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:55.905672 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8fed3-cec4-4468-94ef-6808f016a3af admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:55.905963 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8fed3-cec4-4468-94ef-6808f016a3af admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:55.906250 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8fed3-cec4-4468-94ef-6808f016a3af admin admin] PATH_INFO: `/v3/projects/977099962b8e43a6ba8e7ba5f5aeed55/users/1b24d691db374688b0f01d34c78aaae7/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:55.946951 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f8fed3-cec4-4468-94ef-6808f016a3af admin admin] RBAC: Authorizing `identity:create_grant(project_id=977099962b8e43a6ba8e7ba5f5aeed55, user_id=1b24d691db374688b0f01d34c78aaae7, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:55.951875 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f8fed3-cec4-4468-94ef-6808f016a3af admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:56.017174 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 879/1744] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:27:55 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:27:56.022515 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd033f0b-2ef5-4e4f-b1f0-648431b0a56f None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:56.027776 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-dd033f0b-2ef5-4e4f-b1f0-648431b0a56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:56.072509 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 866/1745] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:27:55 2022] PUT /identity/v3/projects/977099962b8e43a6ba8e7ba5f5aeed55/users/1b24d691db374688b0f01d34c78aaae7/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:27:56.083966 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0aac0-d459-42fa-b7bf-0ed2c38777f7 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:56.084330 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0aac0-d459-42fa-b7bf-0ed2c38777f7 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:56.084679 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0aac0-d459-42fa-b7bf-0ed2c38777f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:56.179610 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-b1e0aac0-d459-42fa-b7bf-0ed2c38777f7 None None] MFA Rules not processed for user `1b24d691db374688b0f01d34c78aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:27:56.182560 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b1e0aac0-d459-42fa-b7bf-0ed2c38777f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:56.273798 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd033f0b-2ef5-4e4f-b1f0-648431b0a56f None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:56.354148 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 867/1746] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:27:56 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:27:56.359155 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab72c6-7dcf-410b-8f72-af2aed9cccc5 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:56.359880 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab72c6-7dcf-410b-8f72-af2aed9cccc5 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:56.368615 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab72c6-7dcf-410b-8f72-af2aed9cccc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:56.449573 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a63fee-f1ae-407f-97e6-9930bfc530c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:56.450330 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a63fee-f1ae-407f-97e6-9930bfc530c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:56.450669 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a63fee-f1ae-407f-97e6-9930bfc530c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:56.451005 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a63fee-f1ae-407f-97e6-9930bfc530c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:56.462197 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-ceab72c6-7dcf-410b-8f72-af2aed9cccc5 None None] MFA Rules not processed for user `c9ac85053def476489ee1843bbd02316`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:27:56.466794 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-ceab72c6-7dcf-410b-8f72-af2aed9cccc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:56.638948 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a63fee-f1ae-407f-97e6-9930bfc530c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:56.643176 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a63fee-f1ae-407f-97e6-9930bfc530c5 service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:56.674430 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 880/1747] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:27:56 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 652 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:27:56.675463 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a63fee-f1ae-407f-97e6-9930bfc530c5 service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:56.759313 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 868/1748] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:27:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:27:56.759313 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab72c6-7dcf-410b-8f72-af2aed9cccc5 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:56.885037 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a63fee-f1ae-407f-97e6-9930bfc530c5 service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:56.898474 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd7ab5c-a5ac-4c4e-b17a-b81320a01d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:56.899232 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd7ab5c-a5ac-4c4e-b17a-b81320a01d64 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:56.899931 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd7ab5c-a5ac-4c4e-b17a-b81320a01d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:56.899931 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd7ab5c-a5ac-4c4e-b17a-b81320a01d64 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:56.900840 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd7ab5c-a5ac-4c4e-b17a-b81320a01d64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:56.908836 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd7ab5c-a5ac-4c4e-b17a-b81320a01d64 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:56.976255 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab72c6-7dcf-410b-8f72-af2aed9cccc5 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:56.994734 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a65154-38cc-4f86-a1bf-695ce5221471 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cd81f6620f410db450871fb29961f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:56.995632 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a65154-38cc-4f86-a1bf-695ce5221471 service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:56.996079 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a65154-38cc-4f86-a1bf-695ce5221471 service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:56.996952 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a65154-38cc-4f86-a1bf-695ce5221471 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:57.016722 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a65154-38cc-4f86-a1bf-695ce5221471 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:57.022209 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a65154-38cc-4f86-a1bf-695ce5221471 service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:57.055204 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 869/1749] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:27:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:27:57.103002 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a65154-38cc-4f86-a1bf-695ce5221471 service nova] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:57.127820 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 881/1750] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:27:56 2022] POST /identity/v3/projects => generated 365 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:27:57.128621 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a65154-38cc-4f86-a1bf-695ce5221471 service nova] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:57.132248 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd7ab5c-a5ac-4c4e-b17a-b81320a01d64 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:57.305003 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce3772-c356-478b-92c8-04b9c45846d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:57.305826 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce3772-c356-478b-92c8-04b9c45846d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:57.306775 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce3772-c356-478b-92c8-04b9c45846d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:57.307146 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce3772-c356-478b-92c8-04b9c45846d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:57.326097 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-73ce3772-c356-478b-92c8-04b9c45846d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:57.425082 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd7ab5c-a5ac-4c4e-b17a-b81320a01d64 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:57.445709 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ab208-8515-4aed-84e6-ad9d7f5c6a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:57.446595 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ab208-8515-4aed-84e6-ad9d7f5c6a07 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:57.446887 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ab208-8515-4aed-84e6-ad9d7f5c6a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:57.447352 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ab208-8515-4aed-84e6-ad9d7f5c6a07 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:57.448201 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784ab208-8515-4aed-84e6-ad9d7f5c6a07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:57.450346 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784ab208-8515-4aed-84e6-ad9d7f5c6a07 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:57.562363 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 882/1751] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:27:57 2022] POST /identity/v3/users => generated 289 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:27:57.566663 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ab208-8515-4aed-84e6-ad9d7f5c6a07 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:57.595314 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ab208-8515-4aed-84e6-ad9d7f5c6a07 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:57.617150 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ce3772-c356-478b-92c8-04b9c45846d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:57.620253 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ce3772-c356-478b-92c8-04b9c45846d2 service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:57.667675 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f159bd0f-2b66-4fdc-850b-4f7675297a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:57.667675 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159bd0f-2b66-4fdc-850b-4f7675297a8f admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:57.667675 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159bd0f-2b66-4fdc-850b-4f7675297a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:57.667675 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159bd0f-2b66-4fdc-850b-4f7675297a8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:57.668413 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f159bd0f-2b66-4fdc-850b-4f7675297a8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:57.668483 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 870/1752] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:27:57 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 07 06:27:57.668552 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f159bd0f-2b66-4fdc-850b-4f7675297a8f admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:57.668618 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce3772-c356-478b-92c8-04b9c45846d2 service cinder] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:57.680936 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-73ce3772-c356-478b-92c8-04b9c45846d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:57.701720 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 883/1753] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:27:57 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 07 06:27:57.707604 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f159bd0f-2b66-4fdc-850b-4f7675297a8f admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:57.738363 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f159bd0f-2b66-4fdc-850b-4f7675297a8f admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:57.747209 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce3772-c356-478b-92c8-04b9c45846d2 service cinder] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:57.748255 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d1a50f-fdc5-41df-a66e-cdb70fc44c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:57.749275 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1a50f-fdc5-41df-a66e-cdb70fc44c0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:57.749578 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1a50f-fdc5-41df-a66e-cdb70fc44c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:57.749853 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1a50f-fdc5-41df-a66e-cdb70fc44c0c admin admin] PATH_INFO: `/v3/projects/c1c6ce22a8ec4f3ea9bd2ff0592571fa/users/2c397ac332014d09bd6ecc17b602f597/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:57.792582 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ada829-fd1d-4e97-8236-07acdc99485a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:57.793550 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ada829-fd1d-4e97-8236-07acdc99485a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:57.793792 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ada829-fd1d-4e97-8236-07acdc99485a admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:57.794068 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ada829-fd1d-4e97-8236-07acdc99485a admin admin] PATH_INFO: `/v3/projects/5f38ef56c5fe44679764a8d97f28112b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:57.802477 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ada829-fd1d-4e97-8236-07acdc99485a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f38ef56c5fe44679764a8d97f28112b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:57.804399 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ada829-fd1d-4e97-8236-07acdc99485a admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:57.838787 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d1a50f-fdc5-41df-a66e-cdb70fc44c0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1c6ce22a8ec4f3ea9bd2ff0592571fa, user_id=2c397ac332014d09bd6ecc17b602f597, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:57.844012 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d1a50f-fdc5-41df-a66e-cdb70fc44c0c admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:58.067539 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 884/1754] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:27:57 2022] PUT /identity/v3/projects/c1c6ce22a8ec4f3ea9bd2ff0592571fa/users/2c397ac332014d09bd6ecc17b602f597/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:27:58.071329 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d1a50f-fdc5-41df-a66e-cdb70fc44c0c admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:58.144022 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-28ada829-fd1d-4e97-8236-07acdc99485a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f38ef56c5fe44679764a8d97f28112b', 'request_id': 'req-28ada829-fd1d-4e97-8236-07acdc99485a'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:58.170216 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-28ada829-fd1d-4e97-8236-07acdc99485a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f38ef56c5fe44679764a8d97f28112b', 'request_id': 'req-28ada829-fd1d-4e97-8236-07acdc99485a'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:58.253868 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d1a50f-fdc5-41df-a66e-cdb70fc44c0c admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:58.321143 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-28ada829-fd1d-4e97-8236-07acdc99485a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f38ef56c5fe44679764a8d97f28112b', 'request_id': 'req-28ada829-fd1d-4e97-8236-07acdc99485a'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:58.340758 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-28ada829-fd1d-4e97-8236-07acdc99485a admin admin] The token cache is being invalidate because project 5f38ef56c5fe44679764a8d97f28112b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:27:58.341049 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-28ada829-fd1d-4e97-8236-07acdc99485a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:58.343351 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-28ada829-fd1d-4e97-8236-07acdc99485a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:58.347006 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 871/1755] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:27:57 2022] DELETE /identity/v3/projects/5f38ef56c5fe44679764a8d97f28112b => generated 0 bytes in 698 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:27:58.350448 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ada829-fd1d-4e97-8236-07acdc99485a admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:58.358076 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-28ada829-fd1d-4e97-8236-07acdc99485a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:58.593573 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ada829-fd1d-4e97-8236-07acdc99485a admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:58.609940 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b618271b-eee7-49e0-98a1-6b2717a4338a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:58.610825 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618271b-eee7-49e0-98a1-6b2717a4338a admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:58.611183 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618271b-eee7-49e0-98a1-6b2717a4338a admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:58.611615 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618271b-eee7-49e0-98a1-6b2717a4338a admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:58.612509 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b618271b-eee7-49e0-98a1-6b2717a4338a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:58.614547 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b618271b-eee7-49e0-98a1-6b2717a4338a admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:58.617466 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b422e2bc-0ea2-4e6d-bc7f-36ca1abd2cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:58.621173 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422e2bc-0ea2-4e6d-bc7f-36ca1abd2cc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:58.622404 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422e2bc-0ea2-4e6d-bc7f-36ca1abd2cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:58.622693 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422e2bc-0ea2-4e6d-bc7f-36ca1abd2cc4 admin admin] PATH_INFO: `/v3/users/78f63209d6fa402182b2b02f86d71129` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:58.627245 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b422e2bc-0ea2-4e6d-bc7f-36ca1abd2cc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78f63209d6fa402182b2b02f86d71129)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:58.642842 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b422e2bc-0ea2-4e6d-bc7f-36ca1abd2cc4 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:58.679247 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 885/1756] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 607 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:27:58.682763 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b618271b-eee7-49e0-98a1-6b2717a4338a admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:58.686791 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b618271b-eee7-49e0-98a1-6b2717a4338a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:58.752302 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b618271b-eee7-49e0-98a1-6b2717a4338a admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:58.771342 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0446e8d-39d3-4f68-bb5e-9b81bcd8e3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:58.772044 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0446e8d-39d3-4f68-bb5e-9b81bcd8e3ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:58.778660 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0446e8d-39d3-4f68-bb5e-9b81bcd8e3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:58.778660 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0446e8d-39d3-4f68-bb5e-9b81bcd8e3ea admin admin] PATH_INFO: `/v3/projects/c1c6ce22a8ec4f3ea9bd2ff0592571fa/users/2c397ac332014d09bd6ecc17b602f597/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:58.778660 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0446e8d-39d3-4f68-bb5e-9b81bcd8e3ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1c6ce22a8ec4f3ea9bd2ff0592571fa, user_id=2c397ac332014d09bd6ecc17b602f597, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:58.790971 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0446e8d-39d3-4f68-bb5e-9b81bcd8e3ea admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:58.827847 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 886/1757] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:27:58 2022] PUT /identity/v3/projects/c1c6ce22a8ec4f3ea9bd2ff0592571fa/users/2c397ac332014d09bd6ecc17b602f597/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:27:58.849830 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d72f24-c3dd-416a-89ba-26b481894685 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:58.852410 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d72f24-c3dd-416a-89ba-26b481894685 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:58.852888 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d72f24-c3dd-416a-89ba-26b481894685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:58.979332 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-b0d72f24-c3dd-416a-89ba-26b481894685 None None] MFA Rules not processed for user `2c397ac332014d09bd6ecc17b602f597`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:27:58.982992 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b0d72f24-c3dd-416a-89ba-26b481894685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:59.024880 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-b422e2bc-0ea2-4e6d-bc7f-36ca1abd2cc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78f63209d6fa402182b2b02f86d71129'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:59.026646 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-b422e2bc-0ea2-4e6d-bc7f-36ca1abd2cc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78f63209d6fa402182b2b02f86d71129'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:59.134791 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-b422e2bc-0ea2-4e6d-bc7f-36ca1abd2cc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78f63209d6fa402182b2b02f86d71129'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:59.135537 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-b422e2bc-0ea2-4e6d-bc7f-36ca1abd2cc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78f63209d6fa402182b2b02f86d71129'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:59.171807 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-b422e2bc-0ea2-4e6d-bc7f-36ca1abd2cc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78f63209d6fa402182b2b02f86d71129'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:27:59.200716 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 872/1758] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:27:58 2022] DELETE /identity/v3/users/78f63209d6fa402182b2b02f86d71129 => generated 0 bytes in 850 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:27:59.224339 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 887/1759] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:27:58 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:27:59.316648 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b422e2bc-0ea2-4e6d-bc7f-36ca1abd2cc4 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:27:59.318614 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b422e2bc-0ea2-4e6d-bc7f-36ca1abd2cc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:27:59.584882 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b422e2bc-0ea2-4e6d-bc7f-36ca1abd2cc4 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:27:59.599941 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61129ed-55d8-4c1b-a41f-9d7977358e3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:27:59.600639 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61129ed-55d8-4c1b-a41f-9d7977358e3e service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:27:59.601229 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61129ed-55d8-4c1b-a41f-9d7977358e3e service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:27:59.601560 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61129ed-55d8-4c1b-a41f-9d7977358e3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:27:59.852258 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61129ed-55d8-4c1b-a41f-9d7977358e3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:27:59.854561 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61129ed-55d8-4c1b-a41f-9d7977358e3e service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:27:59.881055 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 873/1760] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:27:59 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:28:00.205266 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d72f24-c3dd-416a-89ba-26b481894685 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:00.425221 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d72f24-c3dd-416a-89ba-26b481894685 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:00.429905 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b8bdd-582a-4872-a9ab-50449459ea8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:00.430634 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b8bdd-582a-4872-a9ab-50449459ea8a service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:00.430945 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b8bdd-582a-4872-a9ab-50449459ea8a service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:00.431288 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b8bdd-582a-4872-a9ab-50449459ea8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:00.446017 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-af6b8bdd-582a-4872-a9ab-50449459ea8a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:00.630510 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6b8bdd-582a-4872-a9ab-50449459ea8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:00.632608 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6b8bdd-582a-4872-a9ab-50449459ea8a service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:00.671166 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 888/1761] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:28:00 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 07 06:28:00.701946 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61129ed-55d8-4c1b-a41f-9d7977358e3e service cinder] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:00.703525 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a61129ed-55d8-4c1b-a41f-9d7977358e3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:00.896021 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61129ed-55d8-4c1b-a41f-9d7977358e3e service cinder] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:00.922581 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d313b-4449-4eb4-85a2-8f9f6ec3d7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:00.924239 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d313b-4449-4eb4-85a2-8f9f6ec3d7e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:00.924592 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d313b-4449-4eb4-85a2-8f9f6ec3d7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:00.924906 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d313b-4449-4eb4-85a2-8f9f6ec3d7e5 admin admin] PATH_INFO: `/v3/projects/3eed173bed384c2c99856f2be57cdcf1` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:00.929551 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d313b-4449-4eb4-85a2-8f9f6ec3d7e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3eed173bed384c2c99856f2be57cdcf1)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:00.931685 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d313b-4449-4eb4-85a2-8f9f6ec3d7e5 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:01.151100 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-041d313b-4449-4eb4-85a2-8f9f6ec3d7e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3eed173bed384c2c99856f2be57cdcf1', 'request_id': 'req-041d313b-4449-4eb4-85a2-8f9f6ec3d7e5'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:01.168419 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-041d313b-4449-4eb4-85a2-8f9f6ec3d7e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3eed173bed384c2c99856f2be57cdcf1', 'request_id': 'req-041d313b-4449-4eb4-85a2-8f9f6ec3d7e5'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:01.272315 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-041d313b-4449-4eb4-85a2-8f9f6ec3d7e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3eed173bed384c2c99856f2be57cdcf1', 'request_id': 'req-041d313b-4449-4eb4-85a2-8f9f6ec3d7e5'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:01.303614 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-041d313b-4449-4eb4-85a2-8f9f6ec3d7e5 admin admin] The token cache is being invalidate because project 3eed173bed384c2c99856f2be57cdcf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:28:01.303614 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-041d313b-4449-4eb4-85a2-8f9f6ec3d7e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:01.305564 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-041d313b-4449-4eb4-85a2-8f9f6ec3d7e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:01.311469 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 874/1762] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:28:00 2022] DELETE /identity/v3/projects/3eed173bed384c2c99856f2be57cdcf1 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:28:01.316805 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc99175-c210-4772-acb0-7ab05aedf6ef None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:01.317316 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc99175-c210-4772-acb0-7ab05aedf6ef None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:01.317819 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc99175-c210-4772-acb0-7ab05aedf6ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:01.384146 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-0dc99175-c210-4772-acb0-7ab05aedf6ef None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:28:01.389315 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-0dc99175-c210-4772-acb0-7ab05aedf6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:01.560930 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 889/1763] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:28:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:28:01.570866 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f3287-2f8c-4ba1-b4ed-7a94d978b954 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:01.571519 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f3287-2f8c-4ba1-b4ed-7a94d978b954 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:01.572091 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f3287-2f8c-4ba1-b4ed-7a94d978b954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:01.627649 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-561f3287-2f8c-4ba1-b4ed-7a94d978b954 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:28:01.631191 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-561f3287-2f8c-4ba1-b4ed-7a94d978b954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:01.687764 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 875/1764] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:28:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:28:01.699222 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc99175-c210-4772-acb0-7ab05aedf6ef None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:01.717362 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc99175-c210-4772-acb0-7ab05aedf6ef None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:01.735045 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c035d8-78d7-4dbe-953e-b83050a45d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:01.736294 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c035d8-78d7-4dbe-953e-b83050a45d07 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:01.736881 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c035d8-78d7-4dbe-953e-b83050a45d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:01.740004 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c035d8-78d7-4dbe-953e-b83050a45d07 admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:01.745941 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c035d8-78d7-4dbe-953e-b83050a45d07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:28:01.748153 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c035d8-78d7-4dbe-953e-b83050a45d07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:01.754593 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c035d8-78d7-4dbe-953e-b83050a45d07 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:01.802076 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 890/1765] 10.222.0.24 () {58 vars in 1152 bytes} [Thu Apr 7 06:28:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:28:01.806150 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f3287-2f8c-4ba1-b4ed-7a94d978b954 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:01.825763 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f3287-2f8c-4ba1-b4ed-7a94d978b954 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:01.841662 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257d2d7-91f4-441f-bc7c-ca58a0c2bf1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:01.844684 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257d2d7-91f4-441f-bc7c-ca58a0c2bf1d admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:01.844991 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257d2d7-91f4-441f-bc7c-ca58a0c2bf1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:01.846576 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257d2d7-91f4-441f-bc7c-ca58a0c2bf1d admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:01.856267 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2257d2d7-91f4-441f-bc7c-ca58a0c2bf1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:01.863666 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2257d2d7-91f4-441f-bc7c-ca58a0c2bf1d admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:02.003501 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 876/1766] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:28:01 2022] POST /identity/v3/projects => generated 357 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:28:02.007864 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c035d8-78d7-4dbe-953e-b83050a45d07 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:02.035105 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c035d8-78d7-4dbe-953e-b83050a45d07 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:02.161828 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e0b88-0df7-4724-87a0-e8d051801132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:02.162540 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e0b88-0df7-4724-87a0-e8d051801132 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:02.163124 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e0b88-0df7-4724-87a0-e8d051801132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:02.163653 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e0b88-0df7-4724-87a0-e8d051801132 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:02.164562 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e0b88-0df7-4724-87a0-e8d051801132 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:02.173640 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e0b88-0df7-4724-87a0-e8d051801132 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:02.283584 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 891/1767] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:28:02 2022] POST /identity/v3/users => generated 279 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:28:02.287712 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257d2d7-91f4-441f-bc7c-ca58a0c2bf1d admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:02.301754 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257d2d7-91f4-441f-bc7c-ca58a0c2bf1d admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:02.324547 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5ded6b-a46c-470e-8007-ab6c536b4812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:02.325331 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ded6b-a46c-470e-8007-ab6c536b4812 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:02.325626 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ded6b-a46c-470e-8007-ab6c536b4812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:02.325904 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ded6b-a46c-470e-8007-ab6c536b4812 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:02.326705 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5ded6b-a46c-470e-8007-ab6c536b4812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:02.328539 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5ded6b-a46c-470e-8007-ab6c536b4812 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:02.343086 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 877/1768] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 07 06:28:02.345077 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e0b88-0df7-4724-87a0-e8d051801132 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:02.360656 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e0b88-0df7-4724-87a0-e8d051801132 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:02.373587 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d7d4fe-32f8-4aee-8e96-3b0c97746b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:02.374526 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7d4fe-32f8-4aee-8e96-3b0c97746b45 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:02.374982 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7d4fe-32f8-4aee-8e96-3b0c97746b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:02.375410 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7d4fe-32f8-4aee-8e96-3b0c97746b45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:02.376955 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d7d4fe-32f8-4aee-8e96-3b0c97746b45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:02.378825 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d7d4fe-32f8-4aee-8e96-3b0c97746b45 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:02.401929 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 892/1769] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:28:02.406119 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5ded6b-a46c-470e-8007-ab6c536b4812 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:02.420379 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5ded6b-a46c-470e-8007-ab6c536b4812 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:02.436063 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bddee3-caa8-472f-95b3-17109f5a85e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:02.437459 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bddee3-caa8-472f-95b3-17109f5a85e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:02.437757 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bddee3-caa8-472f-95b3-17109f5a85e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:02.438041 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bddee3-caa8-472f-95b3-17109f5a85e7 admin admin] PATH_INFO: `/v3/projects/6d22b06312524358888fb7686cb6dc27/users/89f65b64685744a0a2e749c74c568ba4/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:02.489306 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bddee3-caa8-472f-95b3-17109f5a85e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d22b06312524358888fb7686cb6dc27, user_id=89f65b64685744a0a2e749c74c568ba4, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:02.526414 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bddee3-caa8-472f-95b3-17109f5a85e7 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:02.624911 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 878/1770] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:28:02 2022] PUT /identity/v3/projects/6d22b06312524358888fb7686cb6dc27/users/89f65b64685744a0a2e749c74c568ba4/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:28:02.635362 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454505d7-785c-4078-af32-3f57e44dd8ad None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:02.635668 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454505d7-785c-4078-af32-3f57e44dd8ad None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:02.641210 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454505d7-785c-4078-af32-3f57e44dd8ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:02.727304 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-454505d7-785c-4078-af32-3f57e44dd8ad None None] MFA Rules not processed for user `89f65b64685744a0a2e749c74c568ba4`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:28:02.728614 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-454505d7-785c-4078-af32-3f57e44dd8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:02.906639 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 893/1771] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:28:02 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:28:02.910739 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bddee3-caa8-472f-95b3-17109f5a85e7 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:03.048470 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bddee3-caa8-472f-95b3-17109f5a85e7 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:03.063726 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea6d54-93f2-4497-a3cd-d0653ac9459b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:03.065161 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea6d54-93f2-4497-a3cd-d0653ac9459b admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:03.065655 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea6d54-93f2-4497-a3cd-d0653ac9459b admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:03.066162 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea6d54-93f2-4497-a3cd-d0653ac9459b admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:03.067056 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ea6d54-93f2-4497-a3cd-d0653ac9459b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:03.071547 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ea6d54-93f2-4497-a3cd-d0653ac9459b admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:03.227526 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 879/1772] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:28:02 2022] POST /identity/v3/projects => generated 355 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:28:03.231659 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454505d7-785c-4078-af32-3f57e44dd8ad None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:03.257344 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454505d7-785c-4078-af32-3f57e44dd8ad None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:03.436098 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3da060-bbf4-44cf-937a-68fc9791903d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:03.436098 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3da060-bbf4-44cf-937a-68fc9791903d admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:03.436098 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3da060-bbf4-44cf-937a-68fc9791903d admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:03.436098 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3da060-bbf4-44cf-937a-68fc9791903d admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:03.440190 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3da060-bbf4-44cf-937a-68fc9791903d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:03.440190 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3da060-bbf4-44cf-937a-68fc9791903d admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:03.440709 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d1dca-3c5b-4a7a-b60e-297318aeb24a None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:03.440709 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d1dca-3c5b-4a7a-b60e-297318aeb24a None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:03.440709 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d1dca-3c5b-4a7a-b60e-297318aeb24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:03.474539 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-ed4d1dca-3c5b-4a7a-b60e-297318aeb24a None None] MFA Rules not processed for user `9dfc8205c02f4f83bafdac7217b3e685`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:28:03.475883 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-ed4d1dca-3c5b-4a7a-b60e-297318aeb24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:03.545453 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 880/1773] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:28:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:28:03.696094 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef8e5ca-ec01-40df-b250-8e507efc1879 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:03.696456 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef8e5ca-ec01-40df-b250-8e507efc1879 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:03.696811 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef8e5ca-ec01-40df-b250-8e507efc1879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:03.718776 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-aef8e5ca-ec01-40df-b250-8e507efc1879 None None] MFA Rules not processed for user `eb071251b5b74ab8b03e312de3bc945e`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:28:03.720482 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-aef8e5ca-ec01-40df-b250-8e507efc1879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:03.812886 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 894/1774] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:28:03 2022] POST /identity/v3/users => generated 284 bytes in 582 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:28:03.816358 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3da060-bbf4-44cf-937a-68fc9791903d admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:03.878366 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3da060-bbf4-44cf-937a-68fc9791903d admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:03.918851 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283ee591-bf59-48f7-9723-babe7650a71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:03.919622 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283ee591-bf59-48f7-9723-babe7650a71f admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:03.919959 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283ee591-bf59-48f7-9723-babe7650a71f admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:03.920266 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283ee591-bf59-48f7-9723-babe7650a71f admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:03.921028 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283ee591-bf59-48f7-9723-babe7650a71f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:03.923303 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283ee591-bf59-48f7-9723-babe7650a71f admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:03.934886 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 881/1775] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:28:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:28:03.969803 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 895/1776] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:28:03 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:28:03.971173 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef8e5ca-ec01-40df-b250-8e507efc1879 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:03.988743 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef8e5ca-ec01-40df-b250-8e507efc1879 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:03.995660 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca24e3bc-45a3-48c3-80bf-c536e0eab952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:03.998076 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca24e3bc-45a3-48c3-80bf-c536e0eab952 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:03.998650 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca24e3bc-45a3-48c3-80bf-c536e0eab952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:03.999014 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca24e3bc-45a3-48c3-80bf-c536e0eab952 admin admin] PATH_INFO: `/v3/projects/26cbfb7aaade4581b5beea31e6907c0f/users/07c1a0612a5941ccbdb18ed424fc44bd/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:04.032970 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca24e3bc-45a3-48c3-80bf-c536e0eab952 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26cbfb7aaade4581b5beea31e6907c0f, user_id=07c1a0612a5941ccbdb18ed424fc44bd, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:04.036001 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca24e3bc-45a3-48c3-80bf-c536e0eab952 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:04.144673 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 882/1777] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:28:03 2022] PUT /identity/v3/projects/26cbfb7aaade4581b5beea31e6907c0f/users/07c1a0612a5941ccbdb18ed424fc44bd/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:28:04.145588 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283ee591-bf59-48f7-9723-babe7650a71f admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:04.156808 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283ee591-bf59-48f7-9723-babe7650a71f admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:04.193872 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e86bd89-1b51-4f62-a7a7-336544ac67cb None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:04.194260 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e86bd89-1b51-4f62-a7a7-336544ac67cb None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:04.194610 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e86bd89-1b51-4f62-a7a7-336544ac67cb None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:04.196375 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 883/1778] 10.222.0.24 () {54 vars in 912 bytes} [Thu Apr 7 06:28:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:28:04.201502 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c0edb-79a5-4b0d-8e82-bdfd3a846948 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:04.201790 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c0edb-79a5-4b0d-8e82-bdfd3a846948 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:04.202072 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c0edb-79a5-4b0d-8e82-bdfd3a846948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:04.237131 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee36cdd-0ca3-4a9f-aa5e-266f6405369d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:04.238398 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee36cdd-0ca3-4a9f-aa5e-266f6405369d admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:04.238694 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee36cdd-0ca3-4a9f-aa5e-266f6405369d admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:04.239660 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee36cdd-0ca3-4a9f-aa5e-266f6405369d admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:04.240518 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee36cdd-0ca3-4a9f-aa5e-266f6405369d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:04.242394 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee36cdd-0ca3-4a9f-aa5e-266f6405369d admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:04.245341 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-bd9c0edb-79a5-4b0d-8e82-bdfd3a846948 None None] MFA Rules not processed for user `bb7f549fd26e4642828d4f476aef0239`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:28:04.246658 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-bd9c0edb-79a5-4b0d-8e82-bdfd3a846948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:04.263460 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 896/1779] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:28:04.263460 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee36cdd-0ca3-4a9f-aa5e-266f6405369d admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:04.294243 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee36cdd-0ca3-4a9f-aa5e-266f6405369d admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:04.301612 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9344bcd-4523-46b1-a7ac-49cc3528b8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:04.302548 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9344bcd-4523-46b1-a7ac-49cc3528b8a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:04.302840 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9344bcd-4523-46b1-a7ac-49cc3528b8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:04.303123 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9344bcd-4523-46b1-a7ac-49cc3528b8a2 admin admin] PATH_INFO: `/v3/projects/26cbfb7aaade4581b5beea31e6907c0f/users/07c1a0612a5941ccbdb18ed424fc44bd/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:04.306211 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9344bcd-4523-46b1-a7ac-49cc3528b8a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26cbfb7aaade4581b5beea31e6907c0f, user_id=07c1a0612a5941ccbdb18ed424fc44bd, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:04.309409 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9344bcd-4523-46b1-a7ac-49cc3528b8a2 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:04.325230 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 897/1780] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:28:04 2022] PUT /identity/v3/projects/26cbfb7aaade4581b5beea31e6907c0f/users/07c1a0612a5941ccbdb18ed424fc44bd/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:28:04.338522 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6c843-ea4c-4619-9f65-fc4afd1f4e32 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:04.340952 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6c843-ea4c-4619-9f65-fc4afd1f4e32 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:04.342018 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6c843-ea4c-4619-9f65-fc4afd1f4e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:04.384183 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 884/1781] 10.222.0.24 () {58 vars in 1009 bytes} [Thu Apr 7 06:28:04 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:28:04.387143 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-62b6c843-ea4c-4619-9f65-fc4afd1f4e32 None None] MFA Rules not processed for user `07c1a0612a5941ccbdb18ed424fc44bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:28:04.401116 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-62b6c843-ea4c-4619-9f65-fc4afd1f4e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:04.446406 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c0edb-79a5-4b0d-8e82-bdfd3a846948 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:04.448315 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-bd9c0edb-79a5-4b0d-8e82-bdfd3a846948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:04.465295 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c0edb-79a5-4b0d-8e82-bdfd3a846948 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:04.528409 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 898/1782] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:28:04 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:28:04.541841 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b6c843-ea4c-4619-9f65-fc4afd1f4e32 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:04.544435 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-62b6c843-ea4c-4619-9f65-fc4afd1f4e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:04.574283 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4589cf06-99f3-40ee-970c-103338919cb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:04.574283 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4589cf06-99f3-40ee-970c-103338919cb5 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:04.574283 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4589cf06-99f3-40ee-970c-103338919cb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:04.574283 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4589cf06-99f3-40ee-970c-103338919cb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:04.576656 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4589cf06-99f3-40ee-970c-103338919cb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:04.578277 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4589cf06-99f3-40ee-970c-103338919cb5 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:04.588275 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 885/1783] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:28:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 07 06:28:04.628845 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b6c843-ea4c-4619-9f65-fc4afd1f4e32 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:04.632661 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e15d8-015e-4c66-822a-dd23a2e6377e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:04.633387 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e15d8-015e-4c66-822a-dd23a2e6377e service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:04.633698 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e15d8-015e-4c66-822a-dd23a2e6377e service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:04.633980 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e15d8-015e-4c66-822a-dd23a2e6377e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:04.645593 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0e15d8-015e-4c66-822a-dd23a2e6377e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:04.647029 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0e15d8-015e-4c66-822a-dd23a2e6377e service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:04.656790 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 899/1784] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:28:04 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 07 06:28:05.126911 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90d450-25cc-4fe5-a863-424aeeb5d6d2 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:05.127286 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90d450-25cc-4fe5-a863-424aeeb5d6d2 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:05.127573 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90d450-25cc-4fe5-a863-424aeeb5d6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:05.133036 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e15d8-015e-4c66-822a-dd23a2e6377e service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:05.141896 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e15d8-015e-4c66-822a-dd23a2e6377e service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:05.145074 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-cf90d450-25cc-4fe5-a863-424aeeb5d6d2 None None] MFA Rules not processed for user `c9ac85053def476489ee1843bbd02316`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:28:05.145762 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d67af-5e20-4364-98c2-532176e66f34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:05.146266 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-cf90d450-25cc-4fe5-a863-424aeeb5d6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:05.146894 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d67af-5e20-4364-98c2-532176e66f34 service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:05.147269 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d67af-5e20-4364-98c2-532176e66f34 service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:05.147659 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d67af-5e20-4364-98c2-532176e66f34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:05.210695 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 886/1785] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:28:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:28:05.222338 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740d67af-5e20-4364-98c2-532176e66f34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:05.224376 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740d67af-5e20-4364-98c2-532176e66f34 service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:05.234332 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 900/1786] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:28:05 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 07 06:28:06.236564 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf90d450-25cc-4fe5-a863-424aeeb5d6d2 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:06.238375 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-cf90d450-25cc-4fe5-a863-424aeeb5d6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:06.332044 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf90d450-25cc-4fe5-a863-424aeeb5d6d2 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:06.337684 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c83eb-e4bb-4501-9854-198b5af674cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:06.338706 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c83eb-e4bb-4501-9854-198b5af674cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:06.339231 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c83eb-e4bb-4501-9854-198b5af674cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:06.339536 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c83eb-e4bb-4501-9854-198b5af674cc admin admin] PATH_INFO: `/v3/users/144e001a72904e5ba28c80970e07319b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:06.340968 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8c83eb-e4bb-4501-9854-198b5af674cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=144e001a72904e5ba28c80970e07319b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:06.343081 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8c83eb-e4bb-4501-9854-198b5af674cc admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:06.534077 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7c8c83eb-e4bb-4501-9854-198b5af674cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '144e001a72904e5ba28c80970e07319b'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:06.534745 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7c8c83eb-e4bb-4501-9854-198b5af674cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '144e001a72904e5ba28c80970e07319b'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:06.614155 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7c8c83eb-e4bb-4501-9854-198b5af674cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '144e001a72904e5ba28c80970e07319b'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:06.617513 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7c8c83eb-e4bb-4501-9854-198b5af674cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '144e001a72904e5ba28c80970e07319b'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:06.628721 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7c8c83eb-e4bb-4501-9854-198b5af674cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '144e001a72904e5ba28c80970e07319b'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:06.640819 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 887/1787] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:28:06 2022] DELETE /identity/v3/users/144e001a72904e5ba28c80970e07319b => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:28:06.646186 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdfa500-c487-45dd-9f8e-e2fc8f3ca9d1 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:06.646652 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdfa500-c487-45dd-9f8e-e2fc8f3ca9d1 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:06.646652 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdfa500-c487-45dd-9f8e-e2fc8f3ca9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:06.663332 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-fcdfa500-c487-45dd-9f8e-e2fc8f3ca9d1 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:28:06.664575 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-fcdfa500-c487-45dd-9f8e-e2fc8f3ca9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:06.728862 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 901/1788] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:28:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:28:06.739538 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c83eb-e4bb-4501-9854-198b5af674cc admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:06.741720 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-7c8c83eb-e4bb-4501-9854-198b5af674cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:06.830709 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c83eb-e4bb-4501-9854-198b5af674cc admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:06.842765 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd86c3f-fb76-4253-a0c1-7ca0453f559c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:06.842765 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd86c3f-fb76-4253-a0c1-7ca0453f559c service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:06.842765 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd86c3f-fb76-4253-a0c1-7ca0453f559c service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:06.842765 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd86c3f-fb76-4253-a0c1-7ca0453f559c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:06.853221 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd86c3f-fb76-4253-a0c1-7ca0453f559c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:06.854810 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd86c3f-fb76-4253-a0c1-7ca0453f559c service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:06.869864 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 888/1789] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:28:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:28:07.450755 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdfa500-c487-45dd-9f8e-e2fc8f3ca9d1 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:07.452469 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-fcdfa500-c487-45dd-9f8e-e2fc8f3ca9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:07.465646 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdfa500-c487-45dd-9f8e-e2fc8f3ca9d1 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:07.471038 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f9933-0918-4b88-92ce-2a3b43a1b345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:07.472157 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f9933-0918-4b88-92ce-2a3b43a1b345 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:07.472524 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f9933-0918-4b88-92ce-2a3b43a1b345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:07.472878 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f9933-0918-4b88-92ce-2a3b43a1b345 admin admin] PATH_INFO: `/v3/projects/30b4938efa144fc894f48a438830318e` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:07.474243 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3f9933-0918-4b88-92ce-2a3b43a1b345 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30b4938efa144fc894f48a438830318e)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:07.476394 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3f9933-0918-4b88-92ce-2a3b43a1b345 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:07.595190 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-4e3f9933-0918-4b88-92ce-2a3b43a1b345 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30b4938efa144fc894f48a438830318e', 'request_id': 'req-4e3f9933-0918-4b88-92ce-2a3b43a1b345'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:07.595190 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-4e3f9933-0918-4b88-92ce-2a3b43a1b345 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30b4938efa144fc894f48a438830318e', 'request_id': 'req-4e3f9933-0918-4b88-92ce-2a3b43a1b345'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:07.699893 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-4e3f9933-0918-4b88-92ce-2a3b43a1b345 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30b4938efa144fc894f48a438830318e', 'request_id': 'req-4e3f9933-0918-4b88-92ce-2a3b43a1b345'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:07.713100 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-4e3f9933-0918-4b88-92ce-2a3b43a1b345 admin admin] The token cache is being invalidate because project 30b4938efa144fc894f48a438830318e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:28:07.713575 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-4e3f9933-0918-4b88-92ce-2a3b43a1b345 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:07.714632 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-4e3f9933-0918-4b88-92ce-2a3b43a1b345 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:07.716546 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 902/1790] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:28:07 2022] DELETE /identity/v3/projects/30b4938efa144fc894f48a438830318e => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:28:07.720370 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd86c3f-fb76-4253-a0c1-7ca0453f559c service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:07.730422 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd86c3f-fb76-4253-a0c1-7ca0453f559c service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:07.800616 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b10cf-e21e-4722-b32f-ae5620589e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:07.801512 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b10cf-e21e-4722-b32f-ae5620589e6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:07.801846 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b10cf-e21e-4722-b32f-ae5620589e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:07.802074 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b10cf-e21e-4722-b32f-ae5620589e6d admin admin] PATH_INFO: `/v3/users/c69d3f7bf6a7471da99ff8226b085a5d` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:07.803327 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872b10cf-e21e-4722-b32f-ae5620589e6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c69d3f7bf6a7471da99ff8226b085a5d)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:07.805261 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872b10cf-e21e-4722-b32f-ae5620589e6d admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:08.165988 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-872b10cf-e21e-4722-b32f-ae5620589e6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c69d3f7bf6a7471da99ff8226b085a5d'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:08.166647 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-872b10cf-e21e-4722-b32f-ae5620589e6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c69d3f7bf6a7471da99ff8226b085a5d'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:08.310669 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-872b10cf-e21e-4722-b32f-ae5620589e6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c69d3f7bf6a7471da99ff8226b085a5d'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:08.311295 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-872b10cf-e21e-4722-b32f-ae5620589e6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c69d3f7bf6a7471da99ff8226b085a5d'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:08.323568 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-872b10cf-e21e-4722-b32f-ae5620589e6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c69d3f7bf6a7471da99ff8226b085a5d'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:08.335764 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 889/1791] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:28:07 2022] DELETE /identity/v3/users/c69d3f7bf6a7471da99ff8226b085a5d => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:28:08.743913 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f9933-0918-4b88-92ce-2a3b43a1b345 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:08.749744 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-4e3f9933-0918-4b88-92ce-2a3b43a1b345 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:08.760630 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f9933-0918-4b88-92ce-2a3b43a1b345 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:08.867509 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e92101-7302-4183-a526-5daa37aae43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:08.867509 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e92101-7302-4183-a526-5daa37aae43f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:08.867509 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e92101-7302-4183-a526-5daa37aae43f admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:08.867509 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e92101-7302-4183-a526-5daa37aae43f admin admin] PATH_INFO: `/v3/projects/34e6a4891023445d9723606fd2d6f3f3` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:08.870014 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e92101-7302-4183-a526-5daa37aae43f admin admin] RBAC: Authorizing `identity:delete_project(project_id=34e6a4891023445d9723606fd2d6f3f3)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:08.871163 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e92101-7302-4183-a526-5daa37aae43f admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:10.043762 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-07e92101-7302-4183-a526-5daa37aae43f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34e6a4891023445d9723606fd2d6f3f3', 'request_id': 'req-07e92101-7302-4183-a526-5daa37aae43f'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:10.050585 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-07e92101-7302-4183-a526-5daa37aae43f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34e6a4891023445d9723606fd2d6f3f3', 'request_id': 'req-07e92101-7302-4183-a526-5daa37aae43f'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:10.274440 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-07e92101-7302-4183-a526-5daa37aae43f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34e6a4891023445d9723606fd2d6f3f3', 'request_id': 'req-07e92101-7302-4183-a526-5daa37aae43f'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:10.288068 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-07e92101-7302-4183-a526-5daa37aae43f admin admin] The token cache is being invalidate because project 34e6a4891023445d9723606fd2d6f3f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:28:10.288987 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-07e92101-7302-4183-a526-5daa37aae43f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:10.289980 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-07e92101-7302-4183-a526-5daa37aae43f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:10.292024 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 903/1792] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:28:08 2022] DELETE /identity/v3/projects/34e6a4891023445d9723606fd2d6f3f3 => generated 0 bytes in 1548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:28:10.298094 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329458a4-57db-4df3-b824-47c8ef121f7f None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:10.298908 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329458a4-57db-4df3-b824-47c8ef121f7f None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:10.299234 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329458a4-57db-4df3-b824-47c8ef121f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:10.318108 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-329458a4-57db-4df3-b824-47c8ef121f7f None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:28:10.319239 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-329458a4-57db-4df3-b824-47c8ef121f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:10.383543 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 890/1793] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:28:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:28:10.391410 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4792c860-b502-496a-a091-1661560255de None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:10.391813 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4792c860-b502-496a-a091-1661560255de None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:10.392185 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4792c860-b502-496a-a091-1661560255de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:10.411063 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-4792c860-b502-496a-a091-1661560255de None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:28:10.412357 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-4792c860-b502-496a-a091-1661560255de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:10.421038 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 904/1794] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:28:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:28:10.424878 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329458a4-57db-4df3-b824-47c8ef121f7f None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:10.435454 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329458a4-57db-4df3-b824-47c8ef121f7f None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:10.440929 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96358503-5f13-48f2-a6b5-1f065fb95a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:10.441676 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96358503-5f13-48f2-a6b5-1f065fb95a97 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:10.442027 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96358503-5f13-48f2-a6b5-1f065fb95a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:10.442355 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96358503-5f13-48f2-a6b5-1f065fb95a97 admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:10.447849 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96358503-5f13-48f2-a6b5-1f065fb95a97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:28:10.447849 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96358503-5f13-48f2-a6b5-1f065fb95a97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:10.447849 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96358503-5f13-48f2-a6b5-1f065fb95a97 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:10.457205 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 891/1795] 10.222.0.24 () {58 vars in 1152 bytes} [Thu Apr 7 06:28:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:28:10.461867 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4792c860-b502-496a-a091-1661560255de None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:10.472210 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4792c860-b502-496a-a091-1661560255de None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:10.477208 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cb4453-6891-4301-8e9e-bacd3239079c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:10.477877 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb4453-6891-4301-8e9e-bacd3239079c admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:10.478162 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb4453-6891-4301-8e9e-bacd3239079c admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:10.478442 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb4453-6891-4301-8e9e-bacd3239079c admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:10.479168 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cb4453-6891-4301-8e9e-bacd3239079c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:10.481312 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cb4453-6891-4301-8e9e-bacd3239079c admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:10.636436 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 905/1796] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:28:10 2022] POST /identity/v3/projects => generated 389 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:28:10.638786 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96358503-5f13-48f2-a6b5-1f065fb95a97 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:10.649244 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96358503-5f13-48f2-a6b5-1f065fb95a97 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:10.704936 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f738bb-fd09-4fa3-a4e1-db745f31b17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:10.705622 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f738bb-fd09-4fa3-a4e1-db745f31b17f admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:10.705911 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f738bb-fd09-4fa3-a4e1-db745f31b17f admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:10.706190 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f738bb-fd09-4fa3-a4e1-db745f31b17f admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:10.706903 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f738bb-fd09-4fa3-a4e1-db745f31b17f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:10.708888 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f738bb-fd09-4fa3-a4e1-db745f31b17f admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:10.791229 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 892/1797] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:28:10 2022] POST /identity/v3/users => generated 295 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:28:10.795354 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cb4453-6891-4301-8e9e-bacd3239079c admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:10.807092 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cb4453-6891-4301-8e9e-bacd3239079c admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:10.812248 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63566fd-b808-4a6e-adc1-a559d60771b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:10.812492 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63566fd-b808-4a6e-adc1-a559d60771b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:10.812780 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63566fd-b808-4a6e-adc1-a559d60771b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:10.813055 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63566fd-b808-4a6e-adc1-a559d60771b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:10.813951 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63566fd-b808-4a6e-adc1-a559d60771b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:10.815565 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63566fd-b808-4a6e-adc1-a559d60771b0 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:10.826460 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 906/1798] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:28:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:28:10.831099 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f738bb-fd09-4fa3-a4e1-db745f31b17f admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:10.854488 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f738bb-fd09-4fa3-a4e1-db745f31b17f admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:10.861493 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba017d4-fbf1-4a7f-aecc-150f5b43bab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:10.862528 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba017d4-fbf1-4a7f-aecc-150f5b43bab3 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:10.862886 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba017d4-fbf1-4a7f-aecc-150f5b43bab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:10.863430 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba017d4-fbf1-4a7f-aecc-150f5b43bab3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:10.864487 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba017d4-fbf1-4a7f-aecc-150f5b43bab3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:10.866128 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba017d4-fbf1-4a7f-aecc-150f5b43bab3 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:10.876332 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 893/1799] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:28:10 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:28:10.880899 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63566fd-b808-4a6e-adc1-a559d60771b0 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:10.892232 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63566fd-b808-4a6e-adc1-a559d60771b0 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:10.896961 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e0634-97e3-4f81-a4cb-6fddf9b678aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:10.897921 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e0634-97e3-4f81-a4cb-6fddf9b678aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:10.898283 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e0634-97e3-4f81-a4cb-6fddf9b678aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:10.898631 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e0634-97e3-4f81-a4cb-6fddf9b678aa admin admin] PATH_INFO: `/v3/projects/f5d4f82aed26454980647766e06ec9fd/users/6d582d762d124a94be4b3cc188a9554c/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:10.915823 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5e0634-97e3-4f81-a4cb-6fddf9b678aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5d4f82aed26454980647766e06ec9fd, user_id=6d582d762d124a94be4b3cc188a9554c, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:10.918590 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5e0634-97e3-4f81-a4cb-6fddf9b678aa admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:10.945851 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba017d4-fbf1-4a7f-aecc-150f5b43bab3 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:10.947662 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-8ba017d4-fbf1-4a7f-aecc-150f5b43bab3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:10.963783 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba017d4-fbf1-4a7f-aecc-150f5b43bab3 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:10.968768 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2fb7a8-0cf4-41bb-afdd-e90e6db2adb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:10.970336 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2fb7a8-0cf4-41bb-afdd-e90e6db2adb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:10.971463 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2fb7a8-0cf4-41bb-afdd-e90e6db2adb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:10.971463 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2fb7a8-0cf4-41bb-afdd-e90e6db2adb8 admin admin] PATH_INFO: `/v3/users/5cb15f24e9794d6494a910b139cdbc9c` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:10.972438 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2fb7a8-0cf4-41bb-afdd-e90e6db2adb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cb15f24e9794d6494a910b139cdbc9c)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:10.974518 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2fb7a8-0cf4-41bb-afdd-e90e6db2adb8 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:11.054812 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 907/1800] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:28:10 2022] PUT /identity/v3/projects/f5d4f82aed26454980647766e06ec9fd/users/6d582d762d124a94be4b3cc188a9554c/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:28:11.065647 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5ef90-372d-49e1-82c6-c105552794b4 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:11.065946 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5ef90-372d-49e1-82c6-c105552794b4 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:11.066231 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5ef90-372d-49e1-82c6-c105552794b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:11.099278 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-6ce5ef90-372d-49e1-82c6-c105552794b4 None None] MFA Rules not processed for user `6d582d762d124a94be4b3cc188a9554c`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:28:11.100867 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-6ce5ef90-372d-49e1-82c6-c105552794b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:11.175253 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 908/1801] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:28:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:28:11.179828 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce5ef90-372d-49e1-82c6-c105552794b4 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:11.221145 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ed2fb7a8-0cf4-41bb-afdd-e90e6db2adb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cb15f24e9794d6494a910b139cdbc9c'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:11.225107 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ed2fb7a8-0cf4-41bb-afdd-e90e6db2adb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cb15f24e9794d6494a910b139cdbc9c'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:11.262309 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce5ef90-372d-49e1-82c6-c105552794b4 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:11.269102 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa816f7b-7cfe-4eb6-9000-1d1f43e40995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:11.269899 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa816f7b-7cfe-4eb6-9000-1d1f43e40995 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:11.270297 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa816f7b-7cfe-4eb6-9000-1d1f43e40995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:11.270853 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa816f7b-7cfe-4eb6-9000-1d1f43e40995 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:11.272247 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa816f7b-7cfe-4eb6-9000-1d1f43e40995 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:11.275525 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa816f7b-7cfe-4eb6-9000-1d1f43e40995 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:11.351598 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ed2fb7a8-0cf4-41bb-afdd-e90e6db2adb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cb15f24e9794d6494a910b139cdbc9c'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:11.357142 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ed2fb7a8-0cf4-41bb-afdd-e90e6db2adb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cb15f24e9794d6494a910b139cdbc9c'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:11.369765 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ed2fb7a8-0cf4-41bb-afdd-e90e6db2adb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cb15f24e9794d6494a910b139cdbc9c'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:11.395371 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 894/1802] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:28:10 2022] DELETE /identity/v3/users/5cb15f24e9794d6494a910b139cdbc9c => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:28:11.396899 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97462574-4588-4d07-b9a0-7d1befde39fd None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:11.397289 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97462574-4588-4d07-b9a0-7d1befde39fd None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:11.397824 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97462574-4588-4d07-b9a0-7d1befde39fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:11.419878 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-97462574-4588-4d07-b9a0-7d1befde39fd None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:28:11.420492 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-97462574-4588-4d07-b9a0-7d1befde39fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:11.431794 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 909/1803] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:28:11 2022] POST /identity/v3/projects => generated 387 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:28:11.432777 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa816f7b-7cfe-4eb6-9000-1d1f43e40995 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:11.434335 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-fa816f7b-7cfe-4eb6-9000-1d1f43e40995 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:11.485660 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 895/1804] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:28:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:28:11.496583 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97462574-4588-4d07-b9a0-7d1befde39fd None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:11.498031 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-97462574-4588-4d07-b9a0-7d1befde39fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:11.515343 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa816f7b-7cfe-4eb6-9000-1d1f43e40995 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:11.527595 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a21c44f-4f9a-4331-8424-b0d59541db40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:11.528457 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21c44f-4f9a-4331-8424-b0d59541db40 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:11.528822 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21c44f-4f9a-4331-8424-b0d59541db40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:11.529171 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21c44f-4f9a-4331-8424-b0d59541db40 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:11.529879 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a21c44f-4f9a-4331-8424-b0d59541db40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:11.551267 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a21c44f-4f9a-4331-8424-b0d59541db40 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:11.611636 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97462574-4588-4d07-b9a0-7d1befde39fd None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:11.688819 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e41bdd-fcbe-4b0e-a6e9-509d5ad9dc54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:11.690340 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e41bdd-fcbe-4b0e-a6e9-509d5ad9dc54 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:11.690811 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e41bdd-fcbe-4b0e-a6e9-509d5ad9dc54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:11.691235 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e41bdd-fcbe-4b0e-a6e9-509d5ad9dc54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:11.719444 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 910/1805] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:28:11 2022] POST /identity/v3/users => generated 300 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:28:11.721996 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a21c44f-4f9a-4331-8424-b0d59541db40 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:11.746320 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e41bdd-fcbe-4b0e-a6e9-509d5ad9dc54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:11.747968 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e41bdd-fcbe-4b0e-a6e9-509d5ad9dc54 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:11.756503 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a21c44f-4f9a-4331-8424-b0d59541db40 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:11.772368 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 896/1806] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:28:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 07 06:28:11.785733 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6cbf8f-5a51-40d4-8850-bd9ccf667a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:11.785733 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cbf8f-5a51-40d4-8850-bd9ccf667a22 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:11.785733 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cbf8f-5a51-40d4-8850-bd9ccf667a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:11.785733 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cbf8f-5a51-40d4-8850-bd9ccf667a22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:11.786449 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6cbf8f-5a51-40d4-8850-bd9ccf667a22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:11.789953 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6cbf8f-5a51-40d4-8850-bd9ccf667a22 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:11.815736 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e41bdd-fcbe-4b0e-a6e9-509d5ad9dc54 service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:11.821052 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 911/1807] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:28:11 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:28:11.830735 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e41bdd-fcbe-4b0e-a6e9-509d5ad9dc54 service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:11.843662 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a707f548-fde4-4266-80c6-c9afeacce8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:11.845312 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707f548-fde4-4266-80c6-c9afeacce8e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:11.845741 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707f548-fde4-4266-80c6-c9afeacce8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:11.846127 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707f548-fde4-4266-80c6-c9afeacce8e3 admin admin] PATH_INFO: `/v3/projects/fc6187aea5324996bd88a768e985cb1f/users/05a223c5d413423fba162f60069e3633/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:11.869980 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a707f548-fde4-4266-80c6-c9afeacce8e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc6187aea5324996bd88a768e985cb1f, user_id=05a223c5d413423fba162f60069e3633, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:11.872826 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a707f548-fde4-4266-80c6-c9afeacce8e3 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:12.021618 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 897/1808] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:28:11 2022] PUT /identity/v3/projects/fc6187aea5324996bd88a768e985cb1f/users/05a223c5d413423fba162f60069e3633/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:28:12.025704 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6cbf8f-5a51-40d4-8850-bd9ccf667a22 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:12.037130 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6cbf8f-5a51-40d4-8850-bd9ccf667a22 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:12.125758 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9df03b-afd6-4eb2-9f73-b0ca9473d35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:12.126595 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9df03b-afd6-4eb2-9f73-b0ca9473d35d admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:12.127766 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9df03b-afd6-4eb2-9f73-b0ca9473d35d admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:12.129140 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9df03b-afd6-4eb2-9f73-b0ca9473d35d admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:12.130773 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9df03b-afd6-4eb2-9f73-b0ca9473d35d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:12.136127 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9df03b-afd6-4eb2-9f73-b0ca9473d35d admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:12.150538 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 912/1809] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:28:12 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:28:12.153924 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a707f548-fde4-4266-80c6-c9afeacce8e3 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:12.186965 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a707f548-fde4-4266-80c6-c9afeacce8e3 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:12.202571 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9df6f48-8708-45a2-a1a4-fdc4dd753c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:12.205959 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df6f48-8708-45a2-a1a4-fdc4dd753c8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:12.205959 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df6f48-8708-45a2-a1a4-fdc4dd753c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:12.205959 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df6f48-8708-45a2-a1a4-fdc4dd753c8e admin admin] PATH_INFO: `/v3/projects/fc6187aea5324996bd88a768e985cb1f/users/05a223c5d413423fba162f60069e3633/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:12.211525 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9df6f48-8708-45a2-a1a4-fdc4dd753c8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc6187aea5324996bd88a768e985cb1f, user_id=05a223c5d413423fba162f60069e3633, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:12.214731 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9df6f48-8708-45a2-a1a4-fdc4dd753c8e admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:12.238807 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 898/1810] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:28:12 2022] PUT /identity/v3/projects/fc6187aea5324996bd88a768e985cb1f/users/05a223c5d413423fba162f60069e3633/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:28:12.260543 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492deb0-b3c6-496b-be9f-a7ecbbfd31c9 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:12.260859 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492deb0-b3c6-496b-be9f-a7ecbbfd31c9 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:12.261124 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492deb0-b3c6-496b-be9f-a7ecbbfd31c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:12.316347 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-8492deb0-b3c6-496b-be9f-a7ecbbfd31c9 None None] MFA Rules not processed for user `05a223c5d413423fba162f60069e3633`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:28:12.317819 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-8492deb0-b3c6-496b-be9f-a7ecbbfd31c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:12.442599 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 913/1811] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:28:12 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:28:12.457845 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9df6f48-8708-45a2-a1a4-fdc4dd753c8e admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:12.460950 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d9df6f48-8708-45a2-a1a4-fdc4dd753c8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:12.540097 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdccf7b6-5c51-4208-9102-a3cc336c8616 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:12.540573 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdccf7b6-5c51-4208-9102-a3cc336c8616 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:12.540865 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdccf7b6-5c51-4208-9102-a3cc336c8616 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:12.541173 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9df6f48-8708-45a2-a1a4-fdc4dd753c8e admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:12.542263 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 914/1812] 10.222.0.24 () {54 vars in 921 bytes} [Thu Apr 7 06:28:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:28:12.545775 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0318e0fa-adc4-4c46-bfc0-b8283b55e5e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:12.550346 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318e0fa-adc4-4c46-bfc0-b8283b55e5e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:12.550346 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318e0fa-adc4-4c46-bfc0-b8283b55e5e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:12.550346 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318e0fa-adc4-4c46-bfc0-b8283b55e5e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:12.552872 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d7d67-6ef5-431c-9189-8273544df24f None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:12.553695 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d7d67-6ef5-431c-9189-8273544df24f None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:12.554104 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d7d67-6ef5-431c-9189-8273544df24f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:12.563391 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0318e0fa-adc4-4c46-bfc0-b8283b55e5e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:12.566626 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0318e0fa-adc4-4c46-bfc0-b8283b55e5e6 service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:12.586227 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 899/1813] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:28:12 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:28:12.587603 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-c34d7d67-6ef5-431c-9189-8273544df24f None None] MFA Rules not processed for user `02cd81f6620f410db450871fb29961f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:28:12.589796 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c34d7d67-6ef5-431c-9189-8273544df24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:12.698569 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 915/1814] 10.222.0.24 () {58 vars in 1018 bytes} [Thu Apr 7 06:28:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:28:12.711200 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0318e0fa-adc4-4c46-bfc0-b8283b55e5e6 service cinder] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:12.712761 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-0318e0fa-adc4-4c46-bfc0-b8283b55e5e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:12.730963 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0318e0fa-adc4-4c46-bfc0-b8283b55e5e6 service cinder] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:12.737861 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce5c62-997c-4fd3-afcb-9d2cd1bfafac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cd81f6620f410db450871fb29961f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:12.739102 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce5c62-997c-4fd3-afcb-9d2cd1bfafac service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:12.739482 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce5c62-997c-4fd3-afcb-9d2cd1bfafac service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:12.739905 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce5c62-997c-4fd3-afcb-9d2cd1bfafac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:12.754246 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ce5c62-997c-4fd3-afcb-9d2cd1bfafac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:12.754509 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d7d67-6ef5-431c-9189-8273544df24f None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:12.756403 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ce5c62-997c-4fd3-afcb-9d2cd1bfafac service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:12.769581 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 900/1815] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:28:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:28:12.879096 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d7d67-6ef5-431c-9189-8273544df24f None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:12.894337 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ff830-bfe2-438b-be57-bd1023276c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:12.895261 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ff830-bfe2-438b-be57-bd1023276c43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:12.895548 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ff830-bfe2-438b-be57-bd1023276c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:12.895854 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ff830-bfe2-438b-be57-bd1023276c43 admin admin] PATH_INFO: `/v3/users/6d582d762d124a94be4b3cc188a9554c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:12.897546 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ff830-bfe2-438b-be57-bd1023276c43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d582d762d124a94be4b3cc188a9554c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:12.899842 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ff830-bfe2-438b-be57-bd1023276c43 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:13.152317 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-751ff830-bfe2-438b-be57-bd1023276c43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d582d762d124a94be4b3cc188a9554c'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:13.170865 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-751ff830-bfe2-438b-be57-bd1023276c43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d582d762d124a94be4b3cc188a9554c'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:13.271541 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-751ff830-bfe2-438b-be57-bd1023276c43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d582d762d124a94be4b3cc188a9554c'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:13.272238 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-751ff830-bfe2-438b-be57-bd1023276c43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d582d762d124a94be4b3cc188a9554c'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:13.272909 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-751ff830-bfe2-438b-be57-bd1023276c43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d582d762d124a94be4b3cc188a9554c'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:13.295828 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 916/1816] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:28:12 2022] DELETE /identity/v3/users/6d582d762d124a94be4b3cc188a9554c => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:28:13.300138 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb91e52-91f1-4f9e-8355-e2386f8ecd4d None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:13.300429 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb91e52-91f1-4f9e-8355-e2386f8ecd4d None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:13.300711 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb91e52-91f1-4f9e-8355-e2386f8ecd4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:13.347890 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-5cb91e52-91f1-4f9e-8355-e2386f8ecd4d None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:28:13.349181 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-5cb91e52-91f1-4f9e-8355-e2386f8ecd4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:13.430944 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ff830-bfe2-438b-be57-bd1023276c43 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:13.432462 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-751ff830-bfe2-438b-be57-bd1023276c43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:13.460483 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 901/1817] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:28:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:28:13.470148 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb91e52-91f1-4f9e-8355-e2386f8ecd4d None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:13.478085 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-5cb91e52-91f1-4f9e-8355-e2386f8ecd4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:13.573128 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ff830-bfe2-438b-be57-bd1023276c43 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:13.580228 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a1350-a441-4dc4-8fdf-afef1b3c9453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:13.581583 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a1350-a441-4dc4-8fdf-afef1b3c9453 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:13.581583 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a1350-a441-4dc4-8fdf-afef1b3c9453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:13.581822 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a1350-a441-4dc4-8fdf-afef1b3c9453 admin admin] PATH_INFO: `/v3/projects/5b45a467bac44680a790b4d3336e6daa` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:13.583197 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4a1350-a441-4dc4-8fdf-afef1b3c9453 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b45a467bac44680a790b4d3336e6daa)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:13.586583 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4a1350-a441-4dc4-8fdf-afef1b3c9453 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:13.629258 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb91e52-91f1-4f9e-8355-e2386f8ecd4d None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:13.633476 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28c8815-b780-4291-ae30-57d7c8630087 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:13.634238 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c8815-b780-4291-ae30-57d7c8630087 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:13.634812 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c8815-b780-4291-ae30-57d7c8630087 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:13.634940 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c8815-b780-4291-ae30-57d7c8630087 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:13.644898 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28c8815-b780-4291-ae30-57d7c8630087 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:13.646816 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28c8815-b780-4291-ae30-57d7c8630087 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:13.660985 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 902/1818] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:28:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:28:13.726044 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6a4a1350-a441-4dc4-8fdf-afef1b3c9453 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b45a467bac44680a790b4d3336e6daa', 'request_id': 'req-6a4a1350-a441-4dc4-8fdf-afef1b3c9453'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:13.733215 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6a4a1350-a441-4dc4-8fdf-afef1b3c9453 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b45a467bac44680a790b4d3336e6daa', 'request_id': 'req-6a4a1350-a441-4dc4-8fdf-afef1b3c9453'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:13.820169 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6a4a1350-a441-4dc4-8fdf-afef1b3c9453 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b45a467bac44680a790b4d3336e6daa', 'request_id': 'req-6a4a1350-a441-4dc4-8fdf-afef1b3c9453'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:13.862694 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6a4a1350-a441-4dc4-8fdf-afef1b3c9453 admin admin] The token cache is being invalidate because project 5b45a467bac44680a790b4d3336e6daa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:28:13.866275 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6a4a1350-a441-4dc4-8fdf-afef1b3c9453 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:13.868201 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6a4a1350-a441-4dc4-8fdf-afef1b3c9453 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:13.870622 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 917/1819] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:28:13 2022] DELETE /identity/v3/projects/5b45a467bac44680a790b4d3336e6daa => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:28:13.876162 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30045ada-2601-441a-a724-b69444c041c3 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:13.876698 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30045ada-2601-441a-a724-b69444c041c3 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:13.877149 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30045ada-2601-441a-a724-b69444c041c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:13.918337 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-30045ada-2601-441a-a724-b69444c041c3 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:28:13.920093 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-30045ada-2601-441a-a724-b69444c041c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:14.083262 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 903/1820] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:28:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:28:14.091126 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ce34c-b58c-4a25-b7b3-10f1a2e99ae0 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:14.092045 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ce34c-b58c-4a25-b7b3-10f1a2e99ae0 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:14.092881 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ce34c-b58c-4a25-b7b3-10f1a2e99ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:14.180707 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-7d1ce34c-b58c-4a25-b7b3-10f1a2e99ae0 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:28:14.183674 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-7d1ce34c-b58c-4a25-b7b3-10f1a2e99ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:14.200230 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 918/1821] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:28:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:28:14.205888 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30045ada-2601-441a-a724-b69444c041c3 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:14.233995 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30045ada-2601-441a-a724-b69444c041c3 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:14.261111 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de545c37-fc0d-4423-9be5-58da7d2a09b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:14.261993 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de545c37-fc0d-4423-9be5-58da7d2a09b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:14.262413 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de545c37-fc0d-4423-9be5-58da7d2a09b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:14.263383 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de545c37-fc0d-4423-9be5-58da7d2a09b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:14.264199 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de545c37-fc0d-4423-9be5-58da7d2a09b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:28:14.264712 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de545c37-fc0d-4423-9be5-58da7d2a09b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:14.274452 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de545c37-fc0d-4423-9be5-58da7d2a09b7 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:14.319545 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 904/1822] 10.222.0.24 () {58 vars in 1152 bytes} [Thu Apr 7 06:28:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:28:14.326999 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ce34c-b58c-4a25-b7b3-10f1a2e99ae0 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:14.351021 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ce34c-b58c-4a25-b7b3-10f1a2e99ae0 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:14.395335 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12558aa5-cd78-495d-a785-f432cc82b753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:14.400988 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12558aa5-cd78-495d-a785-f432cc82b753 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:14.404351 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12558aa5-cd78-495d-a785-f432cc82b753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:14.406383 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12558aa5-cd78-495d-a785-f432cc82b753 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:14.440577 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12558aa5-cd78-495d-a785-f432cc82b753 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:14.458871 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12558aa5-cd78-495d-a785-f432cc82b753 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:14.629468 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 919/1823] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:28:14 2022] POST /identity/v3/projects => generated 403 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:28:14.635166 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de545c37-fc0d-4423-9be5-58da7d2a09b7 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:14.649436 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de545c37-fc0d-4423-9be5-58da7d2a09b7 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:14.728158 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf4dd0-54e4-42b5-9b5f-8050adcf29f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:14.728857 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf4dd0-54e4-42b5-9b5f-8050adcf29f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:14.729144 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf4dd0-54e4-42b5-9b5f-8050adcf29f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:14.729421 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf4dd0-54e4-42b5-9b5f-8050adcf29f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:14.730120 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf4dd0-54e4-42b5-9b5f-8050adcf29f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:14.732190 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf4dd0-54e4-42b5-9b5f-8050adcf29f3 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:14.855839 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 905/1824] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:28:14 2022] POST /identity/v3/users => generated 302 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:28:14.861738 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12558aa5-cd78-495d-a785-f432cc82b753 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:14.877715 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12558aa5-cd78-495d-a785-f432cc82b753 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:14.883191 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa5740a-9f1f-436b-b997-e193e4aa7e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:14.890375 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa5740a-9f1f-436b-b997-e193e4aa7e22 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:14.890375 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa5740a-9f1f-436b-b997-e193e4aa7e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:14.890375 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa5740a-9f1f-436b-b997-e193e4aa7e22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:14.890375 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa5740a-9f1f-436b-b997-e193e4aa7e22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:14.890375 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa5740a-9f1f-436b-b997-e193e4aa7e22 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:14.902993 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf4dd0-54e4-42b5-9b5f-8050adcf29f3 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:14.904332 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 920/1825] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:28:14.914211 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf4dd0-54e4-42b5-9b5f-8050adcf29f3 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:14.919242 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1a6f3-a4b3-49bd-852b-cba4fbaabe76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:14.919964 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1a6f3-a4b3-49bd-852b-cba4fbaabe76 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:14.921420 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1a6f3-a4b3-49bd-852b-cba4fbaabe76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:14.921420 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1a6f3-a4b3-49bd-852b-cba4fbaabe76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:14.921420 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f1a6f3-a4b3-49bd-852b-cba4fbaabe76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:14.923839 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f1a6f3-a4b3-49bd-852b-cba4fbaabe76 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:14.934677 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 906/1826] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 07 06:28:14.941012 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa5740a-9f1f-436b-b997-e193e4aa7e22 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:14.947179 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1a6f3-a4b3-49bd-852b-cba4fbaabe76 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:14.949332 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-c6f1a6f3-a4b3-49bd-852b-cba4fbaabe76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:14.970555 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa5740a-9f1f-436b-b997-e193e4aa7e22 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:14.974254 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1a6f3-a4b3-49bd-852b-cba4fbaabe76 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:14.976531 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed985b-6a5e-46ec-a2c6-e827a715d9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:14.977511 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed985b-6a5e-46ec-a2c6-e827a715d9d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:14.978516 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed985b-6a5e-46ec-a2c6-e827a715d9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:14.978899 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed985b-6a5e-46ec-a2c6-e827a715d9d0 admin admin] PATH_INFO: `/v3/projects/ffe0694abcc44947a6eff2c2cb1e0334/users/dd9abc0cda3e4480a659f0c7dd69e0aa/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:14.982951 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4fe028-b04c-4f79-8573-5678ee9f24bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:14.984528 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4fe028-b04c-4f79-8573-5678ee9f24bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:14.986380 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4fe028-b04c-4f79-8573-5678ee9f24bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:14.986876 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4fe028-b04c-4f79-8573-5678ee9f24bc admin admin] PATH_INFO: `/v3/projects/f5d4f82aed26454980647766e06ec9fd` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:14.988732 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4fe028-b04c-4f79-8573-5678ee9f24bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5d4f82aed26454980647766e06ec9fd)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:14.991075 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4fe028-b04c-4f79-8573-5678ee9f24bc admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:15.005008 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ed985b-6a5e-46ec-a2c6-e827a715d9d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffe0694abcc44947a6eff2c2cb1e0334, user_id=dd9abc0cda3e4480a659f0c7dd69e0aa, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:15.019122 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ed985b-6a5e-46ec-a2c6-e827a715d9d0 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:15.231176 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 921/1827] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:28:14 2022] PUT /identity/v3/projects/ffe0694abcc44947a6eff2c2cb1e0334/users/dd9abc0cda3e4480a659f0c7dd69e0aa/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:28:15.240542 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067c0ba-12ee-4e1f-944d-3ff35fcaad68 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:15.240991 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067c0ba-12ee-4e1f-944d-3ff35fcaad68 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:15.241198 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067c0ba-12ee-4e1f-944d-3ff35fcaad68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:15.243779 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7f4fe028-b04c-4f79-8573-5678ee9f24bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5d4f82aed26454980647766e06ec9fd', 'request_id': 'req-7f4fe028-b04c-4f79-8573-5678ee9f24bc'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:15.249166 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7f4fe028-b04c-4f79-8573-5678ee9f24bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5d4f82aed26454980647766e06ec9fd', 'request_id': 'req-7f4fe028-b04c-4f79-8573-5678ee9f24bc'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:15.275424 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-a067c0ba-12ee-4e1f-944d-3ff35fcaad68 None None] MFA Rules not processed for user `dd9abc0cda3e4480a659f0c7dd69e0aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:28:15.276677 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a067c0ba-12ee-4e1f-944d-3ff35fcaad68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:15.346521 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 922/1828] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:28:15 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:28:15.351126 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a067c0ba-12ee-4e1f-944d-3ff35fcaad68 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:15.379737 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7f4fe028-b04c-4f79-8573-5678ee9f24bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5d4f82aed26454980647766e06ec9fd', 'request_id': 'req-7f4fe028-b04c-4f79-8573-5678ee9f24bc'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:15.392765 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7f4fe028-b04c-4f79-8573-5678ee9f24bc admin admin] The token cache is being invalidate because project f5d4f82aed26454980647766e06ec9fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:28:15.393060 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7f4fe028-b04c-4f79-8573-5678ee9f24bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:15.394008 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7f4fe028-b04c-4f79-8573-5678ee9f24bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:15.395617 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 907/1829] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:28:14 2022] DELETE /identity/v3/projects/f5d4f82aed26454980647766e06ec9fd => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:28:15.401538 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4fe028-b04c-4f79-8573-5678ee9f24bc admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:15.403153 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-7f4fe028-b04c-4f79-8573-5678ee9f24bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:15.426731 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a067c0ba-12ee-4e1f-944d-3ff35fcaad68 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:15.432660 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f555a8d-c4d1-46e1-a60a-677492996cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:15.435259 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f555a8d-c4d1-46e1-a60a-677492996cd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:15.435802 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f555a8d-c4d1-46e1-a60a-677492996cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:15.436257 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f555a8d-c4d1-46e1-a60a-677492996cd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:15.436990 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f555a8d-c4d1-46e1-a60a-677492996cd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:15.439035 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f555a8d-c4d1-46e1-a60a-677492996cd5 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:15.503864 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4fe028-b04c-4f79-8573-5678ee9f24bc admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:15.508923 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f5477-9fbb-42d0-b5e8-3b448f3ac5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:15.510059 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f5477-9fbb-42d0-b5e8-3b448f3ac5ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:15.510292 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f5477-9fbb-42d0-b5e8-3b448f3ac5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:15.510956 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f5477-9fbb-42d0-b5e8-3b448f3ac5ad admin admin] PATH_INFO: `/v3/users/05a223c5d413423fba162f60069e3633` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:15.511875 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863f5477-9fbb-42d0-b5e8-3b448f3ac5ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=05a223c5d413423fba162f60069e3633)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:15.514191 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863f5477-9fbb-42d0-b5e8-3b448f3ac5ad admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:15.561863 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 923/1830] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:28:15 2022] POST /identity/v3/projects => generated 405 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:28:15.563133 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f555a8d-c4d1-46e1-a60a-677492996cd5 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:15.564898 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-7f555a8d-c4d1-46e1-a60a-677492996cd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:15.704267 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f555a8d-c4d1-46e1-a60a-677492996cd5 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:15.705631 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e4183f-ab75-4b69-b113-86c4e2c2b144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:15.706533 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4183f-ab75-4b69-b113-86c4e2c2b144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:15.706818 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4183f-ab75-4b69-b113-86c4e2c2b144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:15.707214 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4183f-ab75-4b69-b113-86c4e2c2b144 admin admin] PATH_INFO: `/v3/users/1b24d691db374688b0f01d34c78aaae7` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:15.708422 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e4183f-ab75-4b69-b113-86c4e2c2b144 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b24d691db374688b0f01d34c78aaae7)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:15.710501 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e4183f-ab75-4b69-b113-86c4e2c2b144 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:15.744048 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-863f5477-9fbb-42d0-b5e8-3b448f3ac5ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05a223c5d413423fba162f60069e3633'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:15.745042 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-863f5477-9fbb-42d0-b5e8-3b448f3ac5ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05a223c5d413423fba162f60069e3633'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:15.865788 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-863f5477-9fbb-42d0-b5e8-3b448f3ac5ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05a223c5d413423fba162f60069e3633'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:15.868698 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-863f5477-9fbb-42d0-b5e8-3b448f3ac5ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05a223c5d413423fba162f60069e3633'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:15.880640 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-863f5477-9fbb-42d0-b5e8-3b448f3ac5ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05a223c5d413423fba162f60069e3633'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:15.893645 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 908/1831] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:28:15 2022] DELETE /identity/v3/users/05a223c5d413423fba162f60069e3633 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:28:15.894766 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f5477-9fbb-42d0-b5e8-3b448f3ac5ad admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:15.896240 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-863f5477-9fbb-42d0-b5e8-3b448f3ac5ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:15.986903 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d3e4183f-ab75-4b69-b113-86c4e2c2b144 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b24d691db374688b0f01d34c78aaae7'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:15.988749 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f5477-9fbb-42d0-b5e8-3b448f3ac5ad admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:15.993743 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b57e01-d787-4cbc-8551-33f1fe512cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:15.995322 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b57e01-d787-4cbc-8551-33f1fe512cea admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:15.996093 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b57e01-d787-4cbc-8551-33f1fe512cea admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:15.996579 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b57e01-d787-4cbc-8551-33f1fe512cea admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:15.997908 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b57e01-d787-4cbc-8551-33f1fe512cea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:16.007135 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b57e01-d787-4cbc-8551-33f1fe512cea admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:16.014671 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d3e4183f-ab75-4b69-b113-86c4e2c2b144 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b24d691db374688b0f01d34c78aaae7'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:16.100525 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d3e4183f-ab75-4b69-b113-86c4e2c2b144 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b24d691db374688b0f01d34c78aaae7'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:16.103723 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d3e4183f-ab75-4b69-b113-86c4e2c2b144 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b24d691db374688b0f01d34c78aaae7'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:16.105296 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d3e4183f-ab75-4b69-b113-86c4e2c2b144 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b24d691db374688b0f01d34c78aaae7'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:16.108178 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 909/1832] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:28:15 2022] POST /identity/v3/users => generated 309 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:28:16.112661 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b57e01-d787-4cbc-8551-33f1fe512cea admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:16.114838 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b2b57e01-d787-4cbc-8551-33f1fe512cea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:16.130403 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b57e01-d787-4cbc-8551-33f1fe512cea admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:16.136965 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897be304-8214-4db1-8ee4-e58ed7585ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:16.138059 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897be304-8214-4db1-8ee4-e58ed7585ef2 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:16.138424 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897be304-8214-4db1-8ee4-e58ed7585ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:16.138781 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897be304-8214-4db1-8ee4-e58ed7585ef2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:16.139657 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897be304-8214-4db1-8ee4-e58ed7585ef2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:16.142518 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897be304-8214-4db1-8ee4-e58ed7585ef2 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:16.154474 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 924/1833] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:28:15 2022] DELETE /identity/v3/users/1b24d691db374688b0f01d34c78aaae7 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:28:16.164747 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c12a4c-0ea6-497e-81e7-6b4a2ff538d7 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:16.165061 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c12a4c-0ea6-497e-81e7-6b4a2ff538d7 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:16.165329 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c12a4c-0ea6-497e-81e7-6b4a2ff538d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:16.176180 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 910/1834] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:28:16.181018 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897be304-8214-4db1-8ee4-e58ed7585ef2 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:16.198372 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897be304-8214-4db1-8ee4-e58ed7585ef2 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:16.200794 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-92c12a4c-0ea6-497e-81e7-6b4a2ff538d7 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:28:16.202011 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-92c12a4c-0ea6-497e-81e7-6b4a2ff538d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:16.308505 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fecc6ad-1927-400e-8804-c66f100b01a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:16.310745 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fecc6ad-1927-400e-8804-c66f100b01a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:16.315196 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fecc6ad-1927-400e-8804-c66f100b01a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:16.315196 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fecc6ad-1927-400e-8804-c66f100b01a3 admin admin] PATH_INFO: `/v3/projects/3e713313dd0f4f0882f29da9b2f5b4dd/users/2d35328c24a14f93a724abc89f97cfdd/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:16.333242 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 925/1835] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:28:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:28:16.345944 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c12a4c-0ea6-497e-81e7-6b4a2ff538d7 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:16.348798 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-92c12a4c-0ea6-497e-81e7-6b4a2ff538d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:16.348947 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fecc6ad-1927-400e-8804-c66f100b01a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e713313dd0f4f0882f29da9b2f5b4dd, user_id=2d35328c24a14f93a724abc89f97cfdd, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:16.354518 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fecc6ad-1927-400e-8804-c66f100b01a3 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:16.432770 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c12a4c-0ea6-497e-81e7-6b4a2ff538d7 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:16.434277 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 911/1836] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:28:16 2022] PUT /identity/v3/projects/3e713313dd0f4f0882f29da9b2f5b4dd/users/2d35328c24a14f93a724abc89f97cfdd/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:28:16.435216 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fecc6ad-1927-400e-8804-c66f100b01a3 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:16.438502 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-5fecc6ad-1927-400e-8804-c66f100b01a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:16.503493 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b6c12-a391-41f9-979f-a4167d85ad4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:16.507289 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b6c12-a391-41f9-979f-a4167d85ad4c service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:16.507595 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b6c12-a391-41f9-979f-a4167d85ad4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:16.507916 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b6c12-a391-41f9-979f-a4167d85ad4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:16.539300 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fecc6ad-1927-400e-8804-c66f100b01a3 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:16.548477 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadb6ced-08b1-49f0-9c9c-ac448eb65039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:16.549357 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb6ced-08b1-49f0-9c9c-ac448eb65039 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:16.549690 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb6ced-08b1-49f0-9c9c-ac448eb65039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:16.551919 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb6ced-08b1-49f0-9c9c-ac448eb65039 admin admin] PATH_INFO: `/v3/projects/fc6187aea5324996bd88a768e985cb1f` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:16.552355 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadb6ced-08b1-49f0-9c9c-ac448eb65039 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc6187aea5324996bd88a768e985cb1f)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:16.554980 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadb6ced-08b1-49f0-9c9c-ac448eb65039 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:16.609091 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1b6c12-a391-41f9-979f-a4167d85ad4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:16.611463 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1b6c12-a391-41f9-979f-a4167d85ad4c service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:16.643916 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 926/1837] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:28:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:28:16.644291 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b6c12-a391-41f9-979f-a4167d85ad4c service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:16.664650 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b6c12-a391-41f9-979f-a4167d85ad4c service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:16.680400 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a227493a-79f1-4985-bca0-e48d89639a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:16.681122 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227493a-79f1-4985-bca0-e48d89639a75 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:16.681406 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227493a-79f1-4985-bca0-e48d89639a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:16.681733 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227493a-79f1-4985-bca0-e48d89639a75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:16.682505 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a227493a-79f1-4985-bca0-e48d89639a75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:16.684191 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a227493a-79f1-4985-bca0-e48d89639a75 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:16.715721 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 927/1838] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:28:16.721653 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a227493a-79f1-4985-bca0-e48d89639a75 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:16.744546 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a227493a-79f1-4985-bca0-e48d89639a75 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:16.745537 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-eadb6ced-08b1-49f0-9c9c-ac448eb65039 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc6187aea5324996bd88a768e985cb1f', 'request_id': 'req-eadb6ced-08b1-49f0-9c9c-ac448eb65039'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:16.757614 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-eadb6ced-08b1-49f0-9c9c-ac448eb65039 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc6187aea5324996bd88a768e985cb1f', 'request_id': 'req-eadb6ced-08b1-49f0-9c9c-ac448eb65039'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:16.864003 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe992ad-baf6-4e6e-bccb-041360dfb23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:16.865018 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe992ad-baf6-4e6e-bccb-041360dfb23e admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:16.866757 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe992ad-baf6-4e6e-bccb-041360dfb23e admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:16.867868 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe992ad-baf6-4e6e-bccb-041360dfb23e admin admin] PATH_INFO: `/v3/projects/3e713313dd0f4f0882f29da9b2f5b4dd/users/2d35328c24a14f93a724abc89f97cfdd/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:16.871796 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe992ad-baf6-4e6e-bccb-041360dfb23e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e713313dd0f4f0882f29da9b2f5b4dd, user_id=2d35328c24a14f93a724abc89f97cfdd, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:16.879333 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe992ad-baf6-4e6e-bccb-041360dfb23e admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:16.900567 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 928/1839] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:28:16 2022] PUT /identity/v3/projects/3e713313dd0f4f0882f29da9b2f5b4dd/users/2d35328c24a14f93a724abc89f97cfdd/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:28:16.908691 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea438c-b319-4de4-a286-4f65875cf0c4 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:16.908992 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea438c-b319-4de4-a286-4f65875cf0c4 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:16.909275 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea438c-b319-4de4-a286-4f65875cf0c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:16.940010 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-60ea438c-b319-4de4-a286-4f65875cf0c4 None None] MFA Rules not processed for user `2d35328c24a14f93a724abc89f97cfdd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:28:16.941316 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-60ea438c-b319-4de4-a286-4f65875cf0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:16.947518 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-eadb6ced-08b1-49f0-9c9c-ac448eb65039 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc6187aea5324996bd88a768e985cb1f', 'request_id': 'req-eadb6ced-08b1-49f0-9c9c-ac448eb65039'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:16.962294 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-eadb6ced-08b1-49f0-9c9c-ac448eb65039 admin admin] The token cache is being invalidate because project fc6187aea5324996bd88a768e985cb1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:28:16.962586 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-eadb6ced-08b1-49f0-9c9c-ac448eb65039 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:16.963268 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-eadb6ced-08b1-49f0-9c9c-ac448eb65039 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:16.965174 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 912/1840] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:28:16 2022] DELETE /identity/v3/projects/fc6187aea5324996bd88a768e985cb1f => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:28:16.970457 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71ebd9-bac4-4bb0-9e3a-05d3d04f45f6 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:16.970995 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71ebd9-bac4-4bb0-9e3a-05d3d04f45f6 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:16.971807 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71ebd9-bac4-4bb0-9e3a-05d3d04f45f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:17.006615 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-1d71ebd9-bac4-4bb0-9e3a-05d3d04f45f6 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:28:17.008089 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-1d71ebd9-bac4-4bb0-9e3a-05d3d04f45f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:17.025037 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 929/1841] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:28:16 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:28:17.038050 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ea438c-b319-4de4-a286-4f65875cf0c4 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:17.040455 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-60ea438c-b319-4de4-a286-4f65875cf0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:17.114903 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 913/1842] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:28:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:28:17.116835 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ad0fd-e06e-4ab7-8b82-02693a047f14 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:17.117150 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ad0fd-e06e-4ab7-8b82-02693a047f14 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:17.117414 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ad0fd-e06e-4ab7-8b82-02693a047f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:17.123715 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ea438c-b319-4de4-a286-4f65875cf0c4 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:17.128441 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff6f79b-b8af-4f0d-becb-f9cefb4b37f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:17.129115 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff6f79b-b8af-4f0d-becb-f9cefb4b37f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:17.129404 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff6f79b-b8af-4f0d-becb-f9cefb4b37f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:17.129686 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff6f79b-b8af-4f0d-becb-f9cefb4b37f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:17.137915 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-267ad0fd-e06e-4ab7-8b82-02693a047f14 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:28:17.139538 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-267ad0fd-e06e-4ab7-8b82-02693a047f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:17.162338 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff6f79b-b8af-4f0d-becb-f9cefb4b37f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:17.164021 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff6f79b-b8af-4f0d-becb-f9cefb4b37f9 service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:17.171547 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 914/1843] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:28:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:28:17.180329 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 930/1844] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:28:17 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:28:17.187053 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267ad0fd-e06e-4ab7-8b82-02693a047f14 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:17.193879 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebacf49d-30d7-4c71-853a-e85ad0dca46d None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:17.194176 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebacf49d-30d7-4c71-853a-e85ad0dca46d None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:17.194465 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebacf49d-30d7-4c71-853a-e85ad0dca46d None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:17.195884 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 931/1845] 10.222.0.24 () {54 vars in 921 bytes} [Thu Apr 7 06:28:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 07 06:28:17.205015 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267ad0fd-e06e-4ab7-8b82-02693a047f14 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:17.211795 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9794360-f52f-434f-88d7-b3a3089319d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:17.212795 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9794360-f52f-434f-88d7-b3a3089319d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:17.213402 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9794360-f52f-434f-88d7-b3a3089319d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:17.213891 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9794360-f52f-434f-88d7-b3a3089319d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:17.215143 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9794360-f52f-434f-88d7-b3a3089319d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:28:17.215673 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9794360-f52f-434f-88d7-b3a3089319d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:17.218142 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9794360-f52f-434f-88d7-b3a3089319d9 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:17.238925 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 915/1846] 10.222.0.24 () {58 vars in 1152 bytes} [Thu Apr 7 06:28:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:28:17.243015 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebacf49d-30d7-4c71-853a-e85ad0dca46d None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:17.261800 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd02d9be-d0e2-48b4-9b56-445bad495008 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:17.261800 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd02d9be-d0e2-48b4-9b56-445bad495008 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:17.263969 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd02d9be-d0e2-48b4-9b56-445bad495008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:17.269086 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebacf49d-30d7-4c71-853a-e85ad0dca46d None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:17.284770 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabd687e-44e1-4863-a9f9-eaa956402199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:17.285519 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd687e-44e1-4863-a9f9-eaa956402199 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:17.307933 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd687e-44e1-4863-a9f9-eaa956402199 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:17.311357 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd687e-44e1-4863-a9f9-eaa956402199 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:17.312525 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabd687e-44e1-4863-a9f9-eaa956402199 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:17.323154 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabd687e-44e1-4863-a9f9-eaa956402199 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:17.346276 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-cd02d9be-d0e2-48b4-9b56-445bad495008 None None] MFA Rules not processed for user `02cd81f6620f410db450871fb29961f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:28:17.362640 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-cd02d9be-d0e2-48b4-9b56-445bad495008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:17.500051 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 916/1847] 10.222.0.24 () {58 vars in 1018 bytes} [Thu Apr 7 06:28:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:28:17.502001 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd02d9be-d0e2-48b4-9b56-445bad495008 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:17.505065 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-cd02d9be-d0e2-48b4-9b56-445bad495008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:17.521426 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 932/1848] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:28:17 2022] POST /identity/v3/projects => generated 373 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:28:17.522310 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabd687e-44e1-4863-a9f9-eaa956402199 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:17.529161 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-aabd687e-44e1-4863-a9f9-eaa956402199 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:17.550182 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd02d9be-d0e2-48b4-9b56-445bad495008 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:17.670974 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cef14d-159d-46ef-82c9-df6616bda023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:17.672081 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cef14d-159d-46ef-82c9-df6616bda023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:17.672396 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cef14d-159d-46ef-82c9-df6616bda023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:17.672685 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cef14d-159d-46ef-82c9-df6616bda023 admin admin] PATH_INFO: `/v3/users/dd9abc0cda3e4480a659f0c7dd69e0aa` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:17.673930 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cef14d-159d-46ef-82c9-df6616bda023 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd9abc0cda3e4480a659f0c7dd69e0aa)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:17.676387 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cef14d-159d-46ef-82c9-df6616bda023 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:17.679560 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabd687e-44e1-4863-a9f9-eaa956402199 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:17.689787 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb5022-25ef-43ee-94da-71a6c9efb230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:17.690843 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb5022-25ef-43ee-94da-71a6c9efb230 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:17.691135 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb5022-25ef-43ee-94da-71a6c9efb230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:17.691419 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb5022-25ef-43ee-94da-71a6c9efb230 admin admin] PATH_INFO: `/v3/projects/977099962b8e43a6ba8e7ba5f5aeed55` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:17.692899 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdb5022-25ef-43ee-94da-71a6c9efb230 admin admin] RBAC: Authorizing `identity:delete_project(project_id=977099962b8e43a6ba8e7ba5f5aeed55)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:17.694911 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdb5022-25ef-43ee-94da-71a6c9efb230 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:17.881562 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7fdb5022-25ef-43ee-94da-71a6c9efb230 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '977099962b8e43a6ba8e7ba5f5aeed55', 'request_id': 'req-7fdb5022-25ef-43ee-94da-71a6c9efb230'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:17.887833 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-72cef14d-159d-46ef-82c9-df6616bda023 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd9abc0cda3e4480a659f0c7dd69e0aa'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:17.890411 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-72cef14d-159d-46ef-82c9-df6616bda023 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd9abc0cda3e4480a659f0c7dd69e0aa'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:17.896623 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7fdb5022-25ef-43ee-94da-71a6c9efb230 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '977099962b8e43a6ba8e7ba5f5aeed55', 'request_id': 'req-7fdb5022-25ef-43ee-94da-71a6c9efb230'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:17.992022 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-72cef14d-159d-46ef-82c9-df6616bda023 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd9abc0cda3e4480a659f0c7dd69e0aa'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:17.992661 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-72cef14d-159d-46ef-82c9-df6616bda023 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd9abc0cda3e4480a659f0c7dd69e0aa'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:18.007066 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-72cef14d-159d-46ef-82c9-df6616bda023 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd9abc0cda3e4480a659f0c7dd69e0aa'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:18.021523 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 917/1849] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:28:17 2022] DELETE /identity/v3/users/dd9abc0cda3e4480a659f0c7dd69e0aa => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:28:18.022260 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cef14d-159d-46ef-82c9-df6616bda023 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:18.024014 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-72cef14d-159d-46ef-82c9-df6616bda023 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:18.082672 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7fdb5022-25ef-43ee-94da-71a6c9efb230 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '977099962b8e43a6ba8e7ba5f5aeed55', 'request_id': 'req-7fdb5022-25ef-43ee-94da-71a6c9efb230'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:18.095485 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7fdb5022-25ef-43ee-94da-71a6c9efb230 admin admin] The token cache is being invalidate because project 977099962b8e43a6ba8e7ba5f5aeed55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:28:18.095826 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7fdb5022-25ef-43ee-94da-71a6c9efb230 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:18.101775 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7fdb5022-25ef-43ee-94da-71a6c9efb230 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:18.101775 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 933/1850] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:28:17 2022] DELETE /identity/v3/projects/977099962b8e43a6ba8e7ba5f5aeed55 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:28:18.101966 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cef14d-159d-46ef-82c9-df6616bda023 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:18.102055 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb5022-25ef-43ee-94da-71a6c9efb230 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:18.105656 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-7fdb5022-25ef-43ee-94da-71a6c9efb230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:18.113907 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1309029d-24f1-4c2e-bc78-96828d2b1de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:18.115661 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1309029d-24f1-4c2e-bc78-96828d2b1de2 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:18.116162 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1309029d-24f1-4c2e-bc78-96828d2b1de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:18.118225 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1309029d-24f1-4c2e-bc78-96828d2b1de2 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:18.119347 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1309029d-24f1-4c2e-bc78-96828d2b1de2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:18.122197 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1309029d-24f1-4c2e-bc78-96828d2b1de2 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:18.207342 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb5022-25ef-43ee-94da-71a6c9efb230 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:18.277441 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de9b483-c6e3-4219-b158-8d8d4a4e10ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cd81f6620f410db450871fb29961f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:18.278230 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9b483-c6e3-4219-b158-8d8d4a4e10ea service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:18.278626 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9b483-c6e3-4219-b158-8d8d4a4e10ea service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:18.279009 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9b483-c6e3-4219-b158-8d8d4a4e10ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:18.280533 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 918/1851] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:28:18 2022] POST /identity/v3/users => generated 287 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:28:18.282717 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa044a6b-d1df-47b4-889d-a088a197408c None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:18.282857 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-8de9b483-c6e3-4219-b158-8d8d4a4e10ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:18.283144 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa044a6b-d1df-47b4-889d-a088a197408c None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:18.283492 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa044a6b-d1df-47b4-889d-a088a197408c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:18.299140 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de9b483-c6e3-4219-b158-8d8d4a4e10ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:18.301644 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-fa044a6b-d1df-47b4-889d-a088a197408c None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:28:18.301975 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de9b483-c6e3-4219-b158-8d8d4a4e10ea service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:18.302974 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-fa044a6b-d1df-47b4-889d-a088a197408c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:18.313322 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 919/1852] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:28:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:28:18.314372 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa044a6b-d1df-47b4-889d-a088a197408c None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:18.315453 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 934/1853] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:28:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:28:18.316188 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-fa044a6b-d1df-47b4-889d-a088a197408c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:18.316474 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de9b483-c6e3-4219-b158-8d8d4a4e10ea service nova] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:18.318819 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-8de9b483-c6e3-4219-b158-8d8d4a4e10ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:18.329139 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa044a6b-d1df-47b4-889d-a088a197408c None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:18.334418 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c811a-db24-433e-8796-6edc185308eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:18.335584 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c811a-db24-433e-8796-6edc185308eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:18.336159 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c811a-db24-433e-8796-6edc185308eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:18.336303 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c811a-db24-433e-8796-6edc185308eb admin admin] PATH_INFO: `/v3/users/2c397ac332014d09bd6ecc17b602f597` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:18.337636 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31c811a-db24-433e-8796-6edc185308eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c397ac332014d09bd6ecc17b602f597)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:18.339955 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31c811a-db24-433e-8796-6edc185308eb admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:18.340239 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de9b483-c6e3-4219-b158-8d8d4a4e10ea service nova] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:18.366196 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dcc0e5-9c38-4dc5-9929-eb87acb9366f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:18.366737 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dcc0e5-9c38-4dc5-9929-eb87acb9366f admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:18.367076 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dcc0e5-9c38-4dc5-9929-eb87acb9366f admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:18.367432 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dcc0e5-9c38-4dc5-9929-eb87acb9366f admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:18.368305 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dcc0e5-9c38-4dc5-9929-eb87acb9366f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:18.372265 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dcc0e5-9c38-4dc5-9929-eb87acb9366f admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:18.386529 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 935/1854] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:28:18.391698 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dcc0e5-9c38-4dc5-9929-eb87acb9366f admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:18.393514 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d0dcc0e5-9c38-4dc5-9929-eb87acb9366f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:18.478890 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dcc0e5-9c38-4dc5-9929-eb87acb9366f admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:18.501943 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7721e900-8987-40fb-97ab-06edb66c0fbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:18.502666 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721e900-8987-40fb-97ab-06edb66c0fbb service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:18.502948 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721e900-8987-40fb-97ab-06edb66c0fbb service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:18.503426 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721e900-8987-40fb-97ab-06edb66c0fbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:18.515552 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7721e900-8987-40fb-97ab-06edb66c0fbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:18.517112 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7721e900-8987-40fb-97ab-06edb66c0fbb service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:18.528797 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 936/1855] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:28:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:28:18.529870 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7721e900-8987-40fb-97ab-06edb66c0fbb service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:18.540969 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7721e900-8987-40fb-97ab-06edb66c0fbb service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:18.546753 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c530a1-ec76-4c9e-8ac9-21d5432de43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:18.547576 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c530a1-ec76-4c9e-8ac9-21d5432de43c admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:18.547905 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c530a1-ec76-4c9e-8ac9-21d5432de43c admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:18.548174 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c530a1-ec76-4c9e-8ac9-21d5432de43c admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:18.558539 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c530a1-ec76-4c9e-8ac9-21d5432de43c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:18.558539 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c530a1-ec76-4c9e-8ac9-21d5432de43c admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:18.564130 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 937/1856] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:28:18.569358 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c530a1-ec76-4c9e-8ac9-21d5432de43c admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:18.588511 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c530a1-ec76-4c9e-8ac9-21d5432de43c admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:18.595271 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a252146-1868-4829-b823-db9ebc17cf75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:18.596592 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a252146-1868-4829-b823-db9ebc17cf75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:18.597138 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a252146-1868-4829-b823-db9ebc17cf75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:18.597610 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a252146-1868-4829-b823-db9ebc17cf75 admin admin] PATH_INFO: `/v3/projects/bb5d63cbfd0c410c8510a0d5df9d9b6d/users/027bccd998444dd7b946d3f06f267300/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:18.606963 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-e31c811a-db24-433e-8796-6edc185308eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c397ac332014d09bd6ecc17b602f597'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:18.608404 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-e31c811a-db24-433e-8796-6edc185308eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c397ac332014d09bd6ecc17b602f597'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:18.618380 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a252146-1868-4829-b823-db9ebc17cf75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb5d63cbfd0c410c8510a0d5df9d9b6d, user_id=027bccd998444dd7b946d3f06f267300, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:18.621523 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a252146-1868-4829-b823-db9ebc17cf75 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:18.711130 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-e31c811a-db24-433e-8796-6edc185308eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c397ac332014d09bd6ecc17b602f597'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:18.712358 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-e31c811a-db24-433e-8796-6edc185308eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c397ac332014d09bd6ecc17b602f597'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:18.739348 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-e31c811a-db24-433e-8796-6edc185308eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c397ac332014d09bd6ecc17b602f597'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:18.753133 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 920/1857] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:28:18 2022] DELETE /identity/v3/users/2c397ac332014d09bd6ecc17b602f597 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:28:18.760422 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 938/1858] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:28:18 2022] PUT /identity/v3/projects/bb5d63cbfd0c410c8510a0d5df9d9b6d/users/027bccd998444dd7b946d3f06f267300/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:28:18.765579 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897ea45-a762-4d59-8102-b2a16a037f70 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:18.766666 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897ea45-a762-4d59-8102-b2a16a037f70 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:18.767201 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897ea45-a762-4d59-8102-b2a16a037f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:18.794169 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-1897ea45-a762-4d59-8102-b2a16a037f70 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:28:18.796109 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-1897ea45-a762-4d59-8102-b2a16a037f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:18.941166 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 921/1859] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:28:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:28:18.952249 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a252146-1868-4829-b823-db9ebc17cf75 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:18.954794 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-9a252146-1868-4829-b823-db9ebc17cf75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:19.024508 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a252146-1868-4829-b823-db9ebc17cf75 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:19.076462 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9dd170-7203-4c86-a747-9c8d662e469f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:19.077133 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9dd170-7203-4c86-a747-9c8d662e469f service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:19.077422 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9dd170-7203-4c86-a747-9c8d662e469f service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:19.077698 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9dd170-7203-4c86-a747-9c8d662e469f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:19.087414 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9dd170-7203-4c86-a747-9c8d662e469f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:19.088895 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9dd170-7203-4c86-a747-9c8d662e469f service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:19.099130 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 939/1860] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:28:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:28:19.355690 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9dd170-7203-4c86-a747-9c8d662e469f service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:19.356924 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1897ea45-a762-4d59-8102-b2a16a037f70 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:19.359417 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-1897ea45-a762-4d59-8102-b2a16a037f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:19.360921 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-9e9dd170-7203-4c86-a747-9c8d662e469f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:19.381499 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1897ea45-a762-4d59-8102-b2a16a037f70 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:19.382005 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9dd170-7203-4c86-a747-9c8d662e469f service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:19.387814 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a33dd35-656d-43ab-92e2-e6aebc5d9cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:19.388711 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33dd35-656d-43ab-92e2-e6aebc5d9cc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:19.389060 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33dd35-656d-43ab-92e2-e6aebc5d9cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:19.389263 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33dd35-656d-43ab-92e2-e6aebc5d9cc3 admin admin] PATH_INFO: `/v3/projects/c1c6ce22a8ec4f3ea9bd2ff0592571fa` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:19.390161 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d0e4be-bae9-43fb-b5fe-d1b26ee47dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:19.390717 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a33dd35-656d-43ab-92e2-e6aebc5d9cc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1c6ce22a8ec4f3ea9bd2ff0592571fa)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:19.392999 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0e4be-bae9-43fb-b5fe-d1b26ee47dad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:19.393474 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0e4be-bae9-43fb-b5fe-d1b26ee47dad admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:19.393949 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0e4be-bae9-43fb-b5fe-d1b26ee47dad admin admin] PATH_INFO: `/v3/projects/ffe0694abcc44947a6eff2c2cb1e0334` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:19.395760 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a33dd35-656d-43ab-92e2-e6aebc5d9cc3 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:19.396556 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d0e4be-bae9-43fb-b5fe-d1b26ee47dad admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffe0694abcc44947a6eff2c2cb1e0334)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:19.400627 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d0e4be-bae9-43fb-b5fe-d1b26ee47dad admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:19.579848 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-59d0e4be-bae9-43fb-b5fe-d1b26ee47dad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffe0694abcc44947a6eff2c2cb1e0334', 'request_id': 'req-59d0e4be-bae9-43fb-b5fe-d1b26ee47dad'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:19.580908 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6a33dd35-656d-43ab-92e2-e6aebc5d9cc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1c6ce22a8ec4f3ea9bd2ff0592571fa', 'request_id': 'req-6a33dd35-656d-43ab-92e2-e6aebc5d9cc3'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:19.585137 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-59d0e4be-bae9-43fb-b5fe-d1b26ee47dad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffe0694abcc44947a6eff2c2cb1e0334', 'request_id': 'req-59d0e4be-bae9-43fb-b5fe-d1b26ee47dad'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:19.586883 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6a33dd35-656d-43ab-92e2-e6aebc5d9cc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1c6ce22a8ec4f3ea9bd2ff0592571fa', 'request_id': 'req-6a33dd35-656d-43ab-92e2-e6aebc5d9cc3'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:19.705880 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-59d0e4be-bae9-43fb-b5fe-d1b26ee47dad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffe0694abcc44947a6eff2c2cb1e0334', 'request_id': 'req-59d0e4be-bae9-43fb-b5fe-d1b26ee47dad'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:19.717191 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-59d0e4be-bae9-43fb-b5fe-d1b26ee47dad admin admin] The token cache is being invalidate because project ffe0694abcc44947a6eff2c2cb1e0334 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:28:19.717484 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-59d0e4be-bae9-43fb-b5fe-d1b26ee47dad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:19.718125 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-59d0e4be-bae9-43fb-b5fe-d1b26ee47dad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:19.719714 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 922/1861] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:28:19 2022] DELETE /identity/v3/projects/ffe0694abcc44947a6eff2c2cb1e0334 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:28:19.723444 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d0e4be-bae9-43fb-b5fe-d1b26ee47dad admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:19.724748 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-59d0e4be-bae9-43fb-b5fe-d1b26ee47dad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:19.786742 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d0e4be-bae9-43fb-b5fe-d1b26ee47dad admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:19.797511 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6a33dd35-656d-43ab-92e2-e6aebc5d9cc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1c6ce22a8ec4f3ea9bd2ff0592571fa', 'request_id': 'req-6a33dd35-656d-43ab-92e2-e6aebc5d9cc3'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:19.807973 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6a33dd35-656d-43ab-92e2-e6aebc5d9cc3 admin admin] The token cache is being invalidate because project c1c6ce22a8ec4f3ea9bd2ff0592571fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:28:19.808261 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6a33dd35-656d-43ab-92e2-e6aebc5d9cc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:19.808881 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6a33dd35-656d-43ab-92e2-e6aebc5d9cc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:19.810424 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 940/1862] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:28:19 2022] DELETE /identity/v3/projects/c1c6ce22a8ec4f3ea9bd2ff0592571fa => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:28:19.816043 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21cd54-2e69-47bc-a9df-d68b8d99fa6b None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:19.816328 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21cd54-2e69-47bc-a9df-d68b8d99fa6b None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:19.816605 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21cd54-2e69-47bc-a9df-d68b8d99fa6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:19.834043 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-3a21cd54-2e69-47bc-a9df-d68b8d99fa6b None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:28:19.835248 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-3a21cd54-2e69-47bc-a9df-d68b8d99fa6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:19.842564 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188fce8-78fa-4e5f-8f21-42727219223f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:19.843448 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188fce8-78fa-4e5f-8f21-42727219223f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:19.843769 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188fce8-78fa-4e5f-8f21-42727219223f admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:19.845935 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188fce8-78fa-4e5f-8f21-42727219223f admin admin] PATH_INFO: `/v3/users/2d35328c24a14f93a724abc89f97cfdd` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:19.847190 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e188fce8-78fa-4e5f-8f21-42727219223f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d35328c24a14f93a724abc89f97cfdd)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:19.849194 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e188fce8-78fa-4e5f-8f21-42727219223f admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:19.962206 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 941/1863] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:28:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:28:19.970495 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a504b-362b-4494-a452-918a760a7a88 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:19.970796 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a504b-362b-4494-a452-918a760a7a88 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:19.971061 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a504b-362b-4494-a452-918a760a7a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:19.995029 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-919a504b-362b-4494-a452-918a760a7a88 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:28:20.001655 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-919a504b-362b-4494-a452-918a760a7a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:20.016507 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 942/1864] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:28:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:28:20.020999 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a504b-362b-4494-a452-918a760a7a88 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:20.034025 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a504b-362b-4494-a452-918a760a7a88 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:20.041043 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a70a3f0-7470-4b2d-96ee-bac686d644c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:20.042173 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70a3f0-7470-4b2d-96ee-bac686d644c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:20.042628 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70a3f0-7470-4b2d-96ee-bac686d644c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:20.044941 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70a3f0-7470-4b2d-96ee-bac686d644c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:20.044941 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a70a3f0-7470-4b2d-96ee-bac686d644c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:28:20.044941 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a70a3f0-7470-4b2d-96ee-bac686d644c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:20.046743 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a70a3f0-7470-4b2d-96ee-bac686d644c9 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:20.065900 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 943/1865] 10.222.0.24 () {58 vars in 1152 bytes} [Thu Apr 7 06:28:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:28:20.088221 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a70a3f0-7470-4b2d-96ee-bac686d644c9 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:20.105461 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-e188fce8-78fa-4e5f-8f21-42727219223f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d35328c24a14f93a724abc89f97cfdd'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:20.106418 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-e188fce8-78fa-4e5f-8f21-42727219223f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d35328c24a14f93a724abc89f97cfdd'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:20.115917 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a70a3f0-7470-4b2d-96ee-bac686d644c9 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:20.129620 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5cbe34-e461-4e77-99f6-b62aabb85b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:20.130409 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5cbe34-e461-4e77-99f6-b62aabb85b07 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:20.130774 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5cbe34-e461-4e77-99f6-b62aabb85b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:20.131131 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5cbe34-e461-4e77-99f6-b62aabb85b07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:20.132267 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5cbe34-e461-4e77-99f6-b62aabb85b07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:20.134324 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5cbe34-e461-4e77-99f6-b62aabb85b07 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:20.248781 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-e188fce8-78fa-4e5f-8f21-42727219223f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d35328c24a14f93a724abc89f97cfdd'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:20.249483 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-e188fce8-78fa-4e5f-8f21-42727219223f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d35328c24a14f93a724abc89f97cfdd'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:20.264998 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-e188fce8-78fa-4e5f-8f21-42727219223f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d35328c24a14f93a724abc89f97cfdd'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:20.281103 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 923/1866] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:28:19 2022] DELETE /identity/v3/users/2d35328c24a14f93a724abc89f97cfdd => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:28:20.293648 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 944/1867] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:28:20 2022] POST /identity/v3/projects => generated 375 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:28:20.295254 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188fce8-78fa-4e5f-8f21-42727219223f admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:20.297569 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-e188fce8-78fa-4e5f-8f21-42727219223f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:20.399486 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188fce8-78fa-4e5f-8f21-42727219223f admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:20.501599 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c1b25-da41-434e-93c0-b591b5b76404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:20.502694 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c1b25-da41-434e-93c0-b591b5b76404 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:20.503128 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c1b25-da41-434e-93c0-b591b5b76404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:20.503644 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c1b25-da41-434e-93c0-b591b5b76404 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:20.504533 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2c1b25-da41-434e-93c0-b591b5b76404 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:20.508992 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2c1b25-da41-434e-93c0-b591b5b76404 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:20.614794 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 924/1868] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:28:20 2022] POST /identity/v3/users => generated 288 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:28:20.617347 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5cbe34-e461-4e77-99f6-b62aabb85b07 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:20.633609 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5cbe34-e461-4e77-99f6-b62aabb85b07 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:20.644524 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f094eac6-6515-40d2-98a7-5cbcc9e8b2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:20.645291 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094eac6-6515-40d2-98a7-5cbcc9e8b2ec admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:20.645645 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094eac6-6515-40d2-98a7-5cbcc9e8b2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:20.645937 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094eac6-6515-40d2-98a7-5cbcc9e8b2ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:20.646781 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f094eac6-6515-40d2-98a7-5cbcc9e8b2ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:20.650928 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f094eac6-6515-40d2-98a7-5cbcc9e8b2ec admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:20.674056 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 945/1869] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:28:20.679549 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c1b25-da41-434e-93c0-b591b5b76404 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:20.691112 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c1b25-da41-434e-93c0-b591b5b76404 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:20.704852 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e5de3-fce2-4596-acc0-c8067effde9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:20.706196 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e5de3-fce2-4596-acc0-c8067effde9b admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:20.706565 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e5de3-fce2-4596-acc0-c8067effde9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:20.706919 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e5de3-fce2-4596-acc0-c8067effde9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:20.707765 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3e5de3-fce2-4596-acc0-c8067effde9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:20.713927 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3e5de3-fce2-4596-acc0-c8067effde9b admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:20.751895 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 925/1870] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:28:20.756068 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f094eac6-6515-40d2-98a7-5cbcc9e8b2ec admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:20.785894 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f094eac6-6515-40d2-98a7-5cbcc9e8b2ec admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:20.800700 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f39653-68b0-4315-934f-17dae8d4652c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:20.801478 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f39653-68b0-4315-934f-17dae8d4652c admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:20.801774 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f39653-68b0-4315-934f-17dae8d4652c admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:20.802051 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f39653-68b0-4315-934f-17dae8d4652c admin admin] PATH_INFO: `/v3/projects/22c2aa9950c449a6af74f7aca65560d2/users/21c1c527a3c345c6b7f0783a9b5341ff/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:20.836692 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f39653-68b0-4315-934f-17dae8d4652c admin admin] RBAC: Authorizing `identity:create_grant(project_id=22c2aa9950c449a6af74f7aca65560d2, user_id=21c1c527a3c345c6b7f0783a9b5341ff, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:20.842389 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f39653-68b0-4315-934f-17dae8d4652c admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:20.931230 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 946/1871] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:28:20 2022] PUT /identity/v3/projects/22c2aa9950c449a6af74f7aca65560d2/users/21c1c527a3c345c6b7f0783a9b5341ff/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:28:20.941729 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89aa18-9fb4-431e-a91d-32de68fb8a0a None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:20.942027 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89aa18-9fb4-431e-a91d-32de68fb8a0a None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:20.942314 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89aa18-9fb4-431e-a91d-32de68fb8a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:20.973881 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-cc89aa18-9fb4-431e-a91d-32de68fb8a0a None None] MFA Rules not processed for user `21c1c527a3c345c6b7f0783a9b5341ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:28:20.975186 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-cc89aa18-9fb4-431e-a91d-32de68fb8a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:21.061495 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 926/1872] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:28:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:28:21.065863 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f39653-68b0-4315-934f-17dae8d4652c admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:21.162507 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f39653-68b0-4315-934f-17dae8d4652c admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:21.171839 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf74fcf-6f56-4795-91aa-aa74adb848f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:21.173779 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf74fcf-6f56-4795-91aa-aa74adb848f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:21.174080 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf74fcf-6f56-4795-91aa-aa74adb848f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:21.174368 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf74fcf-6f56-4795-91aa-aa74adb848f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:21.175549 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf74fcf-6f56-4795-91aa-aa74adb848f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:21.178095 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf74fcf-6f56-4795-91aa-aa74adb848f9 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:21.325679 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc89aa18-9fb4-431e-a91d-32de68fb8a0a None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:21.326641 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 947/1873] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:28:21 2022] POST /identity/v3/projects => generated 377 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:28:21.338548 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc89aa18-9fb4-431e-a91d-32de68fb8a0a None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:21.458078 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bfd6f9-2d11-4e11-9abb-bf8c305997d3 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:21.458372 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bfd6f9-2d11-4e11-9abb-bf8c305997d3 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:21.458649 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bfd6f9-2d11-4e11-9abb-bf8c305997d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:21.461182 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec7388-d3cf-4e4a-b157-5198f7b2dfe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:21.461874 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec7388-d3cf-4e4a-b157-5198f7b2dfe1 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:21.462215 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec7388-d3cf-4e4a-b157-5198f7b2dfe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:21.462502 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec7388-d3cf-4e4a-b157-5198f7b2dfe1 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:21.463228 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ec7388-d3cf-4e4a-b157-5198f7b2dfe1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:21.465215 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ec7388-d3cf-4e4a-b157-5198f7b2dfe1 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:21.494630 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-a8bfd6f9-2d11-4e11-9abb-bf8c305997d3 None None] MFA Rules not processed for user `027bccd998444dd7b946d3f06f267300`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:28:21.496131 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a8bfd6f9-2d11-4e11-9abb-bf8c305997d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:21.575730 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 948/1874] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:28:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:28:21.580827 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bfd6f9-2d11-4e11-9abb-bf8c305997d3 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:21.582334 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a8bfd6f9-2d11-4e11-9abb-bf8c305997d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:21.596293 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bfd6f9-2d11-4e11-9abb-bf8c305997d3 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:21.600919 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b087f046-a581-499e-87ba-420bbd434fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:21.602550 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b087f046-a581-499e-87ba-420bbd434fc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:21.602550 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b087f046-a581-499e-87ba-420bbd434fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:21.602550 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b087f046-a581-499e-87ba-420bbd434fc9 admin admin] PATH_INFO: `/v3/projects/3e713313dd0f4f0882f29da9b2f5b4dd` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:21.603575 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b087f046-a581-499e-87ba-420bbd434fc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e713313dd0f4f0882f29da9b2f5b4dd)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:21.605588 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b087f046-a581-499e-87ba-420bbd434fc9 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:21.633919 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 927/1875] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:28:21 2022] POST /identity/v3/users => generated 295 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:28:21.635171 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec7388-d3cf-4e4a-b157-5198f7b2dfe1 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:21.638907 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-63ec7388-d3cf-4e4a-b157-5198f7b2dfe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:21.651058 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec7388-d3cf-4e4a-b157-5198f7b2dfe1 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:21.655779 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78f868-804b-4d43-b232-a8d12291869a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:21.656516 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78f868-804b-4d43-b232-a8d12291869a admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:21.656803 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78f868-804b-4d43-b232-a8d12291869a admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:21.657085 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78f868-804b-4d43-b232-a8d12291869a admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:21.657781 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee78f868-804b-4d43-b232-a8d12291869a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:21.659695 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee78f868-804b-4d43-b232-a8d12291869a admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:21.800915 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b087f046-a581-499e-87ba-420bbd434fc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e713313dd0f4f0882f29da9b2f5b4dd', 'request_id': 'req-b087f046-a581-499e-87ba-420bbd434fc9'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:21.814350 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 928/1876] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:28:21 2022] POST /identity/v3/projects => generated 373 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:28:21.820099 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78f868-804b-4d43-b232-a8d12291869a admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:21.820619 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b087f046-a581-499e-87ba-420bbd434fc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e713313dd0f4f0882f29da9b2f5b4dd', 'request_id': 'req-b087f046-a581-499e-87ba-420bbd434fc9'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:21.910780 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b087f046-a581-499e-87ba-420bbd434fc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e713313dd0f4f0882f29da9b2f5b4dd', 'request_id': 'req-b087f046-a581-499e-87ba-420bbd434fc9'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:21.930646 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b087f046-a581-499e-87ba-420bbd434fc9 admin admin] The token cache is being invalidate because project 3e713313dd0f4f0882f29da9b2f5b4dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:28:21.930646 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b087f046-a581-499e-87ba-420bbd434fc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:21.930929 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b087f046-a581-499e-87ba-420bbd434fc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:21.931975 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78f868-804b-4d43-b232-a8d12291869a admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:21.939194 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 949/1877] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:28:21 2022] DELETE /identity/v3/projects/3e713313dd0f4f0882f29da9b2f5b4dd => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:28:21.940161 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b087f046-a581-499e-87ba-420bbd434fc9 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:21.941541 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b087f046-a581-499e-87ba-420bbd434fc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:21.943286 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe5512b-0c30-4293-a84e-063f5d74197d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:21.944162 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe5512b-0c30-4293-a84e-063f5d74197d admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:21.944459 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe5512b-0c30-4293-a84e-063f5d74197d admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:21.944735 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe5512b-0c30-4293-a84e-063f5d74197d admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:21.945481 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe5512b-0c30-4293-a84e-063f5d74197d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:21.950498 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe5512b-0c30-4293-a84e-063f5d74197d admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:21.965713 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 929/1878] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:28:21 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:28:21.967774 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88786b91-fc21-442d-8f3b-9fa72317e952 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:21.968063 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88786b91-fc21-442d-8f3b-9fa72317e952 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:21.968341 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88786b91-fc21-442d-8f3b-9fa72317e952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:21.988628 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-88786b91-fc21-442d-8f3b-9fa72317e952 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:28:21.989903 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-88786b91-fc21-442d-8f3b-9fa72317e952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:21.998621 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 930/1879] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:28:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:28:21.999495 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88786b91-fc21-442d-8f3b-9fa72317e952 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:22.001469 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-88786b91-fc21-442d-8f3b-9fa72317e952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:22.013937 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88786b91-fc21-442d-8f3b-9fa72317e952 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:22.019927 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3aa8ff-b7f9-40dd-b49a-dc1eae293691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:22.021002 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3aa8ff-b7f9-40dd-b49a-dc1eae293691 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:22.021337 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3aa8ff-b7f9-40dd-b49a-dc1eae293691 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:22.021699 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3aa8ff-b7f9-40dd-b49a-dc1eae293691 admin admin] PATH_INFO: `/v3/projects/c6efd89bc5194b36b05112854b35e360/users/c12c8cb597424ee7bc02aa49051e5077/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:22.032986 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b087f046-a581-499e-87ba-420bbd434fc9 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:22.043572 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaff739-df06-4377-9909-76e9bcc56316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:22.043572 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaff739-df06-4377-9909-76e9bcc56316 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:22.043572 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaff739-df06-4377-9909-76e9bcc56316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:22.043572 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaff739-df06-4377-9909-76e9bcc56316 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:22.045498 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3aa8ff-b7f9-40dd-b49a-dc1eae293691 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6efd89bc5194b36b05112854b35e360, user_id=c12c8cb597424ee7bc02aa49051e5077, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:22.045577 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaff739-df06-4377-9909-76e9bcc56316 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:22.045646 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaff739-df06-4377-9909-76e9bcc56316 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:22.046183 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3aa8ff-b7f9-40dd-b49a-dc1eae293691 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:22.134422 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 931/1880] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:28:21 2022] PUT /identity/v3/projects/c6efd89bc5194b36b05112854b35e360/users/c12c8cb597424ee7bc02aa49051e5077/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:28:22.135739 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0ab30-e6c6-4f6f-bca1-1d03977d6624 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:22.136434 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0ab30-e6c6-4f6f-bca1-1d03977d6624 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:22.143855 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0ab30-e6c6-4f6f-bca1-1d03977d6624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:22.156853 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-57c0ab30-e6c6-4f6f-bca1-1d03977d6624 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:28:22.158465 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-57c0ab30-e6c6-4f6f-bca1-1d03977d6624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:22.181888 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 950/1881] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:28:21 2022] POST /identity/v3/users => generated 293 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:28:22.183244 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaff739-df06-4377-9909-76e9bcc56316 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:22.195335 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaff739-df06-4377-9909-76e9bcc56316 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:22.239408 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 932/1882] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:28:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:28:22.240242 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c0ab30-e6c6-4f6f-bca1-1d03977d6624 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:22.260856 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c0ab30-e6c6-4f6f-bca1-1d03977d6624 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:22.271256 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a8eebb-43dc-414d-b67c-b6f07423ddab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:22.272005 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a8eebb-43dc-414d-b67c-b6f07423ddab admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:22.272295 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a8eebb-43dc-414d-b67c-b6f07423ddab admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:22.272577 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a8eebb-43dc-414d-b67c-b6f07423ddab admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:22.274104 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a8eebb-43dc-414d-b67c-b6f07423ddab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:22.276084 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a8eebb-43dc-414d-b67c-b6f07423ddab admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:22.294838 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 933/1883] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:28:22.295227 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049604a6-1757-432e-a467-b714c3125143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:22.295775 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a8eebb-43dc-414d-b67c-b6f07423ddab admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:22.295975 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049604a6-1757-432e-a467-b714c3125143 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:22.298146 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049604a6-1757-432e-a467-b714c3125143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:22.298632 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049604a6-1757-432e-a467-b714c3125143 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:22.299138 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049604a6-1757-432e-a467-b714c3125143 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:22.300782 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049604a6-1757-432e-a467-b714c3125143 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:22.306503 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a8eebb-43dc-414d-b67c-b6f07423ddab admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:22.313598 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 951/1884] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:28:22.314497 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049604a6-1757-432e-a467-b714c3125143 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:22.314732 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ff448-b0a4-4873-96c9-a3ae12581bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:22.315738 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ff448-b0a4-4873-96c9-a3ae12581bbb admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:22.316559 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ff448-b0a4-4873-96c9-a3ae12581bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:22.316963 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ff448-b0a4-4873-96c9-a3ae12581bbb admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:22.317809 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700ff448-b0a4-4873-96c9-a3ae12581bbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:28:22.318187 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700ff448-b0a4-4873-96c9-a3ae12581bbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:22.320548 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700ff448-b0a4-4873-96c9-a3ae12581bbb admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:22.331615 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049604a6-1757-432e-a467-b714c3125143 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:22.333080 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb38cf-885f-4cef-8445-79d4bcb8a5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:22.333994 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb38cf-885f-4cef-8445-79d4bcb8a5db admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:22.334287 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb38cf-885f-4cef-8445-79d4bcb8a5db admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:22.334570 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb38cf-885f-4cef-8445-79d4bcb8a5db admin admin] PATH_INFO: `/v3/projects/7f66e76479bd4801bcc93691d58aeb3c/users/b6a516cb3ec54d2189fea67143983b49/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:22.335732 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 934/1885] 10.222.0.24 () {58 vars in 1152 bytes} [Thu Apr 7 06:28:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:28:22.337197 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ff448-b0a4-4873-96c9-a3ae12581bbb admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:22.351664 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ff448-b0a4-4873-96c9-a3ae12581bbb admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:22.353226 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeb38cf-885f-4cef-8445-79d4bcb8a5db admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f66e76479bd4801bcc93691d58aeb3c, user_id=b6a516cb3ec54d2189fea67143983b49, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:22.356018 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeb38cf-885f-4cef-8445-79d4bcb8a5db admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:22.358949 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc91ec-f867-499e-8687-3e40efe363d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:22.361554 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc91ec-f867-499e-8687-3e40efe363d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:22.361902 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc91ec-f867-499e-8687-3e40efe363d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:22.362243 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc91ec-f867-499e-8687-3e40efe363d7 admin admin] PATH_INFO: `/v3/projects/c6efd89bc5194b36b05112854b35e360/users/c12c8cb597424ee7bc02aa49051e5077/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:22.364801 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcc91ec-f867-499e-8687-3e40efe363d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6efd89bc5194b36b05112854b35e360, user_id=c12c8cb597424ee7bc02aa49051e5077, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:22.367588 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcc91ec-f867-499e-8687-3e40efe363d7 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:22.378181 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 935/1886] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:28:22 2022] PUT /identity/v3/projects/c6efd89bc5194b36b05112854b35e360/users/c12c8cb597424ee7bc02aa49051e5077/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:28:22.379948 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc91ec-f867-499e-8687-3e40efe363d7 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:22.452413 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc91ec-f867-499e-8687-3e40efe363d7 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:22.458170 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b05079-122f-406e-9e2e-6dd262cf0ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:22.458914 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b05079-122f-406e-9e2e-6dd262cf0ac1 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:22.459209 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b05079-122f-406e-9e2e-6dd262cf0ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:22.460032 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b05079-122f-406e-9e2e-6dd262cf0ac1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:22.460439 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b05079-122f-406e-9e2e-6dd262cf0ac1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:22.463209 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b05079-122f-406e-9e2e-6dd262cf0ac1 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:22.467778 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 952/1887] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:28:22 2022] PUT /identity/v3/projects/7f66e76479bd4801bcc93691d58aeb3c/users/b6a516cb3ec54d2189fea67143983b49/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:28:22.472077 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f739c-010b-4967-9403-e56e64fa2cd4 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:22.472722 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f739c-010b-4967-9403-e56e64fa2cd4 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:22.472722 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f739c-010b-4967-9403-e56e64fa2cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:22.502023 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-c78f739c-010b-4967-9403-e56e64fa2cd4 None None] MFA Rules not processed for user `c12c8cb597424ee7bc02aa49051e5077`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:28:22.503283 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c78f739c-010b-4967-9403-e56e64fa2cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:22.571663 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 953/1888] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:28:22 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:28:22.572611 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f739c-010b-4967-9403-e56e64fa2cd4 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:22.624572 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 936/1889] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:28:22 2022] POST /identity/v3/projects => generated 373 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:28:22.624572 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b05079-122f-406e-9e2e-6dd262cf0ac1 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:22.626406 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-92b05079-122f-406e-9e2e-6dd262cf0ac1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:22.637555 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f739c-010b-4967-9403-e56e64fa2cd4 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:22.684795 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b05079-122f-406e-9e2e-6dd262cf0ac1 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:22.689088 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862149bb-4603-416f-82e3-a40b116774de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:22.689747 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862149bb-4603-416f-82e3-a40b116774de service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:22.690040 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862149bb-4603-416f-82e3-a40b116774de service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:22.690319 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862149bb-4603-416f-82e3-a40b116774de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:22.692160 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-862149bb-4603-416f-82e3-a40b116774de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:22.700263 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc0ba6-421b-4e00-8f45-51977a1ce0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:22.701028 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc0ba6-421b-4e00-8f45-51977a1ce0c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:22.701324 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc0ba6-421b-4e00-8f45-51977a1ce0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:22.701607 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc0ba6-421b-4e00-8f45-51977a1ce0c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:22.702342 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dc0ba6-421b-4e00-8f45-51977a1ce0c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:22.704534 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dc0ba6-421b-4e00-8f45-51977a1ce0c9 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:22.715797 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 954/1890] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:28:22.715797 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc0ba6-421b-4e00-8f45-51977a1ce0c9 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:22.939534 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc0ba6-421b-4e00-8f45-51977a1ce0c9 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:22.939534 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb36955-abd1-4ebf-92a6-bfa99509c584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:22.939534 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb36955-abd1-4ebf-92a6-bfa99509c584 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:22.939534 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb36955-abd1-4ebf-92a6-bfa99509c584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:22.940555 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb36955-abd1-4ebf-92a6-bfa99509c584 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:22.940555 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb36955-abd1-4ebf-92a6-bfa99509c584 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:22.940555 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb36955-abd1-4ebf-92a6-bfa99509c584 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:22.941083 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862149bb-4603-416f-82e3-a40b116774de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:22.941083 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862149bb-4603-416f-82e3-a40b116774de service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:22.941083 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 937/1891] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:28:22 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:28:22.941083 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862149bb-4603-416f-82e3-a40b116774de service cinder] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:22.941083 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862149bb-4603-416f-82e3-a40b116774de service cinder] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:22.941484 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4960c8b-4c54-4611-b3d8-45e93c90abb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:22.941484 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4960c8b-4c54-4611-b3d8-45e93c90abb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:22.941484 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4960c8b-4c54-4611-b3d8-45e93c90abb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:22.941484 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4960c8b-4c54-4611-b3d8-45e93c90abb6 admin admin] PATH_INFO: `/v3/projects/7f66e76479bd4801bcc93691d58aeb3c/users/b6a516cb3ec54d2189fea67143983b49/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:22.941986 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4960c8b-4c54-4611-b3d8-45e93c90abb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f66e76479bd4801bcc93691d58aeb3c, user_id=b6a516cb3ec54d2189fea67143983b49, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:22.941986 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4960c8b-4c54-4611-b3d8-45e93c90abb6 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:22.941986 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 938/1892] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:28:22 2022] PUT /identity/v3/projects/7f66e76479bd4801bcc93691d58aeb3c/users/b6a516cb3ec54d2189fea67143983b49/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:28:23.145111 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4960c8b-4c54-4611-b3d8-45e93c90abb6 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:23.147284 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 955/1893] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:28:22 2022] POST /identity/v3/users => generated 287 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:28:23.209265 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4960c8b-4c54-4611-b3d8-45e93c90abb6 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:23.214114 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17572fc-7ca1-4412-a3b5-46a522bf6f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:23.214796 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17572fc-7ca1-4412-a3b5-46a522bf6f22 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:23.215082 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17572fc-7ca1-4412-a3b5-46a522bf6f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:23.215365 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17572fc-7ca1-4412-a3b5-46a522bf6f22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:23.216141 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17572fc-7ca1-4412-a3b5-46a522bf6f22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:23.217786 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17572fc-7ca1-4412-a3b5-46a522bf6f22 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:23.231234 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 939/1894] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:28:23.232692 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb36955-abd1-4ebf-92a6-bfa99509c584 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:23.243597 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb36955-abd1-4ebf-92a6-bfa99509c584 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:23.248365 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab2515-e01a-4189-9696-f8b11670a76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:23.249038 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab2515-e01a-4189-9696-f8b11670a76d admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:23.249454 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab2515-e01a-4189-9696-f8b11670a76d admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:23.249737 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab2515-e01a-4189-9696-f8b11670a76d admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:23.250528 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab2515-e01a-4189-9696-f8b11670a76d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:23.252148 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab2515-e01a-4189-9696-f8b11670a76d admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:23.262264 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 956/1895] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:28:23.267023 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17572fc-7ca1-4412-a3b5-46a522bf6f22 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:23.277160 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17572fc-7ca1-4412-a3b5-46a522bf6f22 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:23.282440 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a480d6d-9025-46cd-b824-6346fb4e404d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:23.283334 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a480d6d-9025-46cd-b824-6346fb4e404d admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:23.283604 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a480d6d-9025-46cd-b824-6346fb4e404d admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:23.283916 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a480d6d-9025-46cd-b824-6346fb4e404d admin admin] PATH_INFO: `/v3/projects/949ee2c59eea4062b104cae518e80066/users/a769560807714ecebd3478658884a210/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:23.305685 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a480d6d-9025-46cd-b824-6346fb4e404d admin admin] RBAC: Authorizing `identity:create_grant(project_id=949ee2c59eea4062b104cae518e80066, user_id=a769560807714ecebd3478658884a210, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:23.308560 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a480d6d-9025-46cd-b824-6346fb4e404d admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:23.445838 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 940/1896] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:28:23 2022] PUT /identity/v3/projects/949ee2c59eea4062b104cae518e80066/users/a769560807714ecebd3478658884a210/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:28:23.470792 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a52ef1-baa2-42f1-bbde-67b826d3d5bd None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:23.470792 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a52ef1-baa2-42f1-bbde-67b826d3d5bd None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:23.470792 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a52ef1-baa2-42f1-bbde-67b826d3d5bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:23.503630 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-52a52ef1-baa2-42f1-bbde-67b826d3d5bd None None] MFA Rules not processed for user `a769560807714ecebd3478658884a210`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:28:23.504953 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-52a52ef1-baa2-42f1-bbde-67b826d3d5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:23.573464 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 957/1897] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:28:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:28:23.592107 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a480d6d-9025-46cd-b824-6346fb4e404d admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:23.594376 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-8a480d6d-9025-46cd-b824-6346fb4e404d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:23.651045 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a480d6d-9025-46cd-b824-6346fb4e404d admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:23.654919 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a1388-b456-44e0-ad66-918acdef652a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:23.655573 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a1388-b456-44e0-ad66-918acdef652a service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:23.655921 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a1388-b456-44e0-ad66-918acdef652a service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:23.656198 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a1388-b456-44e0-ad66-918acdef652a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:23.665285 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036a1388-b456-44e0-ad66-918acdef652a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:23.666726 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036a1388-b456-44e0-ad66-918acdef652a service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:23.676447 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 941/1898] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:28:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:28:23.695955 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a52ef1-baa2-42f1-bbde-67b826d3d5bd None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:23.767299 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a52ef1-baa2-42f1-bbde-67b826d3d5bd None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:23.772364 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93091786-6375-46e7-b6eb-9e2edc56d181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:23.773699 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93091786-6375-46e7-b6eb-9e2edc56d181 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:23.773982 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93091786-6375-46e7-b6eb-9e2edc56d181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:23.774425 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93091786-6375-46e7-b6eb-9e2edc56d181 admin admin] PATH_INFO: `/v3/users/a769560807714ecebd3478658884a210` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:23.775801 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93091786-6375-46e7-b6eb-9e2edc56d181 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a769560807714ecebd3478658884a210)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:23.777731 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93091786-6375-46e7-b6eb-9e2edc56d181 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:24.041921 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-93091786-6375-46e7-b6eb-9e2edc56d181 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a769560807714ecebd3478658884a210'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:24.056867 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-93091786-6375-46e7-b6eb-9e2edc56d181 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a769560807714ecebd3478658884a210'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:24.134195 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-93091786-6375-46e7-b6eb-9e2edc56d181 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a769560807714ecebd3478658884a210'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:24.134815 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-93091786-6375-46e7-b6eb-9e2edc56d181 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a769560807714ecebd3478658884a210'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:24.135424 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-93091786-6375-46e7-b6eb-9e2edc56d181 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a769560807714ecebd3478658884a210'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:24.148722 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 958/1899] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:28:23 2022] DELETE /identity/v3/users/a769560807714ecebd3478658884a210 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:28:24.153239 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda53881-db91-4f25-aa7c-7c141a84745d None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:24.153534 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda53881-db91-4f25-aa7c-7c141a84745d None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:24.153818 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda53881-db91-4f25-aa7c-7c141a84745d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:24.173360 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-eda53881-db91-4f25-aa7c-7c141a84745d None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:28:24.174586 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-eda53881-db91-4f25-aa7c-7c141a84745d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:24.237189 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 942/1900] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:28:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:28:24.246810 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93091786-6375-46e7-b6eb-9e2edc56d181 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:24.248350 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-93091786-6375-46e7-b6eb-9e2edc56d181 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:24.306364 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93091786-6375-46e7-b6eb-9e2edc56d181 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:24.310592 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f23625a-a170-4f8a-b4cd-4618c432d282 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:24.310717 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23625a-a170-4f8a-b4cd-4618c432d282 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:24.311032 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23625a-a170-4f8a-b4cd-4618c432d282 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:24.311310 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23625a-a170-4f8a-b4cd-4618c432d282 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:24.321178 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f23625a-a170-4f8a-b4cd-4618c432d282 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:24.322565 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f23625a-a170-4f8a-b4cd-4618c432d282 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:24.335313 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 959/1901] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:28:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 07 06:28:25.015733 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda53881-db91-4f25-aa7c-7c141a84745d None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:25.017335 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-eda53881-db91-4f25-aa7c-7c141a84745d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:25.029140 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda53881-db91-4f25-aa7c-7c141a84745d None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:25.034781 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc836744-af4c-471b-8821-55c8d6badd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:25.035665 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc836744-af4c-471b-8821-55c8d6badd52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:25.035988 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc836744-af4c-471b-8821-55c8d6badd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:25.036620 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc836744-af4c-471b-8821-55c8d6badd52 admin admin] PATH_INFO: `/v3/projects/949ee2c59eea4062b104cae518e80066` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:25.037500 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc836744-af4c-471b-8821-55c8d6badd52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=949ee2c59eea4062b104cae518e80066)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:25.039432 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc836744-af4c-471b-8821-55c8d6badd52 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:25.222579 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39bbaf-64f6-489a-8eab-a7d0c1fd6f60 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:25.223450 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39bbaf-64f6-489a-8eab-a7d0c1fd6f60 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:25.223909 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39bbaf-64f6-489a-8eab-a7d0c1fd6f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:25.225616 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-fc836744-af4c-471b-8821-55c8d6badd52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '949ee2c59eea4062b104cae518e80066', 'request_id': 'req-fc836744-af4c-471b-8821-55c8d6badd52'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:25.242846 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-fc836744-af4c-471b-8821-55c8d6badd52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '949ee2c59eea4062b104cae518e80066', 'request_id': 'req-fc836744-af4c-471b-8821-55c8d6badd52'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:25.276908 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-2a39bbaf-64f6-489a-8eab-a7d0c1fd6f60 None None] MFA Rules not processed for user `b6a516cb3ec54d2189fea67143983b49`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:28:25.278371 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-2a39bbaf-64f6-489a-8eab-a7d0c1fd6f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:25.311660 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-fc836744-af4c-471b-8821-55c8d6badd52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '949ee2c59eea4062b104cae518e80066', 'request_id': 'req-fc836744-af4c-471b-8821-55c8d6badd52'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:25.329878 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-fc836744-af4c-471b-8821-55c8d6badd52 admin admin] The token cache is being invalidate because project 949ee2c59eea4062b104cae518e80066 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:28:25.330467 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-fc836744-af4c-471b-8821-55c8d6badd52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:25.331581 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-fc836744-af4c-471b-8821-55c8d6badd52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:25.346408 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 943/1902] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:28:25 2022] DELETE /identity/v3/projects/949ee2c59eea4062b104cae518e80066 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:28:25.357254 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10d62d-f4cc-433b-9af1-0f090f452e10 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:25.357848 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10d62d-f4cc-433b-9af1-0f090f452e10 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:25.358323 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10d62d-f4cc-433b-9af1-0f090f452e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:25.403557 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 960/1903] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:28:25 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:28:25.408587 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-9e10d62d-f4cc-433b-9af1-0f090f452e10 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:28:25.409820 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-9e10d62d-f4cc-433b-9af1-0f090f452e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:25.509225 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 944/1904] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:28:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:28:25.518269 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de598ba5-0631-4ce7-902a-97ead93e2f49 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:25.519205 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de598ba5-0631-4ce7-902a-97ead93e2f49 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:25.519496 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de598ba5-0631-4ce7-902a-97ead93e2f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:25.541844 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-de598ba5-0631-4ce7-902a-97ead93e2f49 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:28:25.543053 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-de598ba5-0631-4ce7-902a-97ead93e2f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:25.551135 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 961/1905] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:28:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:28:25.555348 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e10d62d-f4cc-433b-9af1-0f090f452e10 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:25.566259 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e10d62d-f4cc-433b-9af1-0f090f452e10 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:25.572046 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d25863-9938-4a40-b705-f91ff415e0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:25.572734 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d25863-9938-4a40-b705-f91ff415e0a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:25.573021 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d25863-9938-4a40-b705-f91ff415e0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:25.574516 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d25863-9938-4a40-b705-f91ff415e0a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:25.574516 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d25863-9938-4a40-b705-f91ff415e0a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:28:25.574516 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d25863-9938-4a40-b705-f91ff415e0a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:25.576248 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d25863-9938-4a40-b705-f91ff415e0a8 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:25.590760 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 945/1906] 10.222.0.24 () {58 vars in 1152 bytes} [Thu Apr 7 06:28:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:28:25.595964 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de598ba5-0631-4ce7-902a-97ead93e2f49 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:25.606105 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de598ba5-0631-4ce7-902a-97ead93e2f49 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:25.611773 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb13fa26-c3a6-4011-a966-2dde9e4ccc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:25.612465 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb13fa26-c3a6-4011-a966-2dde9e4ccc98 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:25.612791 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb13fa26-c3a6-4011-a966-2dde9e4ccc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:25.613018 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb13fa26-c3a6-4011-a966-2dde9e4ccc98 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:25.613985 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb13fa26-c3a6-4011-a966-2dde9e4ccc98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:25.616077 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb13fa26-c3a6-4011-a966-2dde9e4ccc98 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:25.648390 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d25863-9938-4a40-b705-f91ff415e0a8 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:25.650915 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-76d25863-9938-4a40-b705-f91ff415e0a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:25.723866 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d25863-9938-4a40-b705-f91ff415e0a8 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:25.728973 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329040ef-e4f7-4970-955b-c9691a80dcb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:25.730148 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 962/1907] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:28:25 2022] POST /identity/v3/projects => generated 367 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:28:25.736957 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb13fa26-c3a6-4011-a966-2dde9e4ccc98 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:25.737306 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329040ef-e4f7-4970-955b-c9691a80dcb0 service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:25.737969 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329040ef-e4f7-4970-955b-c9691a80dcb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:25.738742 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329040ef-e4f7-4970-955b-c9691a80dcb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:25.742381 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-329040ef-e4f7-4970-955b-c9691a80dcb0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:25.869866 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb13fa26-c3a6-4011-a966-2dde9e4ccc98 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:25.871176 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329040ef-e4f7-4970-955b-c9691a80dcb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:25.873008 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329040ef-e4f7-4970-955b-c9691a80dcb0 service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:25.876373 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367b8c51-b63a-43a3-a7c3-ed5f47528ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:25.877309 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b8c51-b63a-43a3-a7c3-ed5f47528ac5 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:25.877666 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b8c51-b63a-43a3-a7c3-ed5f47528ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:25.879394 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b8c51-b63a-43a3-a7c3-ed5f47528ac5 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:25.880433 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367b8c51-b63a-43a3-a7c3-ed5f47528ac5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:25.883029 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367b8c51-b63a-43a3-a7c3-ed5f47528ac5 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:25.890686 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 946/1908] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:28:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:28:25.987638 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 963/1909] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:28:25 2022] POST /identity/v3/users => generated 284 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:28:25.993035 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329040ef-e4f7-4970-955b-c9691a80dcb0 service cinder] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:26.008546 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329040ef-e4f7-4970-955b-c9691a80dcb0 service cinder] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:26.014509 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74a4f7-8881-49c5-bfbb-4ff84f326437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:26.015776 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74a4f7-8881-49c5-bfbb-4ff84f326437 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:26.016813 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74a4f7-8881-49c5-bfbb-4ff84f326437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:26.016813 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74a4f7-8881-49c5-bfbb-4ff84f326437 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:26.017554 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c74a4f7-8881-49c5-bfbb-4ff84f326437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:26.020330 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c74a4f7-8881-49c5-bfbb-4ff84f326437 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:26.035450 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 947/1910] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:28:26.036731 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367b8c51-b63a-43a3-a7c3-ed5f47528ac5 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:26.051078 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367b8c51-b63a-43a3-a7c3-ed5f47528ac5 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:26.057665 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ea736-707c-4d76-87e5-c0440372e1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:26.058521 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ea736-707c-4d76-87e5-c0440372e1e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:26.058851 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ea736-707c-4d76-87e5-c0440372e1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:26.059129 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ea736-707c-4d76-87e5-c0440372e1e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:26.060091 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38ea736-707c-4d76-87e5-c0440372e1e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:26.061762 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38ea736-707c-4d76-87e5-c0440372e1e8 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:26.073529 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 964/1911] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:28:26.077522 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74a4f7-8881-49c5-bfbb-4ff84f326437 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:26.089013 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74a4f7-8881-49c5-bfbb-4ff84f326437 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:26.094490 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b590bce0-99b8-46c8-b7ba-10429be63db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:26.095633 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b590bce0-99b8-46c8-b7ba-10429be63db2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:26.095961 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b590bce0-99b8-46c8-b7ba-10429be63db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:26.096238 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b590bce0-99b8-46c8-b7ba-10429be63db2 admin admin] PATH_INFO: `/v3/projects/8a92d3afbcc04f4ea373ef097d274f99/users/4ab986cd7e8e4ac78cc00b3c56ff3021/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:26.118910 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b590bce0-99b8-46c8-b7ba-10429be63db2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a92d3afbcc04f4ea373ef097d274f99, user_id=4ab986cd7e8e4ac78cc00b3c56ff3021, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:26.132683 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b590bce0-99b8-46c8-b7ba-10429be63db2 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:26.221776 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 948/1912] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:28:26 2022] PUT /identity/v3/projects/8a92d3afbcc04f4ea373ef097d274f99/users/4ab986cd7e8e4ac78cc00b3c56ff3021/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:28:26.232674 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a920e6-98f2-43e1-b9ad-ecfb982bb97e None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:26.233209 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a920e6-98f2-43e1-b9ad-ecfb982bb97e None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:26.233209 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a920e6-98f2-43e1-b9ad-ecfb982bb97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:26.260566 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-a0a920e6-98f2-43e1-b9ad-ecfb982bb97e None None] MFA Rules not processed for user `4ab986cd7e8e4ac78cc00b3c56ff3021`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:28:26.261811 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a0a920e6-98f2-43e1-b9ad-ecfb982bb97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:26.333086 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 965/1913] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:28:26 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:28:26.345935 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b590bce0-99b8-46c8-b7ba-10429be63db2 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:26.347724 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b590bce0-99b8-46c8-b7ba-10429be63db2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:26.425679 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b590bce0-99b8-46c8-b7ba-10429be63db2 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:26.429609 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4cc7cf-1811-4bf7-8485-c49b35d7bf5e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca88debdfcc4a9d918e3b0138a9add1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:26.432381 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4cc7cf-1811-4bf7-8485-c49b35d7bf5e service glance] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:26.432809 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4cc7cf-1811-4bf7-8485-c49b35d7bf5e service glance] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:26.433097 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4cc7cf-1811-4bf7-8485-c49b35d7bf5e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:26.451005 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4cc7cf-1811-4bf7-8485-c49b35d7bf5e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:26.452652 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4cc7cf-1811-4bf7-8485-c49b35d7bf5e service glance] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:26.463777 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 949/1914] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:28:26 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:28:29.967975 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a920e6-98f2-43e1-b9ad-ecfb982bb97e None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:29.970755 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a0a920e6-98f2-43e1-b9ad-ecfb982bb97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:30.035470 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a920e6-98f2-43e1-b9ad-ecfb982bb97e None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:30.042171 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4cc7cf-1811-4bf7-8485-c49b35d7bf5e service glance] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:30.046679 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef181bb-7012-4ffc-9578-78b86b9d2042 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:30.047376 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef181bb-7012-4ffc-9578-78b86b9d2042 service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:30.047663 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef181bb-7012-4ffc-9578-78b86b9d2042 service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:30.048014 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef181bb-7012-4ffc-9578-78b86b9d2042 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:30.052165 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4cc7cf-1811-4bf7-8485-c49b35d7bf5e service glance] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:30.056599 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524148e3-8bf6-4441-ad87-40abb10ea9f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:30.057248 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524148e3-8bf6-4441-ad87-40abb10ea9f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:30.057534 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524148e3-8bf6-4441-ad87-40abb10ea9f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:30.057812 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524148e3-8bf6-4441-ad87-40abb10ea9f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:30.059664 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-524148e3-8bf6-4441-ad87-40abb10ea9f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:30.117638 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef181bb-7012-4ffc-9578-78b86b9d2042 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:30.119165 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef181bb-7012-4ffc-9578-78b86b9d2042 service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:30.126076 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524148e3-8bf6-4441-ad87-40abb10ea9f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:30.127570 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524148e3-8bf6-4441-ad87-40abb10ea9f8 service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:30.130120 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 966/1915] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:28:29 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:28:30.137846 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 950/1916] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:28:30 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 07 06:28:31.045646 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef181bb-7012-4ffc-9578-78b86b9d2042 service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:31.047850 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-6ef181bb-7012-4ffc-9578-78b86b9d2042 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:31.115452 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef181bb-7012-4ffc-9578-78b86b9d2042 service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:31.120243 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4ff98d-0054-496f-8890-3d774c8598c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:31.128593 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ff98d-0054-496f-8890-3d774c8598c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:31.128593 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ff98d-0054-496f-8890-3d774c8598c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:31.128593 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ff98d-0054-496f-8890-3d774c8598c0 admin admin] PATH_INFO: `/v3/users/89f65b64685744a0a2e749c74c568ba4` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:31.128593 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4ff98d-0054-496f-8890-3d774c8598c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89f65b64685744a0a2e749c74c568ba4)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:31.128593 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4ff98d-0054-496f-8890-3d774c8598c0 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:31.437402 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-1f4ff98d-0054-496f-8890-3d774c8598c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89f65b64685744a0a2e749c74c568ba4'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:31.453769 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-1f4ff98d-0054-496f-8890-3d774c8598c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89f65b64685744a0a2e749c74c568ba4'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:31.590728 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-1f4ff98d-0054-496f-8890-3d774c8598c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89f65b64685744a0a2e749c74c568ba4'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:31.591357 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-1f4ff98d-0054-496f-8890-3d774c8598c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89f65b64685744a0a2e749c74c568ba4'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:31.592004 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-1f4ff98d-0054-496f-8890-3d774c8598c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89f65b64685744a0a2e749c74c568ba4'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:31.605276 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 967/1917] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:28:31 2022] DELETE /identity/v3/users/89f65b64685744a0a2e749c74c568ba4 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:28:31.610000 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07987d43-e1e9-4729-9f4b-36d3316ac5ce None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:31.610515 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07987d43-e1e9-4729-9f4b-36d3316ac5ce None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:31.610605 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07987d43-e1e9-4729-9f4b-36d3316ac5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:31.627735 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-07987d43-e1e9-4729-9f4b-36d3316ac5ce None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:28:31.628982 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-07987d43-e1e9-4729-9f4b-36d3316ac5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:31.686370 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 951/1918] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:28:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:28:31.697028 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4ff98d-0054-496f-8890-3d774c8598c0 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:31.698528 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-1f4ff98d-0054-496f-8890-3d774c8598c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:31.764901 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4ff98d-0054-496f-8890-3d774c8598c0 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:31.769220 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b741e14a-86c7-43da-a8e3-457cb05ff97d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:31.769989 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741e14a-86c7-43da-a8e3-457cb05ff97d service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:31.770375 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741e14a-86c7-43da-a8e3-457cb05ff97d service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:31.770752 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741e14a-86c7-43da-a8e3-457cb05ff97d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:31.780720 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b741e14a-86c7-43da-a8e3-457cb05ff97d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:31.782175 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b741e14a-86c7-43da-a8e3-457cb05ff97d service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:31.791686 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 968/1919] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:28:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:28:32.295791 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07987d43-e1e9-4729-9f4b-36d3316ac5ce None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:32.297491 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-07987d43-e1e9-4729-9f4b-36d3316ac5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:32.315613 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07987d43-e1e9-4729-9f4b-36d3316ac5ce None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:32.320775 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0177a2ab-d1c4-4d5b-9996-76b4c64baa4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:32.322051 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177a2ab-d1c4-4d5b-9996-76b4c64baa4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:32.322345 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177a2ab-d1c4-4d5b-9996-76b4c64baa4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:32.322627 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177a2ab-d1c4-4d5b-9996-76b4c64baa4b admin admin] PATH_INFO: `/v3/projects/6d22b06312524358888fb7686cb6dc27` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:32.323852 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0177a2ab-d1c4-4d5b-9996-76b4c64baa4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d22b06312524358888fb7686cb6dc27)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:32.334585 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0177a2ab-d1c4-4d5b-9996-76b4c64baa4b admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:32.636463 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-0177a2ab-d1c4-4d5b-9996-76b4c64baa4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d22b06312524358888fb7686cb6dc27', 'request_id': 'req-0177a2ab-d1c4-4d5b-9996-76b4c64baa4b'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:32.642944 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-0177a2ab-d1c4-4d5b-9996-76b4c64baa4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d22b06312524358888fb7686cb6dc27', 'request_id': 'req-0177a2ab-d1c4-4d5b-9996-76b4c64baa4b'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:32.711158 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-0177a2ab-d1c4-4d5b-9996-76b4c64baa4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d22b06312524358888fb7686cb6dc27', 'request_id': 'req-0177a2ab-d1c4-4d5b-9996-76b4c64baa4b'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:32.723235 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-0177a2ab-d1c4-4d5b-9996-76b4c64baa4b admin admin] The token cache is being invalidate because project 6d22b06312524358888fb7686cb6dc27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:28:32.723523 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-0177a2ab-d1c4-4d5b-9996-76b4c64baa4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:32.724287 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-0177a2ab-d1c4-4d5b-9996-76b4c64baa4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:32.726070 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 952/1920] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:28:32 2022] DELETE /identity/v3/projects/6d22b06312524358888fb7686cb6dc27 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:28:32.730018 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b741e14a-86c7-43da-a8e3-457cb05ff97d service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:32.742647 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b741e14a-86c7-43da-a8e3-457cb05ff97d service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:32.803137 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418a8692-8080-4c7e-880b-a5a466c6dae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:32.804076 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a8692-8080-4c7e-880b-a5a466c6dae0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:32.804361 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a8692-8080-4c7e-880b-a5a466c6dae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:32.804635 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a8692-8080-4c7e-880b-a5a466c6dae0 admin admin] PATH_INFO: `/v3/users/07c1a0612a5941ccbdb18ed424fc44bd` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:32.805825 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418a8692-8080-4c7e-880b-a5a466c6dae0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07c1a0612a5941ccbdb18ed424fc44bd)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:32.810879 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418a8692-8080-4c7e-880b-a5a466c6dae0 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:33.043856 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-418a8692-8080-4c7e-880b-a5a466c6dae0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07c1a0612a5941ccbdb18ed424fc44bd'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:33.055341 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-418a8692-8080-4c7e-880b-a5a466c6dae0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07c1a0612a5941ccbdb18ed424fc44bd'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:33.139860 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-418a8692-8080-4c7e-880b-a5a466c6dae0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07c1a0612a5941ccbdb18ed424fc44bd'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:33.140555 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-418a8692-8080-4c7e-880b-a5a466c6dae0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07c1a0612a5941ccbdb18ed424fc44bd'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:33.141806 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-418a8692-8080-4c7e-880b-a5a466c6dae0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07c1a0612a5941ccbdb18ed424fc44bd'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:33.155226 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 969/1921] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:28:32 2022] DELETE /identity/v3/users/07c1a0612a5941ccbdb18ed424fc44bd => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:28:33.569725 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0177a2ab-d1c4-4d5b-9996-76b4c64baa4b admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:33.571163 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-0177a2ab-d1c4-4d5b-9996-76b4c64baa4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:33.598062 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0177a2ab-d1c4-4d5b-9996-76b4c64baa4b admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:33.653327 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75bbac3-e81e-4d96-9a24-10d0aa9c37af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:33.654197 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75bbac3-e81e-4d96-9a24-10d0aa9c37af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:33.654474 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75bbac3-e81e-4d96-9a24-10d0aa9c37af admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:33.654746 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75bbac3-e81e-4d96-9a24-10d0aa9c37af admin admin] PATH_INFO: `/v3/projects/26cbfb7aaade4581b5beea31e6907c0f` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:33.655957 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75bbac3-e81e-4d96-9a24-10d0aa9c37af admin admin] RBAC: Authorizing `identity:delete_project(project_id=26cbfb7aaade4581b5beea31e6907c0f)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:33.658376 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75bbac3-e81e-4d96-9a24-10d0aa9c37af admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:33.770243 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-c75bbac3-e81e-4d96-9a24-10d0aa9c37af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26cbfb7aaade4581b5beea31e6907c0f', 'request_id': 'req-c75bbac3-e81e-4d96-9a24-10d0aa9c37af'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:33.777403 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-c75bbac3-e81e-4d96-9a24-10d0aa9c37af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26cbfb7aaade4581b5beea31e6907c0f', 'request_id': 'req-c75bbac3-e81e-4d96-9a24-10d0aa9c37af'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:33.865289 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-c75bbac3-e81e-4d96-9a24-10d0aa9c37af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26cbfb7aaade4581b5beea31e6907c0f', 'request_id': 'req-c75bbac3-e81e-4d96-9a24-10d0aa9c37af'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:33.877530 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-c75bbac3-e81e-4d96-9a24-10d0aa9c37af admin admin] The token cache is being invalidate because project 26cbfb7aaade4581b5beea31e6907c0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:28:33.877855 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-c75bbac3-e81e-4d96-9a24-10d0aa9c37af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:33.878681 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-c75bbac3-e81e-4d96-9a24-10d0aa9c37af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:33.881622 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 953/1922] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:28:33 2022] DELETE /identity/v3/projects/26cbfb7aaade4581b5beea31e6907c0f => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:28:33.886587 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a928f9-dd9b-4a15-a886-e60b5f3796ff None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:33.887043 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a928f9-dd9b-4a15-a886-e60b5f3796ff None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:33.887160 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a928f9-dd9b-4a15-a886-e60b5f3796ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:33.905390 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-b1a928f9-dd9b-4a15-a886-e60b5f3796ff None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:28:33.906651 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b1a928f9-dd9b-4a15-a886-e60b5f3796ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:33.963869 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 970/1923] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:28:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:28:33.971670 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44616a50-a38f-4f11-bf8d-2982a91a1016 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:33.972011 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44616a50-a38f-4f11-bf8d-2982a91a1016 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:33.972294 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44616a50-a38f-4f11-bf8d-2982a91a1016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:33.990983 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-44616a50-a38f-4f11-bf8d-2982a91a1016 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:28:33.992238 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-44616a50-a38f-4f11-bf8d-2982a91a1016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:34.000777 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 954/1924] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:28:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:28:34.004917 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a928f9-dd9b-4a15-a886-e60b5f3796ff None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:34.014392 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a928f9-dd9b-4a15-a886-e60b5f3796ff None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:34.018928 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d758a514-4070-4eaa-b26d-1a55fb06a7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:34.019613 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758a514-4070-4eaa-b26d-1a55fb06a7a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:34.019924 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758a514-4070-4eaa-b26d-1a55fb06a7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:34.020201 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758a514-4070-4eaa-b26d-1a55fb06a7a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:34.020927 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d758a514-4070-4eaa-b26d-1a55fb06a7a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:28:34.021230 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d758a514-4070-4eaa-b26d-1a55fb06a7a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:34.022907 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d758a514-4070-4eaa-b26d-1a55fb06a7a3 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:34.034141 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 971/1925] 10.222.0.24 () {58 vars in 1152 bytes} [Thu Apr 7 06:28:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:28:34.038631 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44616a50-a38f-4f11-bf8d-2982a91a1016 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:34.048041 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44616a50-a38f-4f11-bf8d-2982a91a1016 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:34.052585 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944da5b-7cfb-4b2e-89e5-9e4b0c5fc221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:34.053356 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944da5b-7cfb-4b2e-89e5-9e4b0c5fc221 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:34.053663 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944da5b-7cfb-4b2e-89e5-9e4b0c5fc221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:34.053939 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944da5b-7cfb-4b2e-89e5-9e4b0c5fc221 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:34.054630 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1944da5b-7cfb-4b2e-89e5-9e4b0c5fc221 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:34.056561 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1944da5b-7cfb-4b2e-89e5-9e4b0c5fc221 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:34.141213 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 955/1926] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:28:34 2022] POST /identity/v3/projects => generated 365 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:28:34.145323 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d758a514-4070-4eaa-b26d-1a55fb06a7a3 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:34.155404 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d758a514-4070-4eaa-b26d-1a55fb06a7a3 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:34.210292 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c74a1e-14d7-4446-9911-2de2036a893d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:34.210968 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c74a1e-14d7-4446-9911-2de2036a893d admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:34.211251 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c74a1e-14d7-4446-9911-2de2036a893d admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:34.211523 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c74a1e-14d7-4446-9911-2de2036a893d admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:34.212331 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c74a1e-14d7-4446-9911-2de2036a893d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:34.214326 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c74a1e-14d7-4446-9911-2de2036a893d admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:34.356947 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 972/1927] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:28:34 2022] POST /identity/v3/users => generated 283 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:28:34.361234 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944da5b-7cfb-4b2e-89e5-9e4b0c5fc221 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:34.372225 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944da5b-7cfb-4b2e-89e5-9e4b0c5fc221 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:34.377806 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35117660-2dac-4389-92ff-db6a12ac0508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:34.378581 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35117660-2dac-4389-92ff-db6a12ac0508 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:34.378864 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35117660-2dac-4389-92ff-db6a12ac0508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:34.379172 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35117660-2dac-4389-92ff-db6a12ac0508 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:34.379967 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35117660-2dac-4389-92ff-db6a12ac0508 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:34.381772 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35117660-2dac-4389-92ff-db6a12ac0508 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:34.396856 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 956/1928] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:28:34 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:28:34.401016 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c74a1e-14d7-4446-9911-2de2036a893d admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:34.411161 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c74a1e-14d7-4446-9911-2de2036a893d admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:34.419037 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a576b20b-2048-4b81-bda1-f1b0fe8fbb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:34.424053 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576b20b-2048-4b81-bda1-f1b0fe8fbb46 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:34.424053 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576b20b-2048-4b81-bda1-f1b0fe8fbb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:34.424053 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576b20b-2048-4b81-bda1-f1b0fe8fbb46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:34.424053 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a576b20b-2048-4b81-bda1-f1b0fe8fbb46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:34.424053 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a576b20b-2048-4b81-bda1-f1b0fe8fbb46 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:34.434755 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 973/1929] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:28:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:28:34.440333 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35117660-2dac-4389-92ff-db6a12ac0508 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:34.450438 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35117660-2dac-4389-92ff-db6a12ac0508 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:34.456040 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1df99a-70de-4a35-9c14-1056c05c4430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:34.456950 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1df99a-70de-4a35-9c14-1056c05c4430 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:34.457237 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1df99a-70de-4a35-9c14-1056c05c4430 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:34.457520 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1df99a-70de-4a35-9c14-1056c05c4430 admin admin] PATH_INFO: `/v3/projects/b656ee030c914f19aec0b2313be2467c/users/e35f244ba80144e1b863765e7e1e65e4/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:34.472968 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1df99a-70de-4a35-9c14-1056c05c4430 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b656ee030c914f19aec0b2313be2467c, user_id=e35f244ba80144e1b863765e7e1e65e4, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:34.475909 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1df99a-70de-4a35-9c14-1056c05c4430 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:34.539992 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 957/1930] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:28:34 2022] PUT /identity/v3/projects/b656ee030c914f19aec0b2313be2467c/users/e35f244ba80144e1b863765e7e1e65e4/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:28:34.551098 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a821f-1578-423e-9ea2-13231af2e221 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:34.551610 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a821f-1578-423e-9ea2-13231af2e221 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:34.552091 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a821f-1578-423e-9ea2-13231af2e221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:34.579100 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-186a821f-1578-423e-9ea2-13231af2e221 None None] MFA Rules not processed for user `e35f244ba80144e1b863765e7e1e65e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:28:34.580357 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-186a821f-1578-423e-9ea2-13231af2e221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:34.643871 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 974/1931] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:28:34 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:28:34.648705 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1df99a-70de-4a35-9c14-1056c05c4430 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:34.708219 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1df99a-70de-4a35-9c14-1056c05c4430 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:34.713092 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9bf8c4-7044-478c-80a4-ac4919cfa4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:34.713670 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9bf8c4-7044-478c-80a4-ac4919cfa4c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:34.714017 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9bf8c4-7044-478c-80a4-ac4919cfa4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:34.714272 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9bf8c4-7044-478c-80a4-ac4919cfa4c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:34.714962 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9bf8c4-7044-478c-80a4-ac4919cfa4c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:34.716836 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9bf8c4-7044-478c-80a4-ac4919cfa4c5 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:34.837724 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 958/1932] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:28:34 2022] POST /identity/v3/projects => generated 365 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:28:34.841527 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186a821f-1578-423e-9ea2-13231af2e221 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:34.852533 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186a821f-1578-423e-9ea2-13231af2e221 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:34.907568 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff9890-75df-45ba-b8b8-debb46f435cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:34.908232 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff9890-75df-45ba-b8b8-debb46f435cc admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:34.908529 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff9890-75df-45ba-b8b8-debb46f435cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:34.908809 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff9890-75df-45ba-b8b8-debb46f435cc admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:34.909496 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dff9890-75df-45ba-b8b8-debb46f435cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:34.911511 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dff9890-75df-45ba-b8b8-debb46f435cc admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:35.042624 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 975/1933] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:28:34 2022] POST /identity/v3/users => generated 289 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:28:35.046663 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9bf8c4-7044-478c-80a4-ac4919cfa4c5 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:35.056830 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9bf8c4-7044-478c-80a4-ac4919cfa4c5 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:35.062031 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f36ae-f02d-4bef-8c4f-3a9f3a4a4b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:35.062758 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f36ae-f02d-4bef-8c4f-3a9f3a4a4b2c admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:35.063032 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f36ae-f02d-4bef-8c4f-3a9f3a4a4b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:35.063317 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f36ae-f02d-4bef-8c4f-3a9f3a4a4b2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:35.064102 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9f36ae-f02d-4bef-8c4f-3a9f3a4a4b2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:35.065751 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9f36ae-f02d-4bef-8c4f-3a9f3a4a4b2c admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:35.076698 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 959/1934] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:28:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:28:35.081689 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff9890-75df-45ba-b8b8-debb46f435cc admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:35.091705 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff9890-75df-45ba-b8b8-debb46f435cc admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:35.097911 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec360d-63f7-4301-bf25-06ce33cb9c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:35.098811 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec360d-63f7-4301-bf25-06ce33cb9c60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:35.099092 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec360d-63f7-4301-bf25-06ce33cb9c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:35.108275 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec360d-63f7-4301-bf25-06ce33cb9c60 admin admin] PATH_INFO: `/v3/projects/f3becd3ce62f4062b8b058379db5d24d/users/872e39129f3f41e9b3f56d18bc7161d6/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:35.114834 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ec360d-63f7-4301-bf25-06ce33cb9c60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3becd3ce62f4062b8b058379db5d24d, user_id=872e39129f3f41e9b3f56d18bc7161d6, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:35.117732 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ec360d-63f7-4301-bf25-06ce33cb9c60 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:35.297212 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 976/1935] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:28:35 2022] PUT /identity/v3/projects/f3becd3ce62f4062b8b058379db5d24d/users/872e39129f3f41e9b3f56d18bc7161d6/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:28:35.300126 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f36ae-f02d-4bef-8c4f-3a9f3a4a4b2c admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:35.312754 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f36ae-f02d-4bef-8c4f-3a9f3a4a4b2c admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:35.371532 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b67036-92e3-4b78-8d50-32be11203167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:35.377400 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b67036-92e3-4b78-8d50-32be11203167 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:35.377400 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b67036-92e3-4b78-8d50-32be11203167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:35.377400 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b67036-92e3-4b78-8d50-32be11203167 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:35.377400 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b67036-92e3-4b78-8d50-32be11203167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:35.377400 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b67036-92e3-4b78-8d50-32be11203167 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:35.386593 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 960/1936] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:28:35 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:28:35.390584 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec360d-63f7-4301-bf25-06ce33cb9c60 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:35.400902 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec360d-63f7-4301-bf25-06ce33cb9c60 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:35.405646 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e82cb60-87b9-48d5-a979-323686253001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:35.407479 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82cb60-87b9-48d5-a979-323686253001 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:35.408046 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82cb60-87b9-48d5-a979-323686253001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:35.408562 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82cb60-87b9-48d5-a979-323686253001 admin admin] PATH_INFO: `/v3/projects/f3becd3ce62f4062b8b058379db5d24d/users/872e39129f3f41e9b3f56d18bc7161d6/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:35.411963 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e82cb60-87b9-48d5-a979-323686253001 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3becd3ce62f4062b8b058379db5d24d, user_id=872e39129f3f41e9b3f56d18bc7161d6, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:35.414891 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e82cb60-87b9-48d5-a979-323686253001 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:35.430728 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 977/1937] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:28:35 2022] PUT /identity/v3/projects/f3becd3ce62f4062b8b058379db5d24d/users/872e39129f3f41e9b3f56d18bc7161d6/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:28:35.448670 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294166e-e65c-422c-9fc2-9d3785ace956 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:35.448971 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294166e-e65c-422c-9fc2-9d3785ace956 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:35.449260 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294166e-e65c-422c-9fc2-9d3785ace956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:35.477504 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-4294166e-e65c-422c-9fc2-9d3785ace956 None None] MFA Rules not processed for user `872e39129f3f41e9b3f56d18bc7161d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:28:35.492676 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-4294166e-e65c-422c-9fc2-9d3785ace956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:35.551280 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 961/1938] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:28:35 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:28:35.562663 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e82cb60-87b9-48d5-a979-323686253001 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:35.566623 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-2e82cb60-87b9-48d5-a979-323686253001 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:35.637610 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e82cb60-87b9-48d5-a979-323686253001 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:35.642242 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841984ca-bb33-402a-b83d-0ab0051f9dfa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:35.642899 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841984ca-bb33-402a-b83d-0ab0051f9dfa service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:35.643187 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841984ca-bb33-402a-b83d-0ab0051f9dfa service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:35.643462 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841984ca-bb33-402a-b83d-0ab0051f9dfa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:35.654137 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841984ca-bb33-402a-b83d-0ab0051f9dfa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:35.655632 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841984ca-bb33-402a-b83d-0ab0051f9dfa service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:35.669993 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 978/1939] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:28:35 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:28:35.978389 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294166e-e65c-422c-9fc2-9d3785ace956 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:35.984099 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-4294166e-e65c-422c-9fc2-9d3785ace956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:36.000390 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294166e-e65c-422c-9fc2-9d3785ace956 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:36.004245 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f746d3aa-302c-4b4f-a252-69a780367312 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:36.005028 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746d3aa-302c-4b4f-a252-69a780367312 service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:36.005537 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746d3aa-302c-4b4f-a252-69a780367312 service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:36.005885 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746d3aa-302c-4b4f-a252-69a780367312 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:36.075969 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f746d3aa-302c-4b4f-a252-69a780367312 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:36.075969 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f746d3aa-302c-4b4f-a252-69a780367312 service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:36.086160 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 962/1940] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:28:35 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:28:40.096693 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841984ca-bb33-402a-b83d-0ab0051f9dfa service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:40.169719 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841984ca-bb33-402a-b83d-0ab0051f9dfa service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:40.174400 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d3434-51e0-4e52-abc2-d51103157764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:40.175365 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d3434-51e0-4e52-abc2-d51103157764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:40.175644 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d3434-51e0-4e52-abc2-d51103157764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:40.175941 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d3434-51e0-4e52-abc2-d51103157764 admin admin] PATH_INFO: `/v3/users/e35f244ba80144e1b863765e7e1e65e4` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:40.177112 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d3434-51e0-4e52-abc2-d51103157764 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e35f244ba80144e1b863765e7e1e65e4)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:40.179106 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d3434-51e0-4e52-abc2-d51103157764 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:40.363208 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-460d3434-51e0-4e52-abc2-d51103157764 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e35f244ba80144e1b863765e7e1e65e4'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:40.375166 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-460d3434-51e0-4e52-abc2-d51103157764 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e35f244ba80144e1b863765e7e1e65e4'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:40.459087 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-460d3434-51e0-4e52-abc2-d51103157764 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e35f244ba80144e1b863765e7e1e65e4'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:40.459734 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-460d3434-51e0-4e52-abc2-d51103157764 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e35f244ba80144e1b863765e7e1e65e4'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:40.460372 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-460d3434-51e0-4e52-abc2-d51103157764 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e35f244ba80144e1b863765e7e1e65e4'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:40.472877 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 979/1941] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:28:40 2022] DELETE /identity/v3/users/e35f244ba80144e1b863765e7e1e65e4 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:28:40.477522 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a7197-bd25-47ff-a311-81da2fafa592 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:40.477973 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a7197-bd25-47ff-a311-81da2fafa592 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:40.478076 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a7197-bd25-47ff-a311-81da2fafa592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:40.495109 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-5f5a7197-bd25-47ff-a311-81da2fafa592 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:28:40.496321 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-5f5a7197-bd25-47ff-a311-81da2fafa592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:40.554819 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 963/1942] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:28:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:28:40.564973 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d3434-51e0-4e52-abc2-d51103157764 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:40.566427 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-460d3434-51e0-4e52-abc2-d51103157764 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:40.621301 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d3434-51e0-4e52-abc2-d51103157764 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:40.625365 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6db873-4826-49e2-ac71-89447819b74c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:40.626022 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6db873-4826-49e2-ac71-89447819b74c service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:40.626311 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6db873-4826-49e2-ac71-89447819b74c service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:40.626641 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6db873-4826-49e2-ac71-89447819b74c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:40.635479 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6db873-4826-49e2-ac71-89447819b74c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:40.636942 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6db873-4826-49e2-ac71-89447819b74c service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:40.646787 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 980/1943] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:28:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:28:41.078611 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a7197-bd25-47ff-a311-81da2fafa592 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:41.081607 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-5f5a7197-bd25-47ff-a311-81da2fafa592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:41.091544 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a7197-bd25-47ff-a311-81da2fafa592 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:41.096881 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b211b0-1758-482a-850c-af3a691085a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:41.099768 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b211b0-1758-482a-850c-af3a691085a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:41.099768 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b211b0-1758-482a-850c-af3a691085a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:41.099768 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b211b0-1758-482a-850c-af3a691085a6 admin admin] PATH_INFO: `/v3/projects/b656ee030c914f19aec0b2313be2467c` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:41.099768 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b211b0-1758-482a-850c-af3a691085a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b656ee030c914f19aec0b2313be2467c)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:41.101497 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b211b0-1758-482a-850c-af3a691085a6 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:41.196734 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-14b211b0-1758-482a-850c-af3a691085a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b656ee030c914f19aec0b2313be2467c', 'request_id': 'req-14b211b0-1758-482a-850c-af3a691085a6'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:41.202395 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-14b211b0-1758-482a-850c-af3a691085a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b656ee030c914f19aec0b2313be2467c', 'request_id': 'req-14b211b0-1758-482a-850c-af3a691085a6'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:41.270759 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-14b211b0-1758-482a-850c-af3a691085a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b656ee030c914f19aec0b2313be2467c', 'request_id': 'req-14b211b0-1758-482a-850c-af3a691085a6'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:41.284409 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-14b211b0-1758-482a-850c-af3a691085a6 admin admin] The token cache is being invalidate because project b656ee030c914f19aec0b2313be2467c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:28:41.284687 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-14b211b0-1758-482a-850c-af3a691085a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:41.285355 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-14b211b0-1758-482a-850c-af3a691085a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:41.286988 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 964/1944] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:28:41 2022] DELETE /identity/v3/projects/b656ee030c914f19aec0b2313be2467c => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:28:41.291152 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6db873-4826-49e2-ac71-89447819b74c service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:41.301392 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6db873-4826-49e2-ac71-89447819b74c service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:41.354429 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff07b7-9c1d-405c-b2cb-f62ae939d9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:41.355297 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff07b7-9c1d-405c-b2cb-f62ae939d9a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:41.355615 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff07b7-9c1d-405c-b2cb-f62ae939d9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:41.355933 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff07b7-9c1d-405c-b2cb-f62ae939d9a9 admin admin] PATH_INFO: `/v3/users/872e39129f3f41e9b3f56d18bc7161d6` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:41.357119 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eff07b7-9c1d-405c-b2cb-f62ae939d9a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=872e39129f3f41e9b3f56d18bc7161d6)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:41.359710 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eff07b7-9c1d-405c-b2cb-f62ae939d9a9 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:41.505912 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-1eff07b7-9c1d-405c-b2cb-f62ae939d9a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '872e39129f3f41e9b3f56d18bc7161d6'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:41.517585 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-1eff07b7-9c1d-405c-b2cb-f62ae939d9a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '872e39129f3f41e9b3f56d18bc7161d6'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:41.596488 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-1eff07b7-9c1d-405c-b2cb-f62ae939d9a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '872e39129f3f41e9b3f56d18bc7161d6'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:41.597111 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-1eff07b7-9c1d-405c-b2cb-f62ae939d9a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '872e39129f3f41e9b3f56d18bc7161d6'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:41.597733 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-1eff07b7-9c1d-405c-b2cb-f62ae939d9a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '872e39129f3f41e9b3f56d18bc7161d6'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:41.610215 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 981/1945] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:28:41 2022] DELETE /identity/v3/users/872e39129f3f41e9b3f56d18bc7161d6 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:28:41.975130 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b211b0-1758-482a-850c-af3a691085a6 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:41.980809 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-14b211b0-1758-482a-850c-af3a691085a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:41.989580 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b211b0-1758-482a-850c-af3a691085a6 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:42.048943 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2578bc3f-d035-40a1-a673-623a3ccbe35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:42.049801 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578bc3f-d035-40a1-a673-623a3ccbe35f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:42.050081 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578bc3f-d035-40a1-a673-623a3ccbe35f admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:42.050351 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578bc3f-d035-40a1-a673-623a3ccbe35f admin admin] PATH_INFO: `/v3/projects/f3becd3ce62f4062b8b058379db5d24d` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:42.051512 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2578bc3f-d035-40a1-a673-623a3ccbe35f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3becd3ce62f4062b8b058379db5d24d)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:42.053455 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2578bc3f-d035-40a1-a673-623a3ccbe35f admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:42.190412 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-2578bc3f-d035-40a1-a673-623a3ccbe35f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3becd3ce62f4062b8b058379db5d24d', 'request_id': 'req-2578bc3f-d035-40a1-a673-623a3ccbe35f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:42.195944 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-2578bc3f-d035-40a1-a673-623a3ccbe35f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3becd3ce62f4062b8b058379db5d24d', 'request_id': 'req-2578bc3f-d035-40a1-a673-623a3ccbe35f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:42.287537 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-2578bc3f-d035-40a1-a673-623a3ccbe35f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3becd3ce62f4062b8b058379db5d24d', 'request_id': 'req-2578bc3f-d035-40a1-a673-623a3ccbe35f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:42.300005 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-2578bc3f-d035-40a1-a673-623a3ccbe35f admin admin] The token cache is being invalidate because project f3becd3ce62f4062b8b058379db5d24d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:28:42.300300 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-2578bc3f-d035-40a1-a673-623a3ccbe35f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:42.300947 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-2578bc3f-d035-40a1-a673-623a3ccbe35f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:42.302512 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 965/1946] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:28:41 2022] DELETE /identity/v3/projects/f3becd3ce62f4062b8b058379db5d24d => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:28:42.307414 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca23992-5a3f-4b9b-a29b-ea7a1f635d9a None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:42.307897 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca23992-5a3f-4b9b-a29b-ea7a1f635d9a None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:42.308028 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca23992-5a3f-4b9b-a29b-ea7a1f635d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:42.327825 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-fca23992-5a3f-4b9b-a29b-ea7a1f635d9a None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:28:42.329024 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-fca23992-5a3f-4b9b-a29b-ea7a1f635d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:42.387217 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 982/1947] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:28:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:28:42.395017 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca184a2a-6171-473c-b8f3-47aec7a3788d None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:42.395308 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca184a2a-6171-473c-b8f3-47aec7a3788d None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:42.395589 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca184a2a-6171-473c-b8f3-47aec7a3788d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:42.413689 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-ca184a2a-6171-473c-b8f3-47aec7a3788d None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:28:42.414885 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-ca184a2a-6171-473c-b8f3-47aec7a3788d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:42.423178 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 966/1948] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:28:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:28:42.427482 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca23992-5a3f-4b9b-a29b-ea7a1f635d9a None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:42.437717 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca23992-5a3f-4b9b-a29b-ea7a1f635d9a None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:42.445510 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de4d6e8-976c-4673-a539-31c4bbac8f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:42.446309 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de4d6e8-976c-4673-a539-31c4bbac8f9e admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:42.446601 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de4d6e8-976c-4673-a539-31c4bbac8f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:42.446882 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de4d6e8-976c-4673-a539-31c4bbac8f9e admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:42.447658 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de4d6e8-976c-4673-a539-31c4bbac8f9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:28:42.448025 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de4d6e8-976c-4673-a539-31c4bbac8f9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:42.449638 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de4d6e8-976c-4673-a539-31c4bbac8f9e admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:42.463173 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 983/1949] 10.222.0.24 () {58 vars in 1152 bytes} [Thu Apr 7 06:28:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:28:42.467561 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca184a2a-6171-473c-b8f3-47aec7a3788d None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:42.478002 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca184a2a-6171-473c-b8f3-47aec7a3788d None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:42.482690 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d873c4b-7da4-48d0-a370-967728410f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:42.483344 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d873c4b-7da4-48d0-a370-967728410f3a admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:42.483629 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d873c4b-7da4-48d0-a370-967728410f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:42.484463 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d873c4b-7da4-48d0-a370-967728410f3a admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:42.485152 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d873c4b-7da4-48d0-a370-967728410f3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:42.487064 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d873c4b-7da4-48d0-a370-967728410f3a admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:42.575097 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 967/1950] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:28:42 2022] POST /identity/v3/projects => generated 387 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:28:42.579184 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de4d6e8-976c-4673-a539-31c4bbac8f9e admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:42.589115 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de4d6e8-976c-4673-a539-31c4bbac8f9e admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:42.643305 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6836ebf5-6a7a-4ae5-87fa-342ee2e3bf7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:42.644757 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836ebf5-6a7a-4ae5-87fa-342ee2e3bf7d admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:42.644757 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836ebf5-6a7a-4ae5-87fa-342ee2e3bf7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:42.644757 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836ebf5-6a7a-4ae5-87fa-342ee2e3bf7d admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:42.645218 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6836ebf5-6a7a-4ae5-87fa-342ee2e3bf7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:42.647137 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6836ebf5-6a7a-4ae5-87fa-342ee2e3bf7d admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:42.737093 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 984/1951] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:28:42 2022] POST /identity/v3/users => generated 294 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:28:42.739220 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d873c4b-7da4-48d0-a370-967728410f3a admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:42.750251 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d873c4b-7da4-48d0-a370-967728410f3a admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:42.756109 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd3b7a4-1ee7-4869-a187-e45bfc2d118a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:42.756787 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd3b7a4-1ee7-4869-a187-e45bfc2d118a admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:42.757075 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd3b7a4-1ee7-4869-a187-e45bfc2d118a admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:42.757346 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd3b7a4-1ee7-4869-a187-e45bfc2d118a admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:42.758084 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd3b7a4-1ee7-4869-a187-e45bfc2d118a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:42.759833 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd3b7a4-1ee7-4869-a187-e45bfc2d118a admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:42.774395 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 968/1952] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:28:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:28:42.779532 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6836ebf5-6a7a-4ae5-87fa-342ee2e3bf7d admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:42.791844 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6836ebf5-6a7a-4ae5-87fa-342ee2e3bf7d admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:42.799645 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7405b84-016c-4f5b-a11f-55b590864d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:42.799645 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7405b84-016c-4f5b-a11f-55b590864d75 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:42.800000 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7405b84-016c-4f5b-a11f-55b590864d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:42.800278 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7405b84-016c-4f5b-a11f-55b590864d75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:42.801170 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7405b84-016c-4f5b-a11f-55b590864d75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:42.802852 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7405b84-016c-4f5b-a11f-55b590864d75 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:42.814130 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 985/1953] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:28:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:28:42.819901 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd3b7a4-1ee7-4869-a187-e45bfc2d118a admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:42.830691 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd3b7a4-1ee7-4869-a187-e45bfc2d118a admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:42.835257 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969e4f69-d4cd-4cde-b885-62f428034594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:42.836178 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e4f69-d4cd-4cde-b885-62f428034594 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:42.836492 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e4f69-d4cd-4cde-b885-62f428034594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:42.836768 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e4f69-d4cd-4cde-b885-62f428034594 admin admin] PATH_INFO: `/v3/projects/e8976582b34d4fb4afb3477fb47d83d0/users/8c1abcb07bb249fa9f577fa98a7b196a/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:42.853032 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969e4f69-d4cd-4cde-b885-62f428034594 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8976582b34d4fb4afb3477fb47d83d0, user_id=8c1abcb07bb249fa9f577fa98a7b196a, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:42.856051 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969e4f69-d4cd-4cde-b885-62f428034594 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:42.962752 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 969/1954] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:28:42 2022] PUT /identity/v3/projects/e8976582b34d4fb4afb3477fb47d83d0/users/8c1abcb07bb249fa9f577fa98a7b196a/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:28:42.978091 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31f2b2-7e91-478d-b0e8-8add3d7efab4 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:42.978091 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31f2b2-7e91-478d-b0e8-8add3d7efab4 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:42.978091 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31f2b2-7e91-478d-b0e8-8add3d7efab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:43.006364 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-9f31f2b2-7e91-478d-b0e8-8add3d7efab4 None None] MFA Rules not processed for user `8c1abcb07bb249fa9f577fa98a7b196a`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:28:43.007655 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-9f31f2b2-7e91-478d-b0e8-8add3d7efab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:43.089792 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 986/1955] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:28:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:28:43.090852 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969e4f69-d4cd-4cde-b885-62f428034594 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:43.153084 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969e4f69-d4cd-4cde-b885-62f428034594 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:43.157771 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471dcc82-5606-4cf2-aeb5-863726c11bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:43.158432 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471dcc82-5606-4cf2-aeb5-863726c11bda admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:43.158717 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471dcc82-5606-4cf2-aeb5-863726c11bda admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:43.158995 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471dcc82-5606-4cf2-aeb5-863726c11bda admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:43.159687 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471dcc82-5606-4cf2-aeb5-863726c11bda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:43.161644 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471dcc82-5606-4cf2-aeb5-863726c11bda admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:43.272966 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 970/1956] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:28:43 2022] POST /identity/v3/projects => generated 385 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:28:43.276951 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f31f2b2-7e91-478d-b0e8-8add3d7efab4 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:43.288044 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f31f2b2-7e91-478d-b0e8-8add3d7efab4 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:43.368377 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3cd950-d288-4027-9ca8-f98ed2eb9ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:43.369212 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3cd950-d288-4027-9ca8-f98ed2eb9ccd admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:43.369431 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3cd950-d288-4027-9ca8-f98ed2eb9ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:43.369872 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3cd950-d288-4027-9ca8-f98ed2eb9ccd admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:43.370677 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3cd950-d288-4027-9ca8-f98ed2eb9ccd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:43.373480 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3cd950-d288-4027-9ca8-f98ed2eb9ccd admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:43.504016 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 987/1957] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:28:43 2022] POST /identity/v3/users => generated 299 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:28:43.512714 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471dcc82-5606-4cf2-aeb5-863726c11bda admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:43.523253 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471dcc82-5606-4cf2-aeb5-863726c11bda admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:43.535003 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaab68d1-6d59-455a-9978-0007885f1f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:43.535003 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaab68d1-6d59-455a-9978-0007885f1f1f admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:43.535003 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaab68d1-6d59-455a-9978-0007885f1f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:43.535003 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaab68d1-6d59-455a-9978-0007885f1f1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:43.546304 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaab68d1-6d59-455a-9978-0007885f1f1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:43.546304 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaab68d1-6d59-455a-9978-0007885f1f1f admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:43.551499 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 971/1958] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:28:43.556592 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3cd950-d288-4027-9ca8-f98ed2eb9ccd admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:43.567003 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3cd950-d288-4027-9ca8-f98ed2eb9ccd admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:43.571879 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69bc441-e176-4f50-8ca3-142f3f1bd362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:43.572772 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69bc441-e176-4f50-8ca3-142f3f1bd362 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:43.573092 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69bc441-e176-4f50-8ca3-142f3f1bd362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:43.573368 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69bc441-e176-4f50-8ca3-142f3f1bd362 admin admin] PATH_INFO: `/v3/projects/126099363d5f4d9cb4803d81a2ea5579/users/3960fdd21e814ddf984ca9d8251c4fc2/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:43.589899 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69bc441-e176-4f50-8ca3-142f3f1bd362 admin admin] RBAC: Authorizing `identity:create_grant(project_id=126099363d5f4d9cb4803d81a2ea5579, user_id=3960fdd21e814ddf984ca9d8251c4fc2, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:43.592653 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69bc441-e176-4f50-8ca3-142f3f1bd362 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:43.683337 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 988/1959] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:28:43 2022] PUT /identity/v3/projects/126099363d5f4d9cb4803d81a2ea5579/users/3960fdd21e814ddf984ca9d8251c4fc2/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:28:43.687216 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaab68d1-6d59-455a-9978-0007885f1f1f admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:43.698636 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaab68d1-6d59-455a-9978-0007885f1f1f admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:43.754713 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646abf60-0442-4602-9da0-ea394bcbefc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:43.755383 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646abf60-0442-4602-9da0-ea394bcbefc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:43.755667 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646abf60-0442-4602-9da0-ea394bcbefc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:43.755975 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646abf60-0442-4602-9da0-ea394bcbefc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:43.756706 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646abf60-0442-4602-9da0-ea394bcbefc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:43.758320 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646abf60-0442-4602-9da0-ea394bcbefc9 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:43.769216 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 972/1960] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:28:43.773555 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69bc441-e176-4f50-8ca3-142f3f1bd362 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:43.784850 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69bc441-e176-4f50-8ca3-142f3f1bd362 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:43.789515 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e099507-164c-4c70-8211-68852cfa481a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:43.790465 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e099507-164c-4c70-8211-68852cfa481a admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:43.791092 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e099507-164c-4c70-8211-68852cfa481a admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:43.791092 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e099507-164c-4c70-8211-68852cfa481a admin admin] PATH_INFO: `/v3/projects/126099363d5f4d9cb4803d81a2ea5579/users/3960fdd21e814ddf984ca9d8251c4fc2/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:43.793109 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e099507-164c-4c70-8211-68852cfa481a admin admin] RBAC: Authorizing `identity:create_grant(project_id=126099363d5f4d9cb4803d81a2ea5579, user_id=3960fdd21e814ddf984ca9d8251c4fc2, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:43.795947 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e099507-164c-4c70-8211-68852cfa481a admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:43.809544 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 989/1961] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:28:43 2022] PUT /identity/v3/projects/126099363d5f4d9cb4803d81a2ea5579/users/3960fdd21e814ddf984ca9d8251c4fc2/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:28:43.820116 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b0586-1d75-483b-8705-3f806cd51905 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:43.820411 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b0586-1d75-483b-8705-3f806cd51905 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:43.820697 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b0586-1d75-483b-8705-3f806cd51905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:43.849876 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-991b0586-1d75-483b-8705-3f806cd51905 None None] MFA Rules not processed for user `3960fdd21e814ddf984ca9d8251c4fc2`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:28:43.851090 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-991b0586-1d75-483b-8705-3f806cd51905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:43.919277 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 973/1962] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:28:43 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:28:43.930672 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e099507-164c-4c70-8211-68852cfa481a admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:43.932544 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-5e099507-164c-4c70-8211-68852cfa481a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:43.990015 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e099507-164c-4c70-8211-68852cfa481a admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:43.997292 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee2effe-954a-46db-b997-84b26a4df685 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:44.006681 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2effe-954a-46db-b997-84b26a4df685 service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:44.006681 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2effe-954a-46db-b997-84b26a4df685 service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:44.006681 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2effe-954a-46db-b997-84b26a4df685 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:44.008565 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee2effe-954a-46db-b997-84b26a4df685 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:44.010059 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee2effe-954a-46db-b997-84b26a4df685 service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:44.020059 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 990/1963] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:28:43 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:28:44.087157 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b0586-1d75-483b-8705-3f806cd51905 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:44.157202 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b0586-1d75-483b-8705-3f806cd51905 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:44.161998 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7954f2d1-52f6-4414-8519-5843aef30ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:44.162924 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954f2d1-52f6-4414-8519-5843aef30ae8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:44.163210 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954f2d1-52f6-4414-8519-5843aef30ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:44.163484 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954f2d1-52f6-4414-8519-5843aef30ae8 admin admin] PATH_INFO: `/v3/users/8c1abcb07bb249fa9f577fa98a7b196a` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:44.164735 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7954f2d1-52f6-4414-8519-5843aef30ae8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c1abcb07bb249fa9f577fa98a7b196a)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:44.166657 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7954f2d1-52f6-4414-8519-5843aef30ae8 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:44.502108 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7954f2d1-52f6-4414-8519-5843aef30ae8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c1abcb07bb249fa9f577fa98a7b196a'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:44.502663 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7954f2d1-52f6-4414-8519-5843aef30ae8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c1abcb07bb249fa9f577fa98a7b196a'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:44.573724 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7954f2d1-52f6-4414-8519-5843aef30ae8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c1abcb07bb249fa9f577fa98a7b196a'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:44.575453 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7954f2d1-52f6-4414-8519-5843aef30ae8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c1abcb07bb249fa9f577fa98a7b196a'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:44.587758 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7954f2d1-52f6-4414-8519-5843aef30ae8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c1abcb07bb249fa9f577fa98a7b196a'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:44.599522 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 974/1964] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:28:44 2022] DELETE /identity/v3/users/8c1abcb07bb249fa9f577fa98a7b196a => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:28:44.604088 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83545d-c72f-46dd-9dbb-b5b90af1478b None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:44.604585 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83545d-c72f-46dd-9dbb-b5b90af1478b None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:44.604672 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83545d-c72f-46dd-9dbb-b5b90af1478b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:44.626692 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-6e83545d-c72f-46dd-9dbb-b5b90af1478b None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:28:44.631170 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-6e83545d-c72f-46dd-9dbb-b5b90af1478b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:44.696624 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 991/1965] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:28:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:28:44.706312 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7954f2d1-52f6-4414-8519-5843aef30ae8 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:44.707705 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-7954f2d1-52f6-4414-8519-5843aef30ae8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:44.765576 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7954f2d1-52f6-4414-8519-5843aef30ae8 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:44.769900 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b60ebb0-e537-45c3-9a92-16f2d1f3ce9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:44.770564 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60ebb0-e537-45c3-9a92-16f2d1f3ce9c service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:44.774759 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60ebb0-e537-45c3-9a92-16f2d1f3ce9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:44.774759 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60ebb0-e537-45c3-9a92-16f2d1f3ce9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:44.781602 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b60ebb0-e537-45c3-9a92-16f2d1f3ce9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:44.783073 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b60ebb0-e537-45c3-9a92-16f2d1f3ce9c service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:44.793063 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 975/1966] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:28:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:28:45.249963 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e83545d-c72f-46dd-9dbb-b5b90af1478b None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:45.259835 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-6e83545d-c72f-46dd-9dbb-b5b90af1478b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:45.269930 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e83545d-c72f-46dd-9dbb-b5b90af1478b None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:45.275767 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f7c96a-e43e-40aa-b403-508bd8ba55e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:45.276659 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7c96a-e43e-40aa-b403-508bd8ba55e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:45.276914 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7c96a-e43e-40aa-b403-508bd8ba55e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:45.277192 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7c96a-e43e-40aa-b403-508bd8ba55e6 admin admin] PATH_INFO: `/v3/projects/e8976582b34d4fb4afb3477fb47d83d0` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:45.278389 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f7c96a-e43e-40aa-b403-508bd8ba55e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8976582b34d4fb4afb3477fb47d83d0)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:45.280517 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f7c96a-e43e-40aa-b403-508bd8ba55e6 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:45.402091 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a5f7c96a-e43e-40aa-b403-508bd8ba55e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8976582b34d4fb4afb3477fb47d83d0', 'request_id': 'req-a5f7c96a-e43e-40aa-b403-508bd8ba55e6'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:45.408930 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a5f7c96a-e43e-40aa-b403-508bd8ba55e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8976582b34d4fb4afb3477fb47d83d0', 'request_id': 'req-a5f7c96a-e43e-40aa-b403-508bd8ba55e6'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:45.517454 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a5f7c96a-e43e-40aa-b403-508bd8ba55e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8976582b34d4fb4afb3477fb47d83d0', 'request_id': 'req-a5f7c96a-e43e-40aa-b403-508bd8ba55e6'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:45.532935 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a5f7c96a-e43e-40aa-b403-508bd8ba55e6 admin admin] The token cache is being invalidate because project e8976582b34d4fb4afb3477fb47d83d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:28:45.533225 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a5f7c96a-e43e-40aa-b403-508bd8ba55e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:45.534590 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a5f7c96a-e43e-40aa-b403-508bd8ba55e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:45.536298 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 992/1967] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:28:45 2022] DELETE /identity/v3/projects/e8976582b34d4fb4afb3477fb47d83d0 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:28:45.550626 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b60ebb0-e537-45c3-9a92-16f2d1f3ce9c service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:45.560683 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b60ebb0-e537-45c3-9a92-16f2d1f3ce9c service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:45.627369 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f959f7f-0898-4e45-841c-b75b3021343d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:45.628283 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f959f7f-0898-4e45-841c-b75b3021343d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:45.628581 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f959f7f-0898-4e45-841c-b75b3021343d admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:45.628859 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f959f7f-0898-4e45-841c-b75b3021343d admin admin] PATH_INFO: `/v3/users/3960fdd21e814ddf984ca9d8251c4fc2` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:45.630267 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f959f7f-0898-4e45-841c-b75b3021343d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3960fdd21e814ddf984ca9d8251c4fc2)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:45.632650 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f959f7f-0898-4e45-841c-b75b3021343d admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:45.849582 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-0f959f7f-0898-4e45-841c-b75b3021343d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3960fdd21e814ddf984ca9d8251c4fc2'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:45.850255 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-0f959f7f-0898-4e45-841c-b75b3021343d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3960fdd21e814ddf984ca9d8251c4fc2'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:45.922010 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-0f959f7f-0898-4e45-841c-b75b3021343d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3960fdd21e814ddf984ca9d8251c4fc2'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:45.922626 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-0f959f7f-0898-4e45-841c-b75b3021343d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3960fdd21e814ddf984ca9d8251c4fc2'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:45.938466 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-0f959f7f-0898-4e45-841c-b75b3021343d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3960fdd21e814ddf984ca9d8251c4fc2'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:45.949098 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 976/1968] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:28:45 2022] DELETE /identity/v3/users/3960fdd21e814ddf984ca9d8251c4fc2 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:28:46.409788 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f7c96a-e43e-40aa-b403-508bd8ba55e6 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:46.411216 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a5f7c96a-e43e-40aa-b403-508bd8ba55e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:46.424973 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f7c96a-e43e-40aa-b403-508bd8ba55e6 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:46.479720 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adee9b5-3fd6-45aa-b18d-9835fe77b7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:46.480741 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adee9b5-3fd6-45aa-b18d-9835fe77b7c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:46.481030 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adee9b5-3fd6-45aa-b18d-9835fe77b7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:46.481300 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adee9b5-3fd6-45aa-b18d-9835fe77b7c6 admin admin] PATH_INFO: `/v3/projects/126099363d5f4d9cb4803d81a2ea5579` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:46.482476 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adee9b5-3fd6-45aa-b18d-9835fe77b7c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=126099363d5f4d9cb4803d81a2ea5579)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:46.485079 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adee9b5-3fd6-45aa-b18d-9835fe77b7c6 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:46.590666 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-1adee9b5-3fd6-45aa-b18d-9835fe77b7c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '126099363d5f4d9cb4803d81a2ea5579', 'request_id': 'req-1adee9b5-3fd6-45aa-b18d-9835fe77b7c6'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:46.597538 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-1adee9b5-3fd6-45aa-b18d-9835fe77b7c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '126099363d5f4d9cb4803d81a2ea5579', 'request_id': 'req-1adee9b5-3fd6-45aa-b18d-9835fe77b7c6'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:46.698882 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-1adee9b5-3fd6-45aa-b18d-9835fe77b7c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '126099363d5f4d9cb4803d81a2ea5579', 'request_id': 'req-1adee9b5-3fd6-45aa-b18d-9835fe77b7c6'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:46.709378 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-1adee9b5-3fd6-45aa-b18d-9835fe77b7c6 admin admin] The token cache is being invalidate because project 126099363d5f4d9cb4803d81a2ea5579 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:28:46.709687 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-1adee9b5-3fd6-45aa-b18d-9835fe77b7c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:46.710306 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-1adee9b5-3fd6-45aa-b18d-9835fe77b7c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:46.711874 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 993/1969] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:28:46 2022] DELETE /identity/v3/projects/126099363d5f4d9cb4803d81a2ea5579 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:28:46.716607 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226feac1-1d7e-4716-863b-8e814c0ae5e1 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:46.717057 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226feac1-1d7e-4716-863b-8e814c0ae5e1 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:46.717174 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226feac1-1d7e-4716-863b-8e814c0ae5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:46.735873 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-226feac1-1d7e-4716-863b-8e814c0ae5e1 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:28:46.736981 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-226feac1-1d7e-4716-863b-8e814c0ae5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:46.794702 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 977/1970] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:28:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:28:46.803400 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e65a0-0ff5-4c57-a3c2-7175d9896bd6 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:46.803690 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e65a0-0ff5-4c57-a3c2-7175d9896bd6 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:46.803996 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e65a0-0ff5-4c57-a3c2-7175d9896bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:46.821826 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-662e65a0-0ff5-4c57-a3c2-7175d9896bd6 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:28:46.823017 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-662e65a0-0ff5-4c57-a3c2-7175d9896bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:46.831362 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 994/1971] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:28:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:28:46.835323 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226feac1-1d7e-4716-863b-8e814c0ae5e1 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:46.845541 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226feac1-1d7e-4716-863b-8e814c0ae5e1 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:46.850085 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3042543-1538-405f-9c51-889caaeda5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:46.850745 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3042543-1538-405f-9c51-889caaeda5bf admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:46.851036 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3042543-1538-405f-9c51-889caaeda5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:46.851317 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3042543-1538-405f-9c51-889caaeda5bf admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:46.852090 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3042543-1538-405f-9c51-889caaeda5bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:28:46.852407 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3042543-1538-405f-9c51-889caaeda5bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:46.854008 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3042543-1538-405f-9c51-889caaeda5bf admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:46.866249 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 978/1972] 10.222.0.24 () {58 vars in 1152 bytes} [Thu Apr 7 06:28:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:28:46.870384 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e65a0-0ff5-4c57-a3c2-7175d9896bd6 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:46.880269 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e65a0-0ff5-4c57-a3c2-7175d9896bd6 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:46.884933 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b2c97-ce98-402c-abb9-adfa9de485d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:46.885585 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b2c97-ce98-402c-abb9-adfa9de485d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:46.885873 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b2c97-ce98-402c-abb9-adfa9de485d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:46.886152 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b2c97-ce98-402c-abb9-adfa9de485d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:46.886851 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b2c97-ce98-402c-abb9-adfa9de485d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:46.888817 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b2c97-ce98-402c-abb9-adfa9de485d1 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:46.998546 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 995/1973] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:28:46 2022] POST /identity/v3/projects => generated 377 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:28:47.003269 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3042543-1538-405f-9c51-889caaeda5bf admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:47.013089 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3042543-1538-405f-9c51-889caaeda5bf admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:47.067720 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca623bfa-d0e0-4b46-88c5-c2fb06224cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:47.068412 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca623bfa-d0e0-4b46-88c5-c2fb06224cc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:47.068698 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca623bfa-d0e0-4b46-88c5-c2fb06224cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:47.068974 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca623bfa-d0e0-4b46-88c5-c2fb06224cc5 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:47.069684 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca623bfa-d0e0-4b46-88c5-c2fb06224cc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:47.071588 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca623bfa-d0e0-4b46-88c5-c2fb06224cc5 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:47.155489 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 979/1974] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:28:47 2022] POST /identity/v3/users => generated 289 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:28:47.160070 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b2c97-ce98-402c-abb9-adfa9de485d1 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:47.169976 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b2c97-ce98-402c-abb9-adfa9de485d1 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:47.175685 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f856f6-5dd1-4f22-accd-7756e81eeea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:47.176401 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f856f6-5dd1-4f22-accd-7756e81eeea3 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:47.176688 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f856f6-5dd1-4f22-accd-7756e81eeea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:47.176962 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f856f6-5dd1-4f22-accd-7756e81eeea3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:47.177713 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f856f6-5dd1-4f22-accd-7756e81eeea3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:47.179352 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f856f6-5dd1-4f22-accd-7756e81eeea3 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:47.189664 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 996/1975] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:28:47.193444 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca623bfa-d0e0-4b46-88c5-c2fb06224cc5 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:47.203510 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca623bfa-d0e0-4b46-88c5-c2fb06224cc5 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:47.208160 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9d076-979c-4c54-ac62-3b2b99b9d3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:47.208810 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9d076-979c-4c54-ac62-3b2b99b9d3c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:47.209094 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9d076-979c-4c54-ac62-3b2b99b9d3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:47.209368 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9d076-979c-4c54-ac62-3b2b99b9d3c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:47.210119 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff9d076-979c-4c54-ac62-3b2b99b9d3c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:47.211791 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff9d076-979c-4c54-ac62-3b2b99b9d3c4 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:47.221944 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 980/1976] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:28:47.226021 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f856f6-5dd1-4f22-accd-7756e81eeea3 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:47.236334 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f856f6-5dd1-4f22-accd-7756e81eeea3 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:47.241124 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af728aca-dcd5-4aac-a4d3-4654362215e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:47.241994 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af728aca-dcd5-4aac-a4d3-4654362215e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:47.242278 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af728aca-dcd5-4aac-a4d3-4654362215e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:47.242565 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af728aca-dcd5-4aac-a4d3-4654362215e6 admin admin] PATH_INFO: `/v3/projects/f21114322b6841f98331b137b7eebb70/users/1c1beaa4fa4b4284a846b4815b28fa1f/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:47.256267 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af728aca-dcd5-4aac-a4d3-4654362215e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f21114322b6841f98331b137b7eebb70, user_id=1c1beaa4fa4b4284a846b4815b28fa1f, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:47.260467 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af728aca-dcd5-4aac-a4d3-4654362215e6 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:47.367898 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 997/1977] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:28:47 2022] PUT /identity/v3/projects/f21114322b6841f98331b137b7eebb70/users/1c1beaa4fa4b4284a846b4815b28fa1f/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:28:47.380234 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bfac3-2c36-4079-9b6f-aa65d8dc298f None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:47.380526 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bfac3-2c36-4079-9b6f-aa65d8dc298f None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:47.380808 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bfac3-2c36-4079-9b6f-aa65d8dc298f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:47.408872 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-a94bfac3-2c36-4079-9b6f-aa65d8dc298f None None] MFA Rules not processed for user `1c1beaa4fa4b4284a846b4815b28fa1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:28:47.410125 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a94bfac3-2c36-4079-9b6f-aa65d8dc298f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:47.470694 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 981/1978] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:28:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:28:47.475203 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af728aca-dcd5-4aac-a4d3-4654362215e6 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:47.535591 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af728aca-dcd5-4aac-a4d3-4654362215e6 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:47.540272 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c35496-ab94-4625-889d-8ad15cee7ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:47.540931 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c35496-ab94-4625-889d-8ad15cee7ddd admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:47.541217 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c35496-ab94-4625-889d-8ad15cee7ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:47.541495 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c35496-ab94-4625-889d-8ad15cee7ddd admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:47.542183 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c35496-ab94-4625-889d-8ad15cee7ddd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:47.544113 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c35496-ab94-4625-889d-8ad15cee7ddd admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:47.661419 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 998/1979] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:28:47 2022] POST /identity/v3/projects => generated 377 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:28:47.665353 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94bfac3-2c36-4079-9b6f-aa65d8dc298f None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:47.675995 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94bfac3-2c36-4079-9b6f-aa65d8dc298f None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:47.729131 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b0592-b1d9-4a3c-a9ad-1f314c3d0e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:47.729804 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b0592-b1d9-4a3c-a9ad-1f314c3d0e19 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:47.730093 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b0592-b1d9-4a3c-a9ad-1f314c3d0e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:47.730375 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b0592-b1d9-4a3c-a9ad-1f314c3d0e19 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:47.731068 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b0592-b1d9-4a3c-a9ad-1f314c3d0e19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:47.733045 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b0592-b1d9-4a3c-a9ad-1f314c3d0e19 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:47.802680 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 982/1980] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:28:47 2022] POST /identity/v3/users => generated 289 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:28:47.806535 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c35496-ab94-4625-889d-8ad15cee7ddd admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:47.816609 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c35496-ab94-4625-889d-8ad15cee7ddd admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:47.821151 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3288e42-e630-4b7c-bb4b-9981dbb40237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:47.821802 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3288e42-e630-4b7c-bb4b-9981dbb40237 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:47.822088 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3288e42-e630-4b7c-bb4b-9981dbb40237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:47.822366 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3288e42-e630-4b7c-bb4b-9981dbb40237 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:47.823092 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3288e42-e630-4b7c-bb4b-9981dbb40237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:47.824707 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3288e42-e630-4b7c-bb4b-9981dbb40237 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:47.836840 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 999/1981] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 07 06:28:47.840426 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b0592-b1d9-4a3c-a9ad-1f314c3d0e19 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:47.852417 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b0592-b1d9-4a3c-a9ad-1f314c3d0e19 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:47.856974 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d438648-1de1-4263-ba0c-13e2680909d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:47.857639 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d438648-1de1-4263-ba0c-13e2680909d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:47.857928 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d438648-1de1-4263-ba0c-13e2680909d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:47.858208 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d438648-1de1-4263-ba0c-13e2680909d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:47.858946 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d438648-1de1-4263-ba0c-13e2680909d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:47.860584 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d438648-1de1-4263-ba0c-13e2680909d9 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:47.870498 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 983/1982] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 07 06:28:47.874991 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3288e42-e630-4b7c-bb4b-9981dbb40237 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:47.884686 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3288e42-e630-4b7c-bb4b-9981dbb40237 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:47.889234 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84001e9-6f74-4389-8759-7e4faa92d0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:47.890708 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84001e9-6f74-4389-8759-7e4faa92d0a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:47.890995 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84001e9-6f74-4389-8759-7e4faa92d0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:47.891273 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84001e9-6f74-4389-8759-7e4faa92d0a7 admin admin] PATH_INFO: `/v3/projects/d4151d69c9e543cabd99c9b3cb074c82/users/5ef13416488d4eafb23b16ab3788acde/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:47.905012 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84001e9-6f74-4389-8759-7e4faa92d0a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4151d69c9e543cabd99c9b3cb074c82, user_id=5ef13416488d4eafb23b16ab3788acde, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:47.907652 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84001e9-6f74-4389-8759-7e4faa92d0a7 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:47.990387 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1000/1983] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:28:47 2022] PUT /identity/v3/projects/d4151d69c9e543cabd99c9b3cb074c82/users/5ef13416488d4eafb23b16ab3788acde/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:28:48.000966 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfae0e9-daec-41ed-a100-67e40b540104 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:48.001261 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfae0e9-daec-41ed-a100-67e40b540104 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:48.001540 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfae0e9-daec-41ed-a100-67e40b540104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:48.027216 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-1bfae0e9-daec-41ed-a100-67e40b540104 None None] MFA Rules not processed for user `5ef13416488d4eafb23b16ab3788acde`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:28:48.028461 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-1bfae0e9-daec-41ed-a100-67e40b540104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:48.094153 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 984/1984] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:28:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:28:48.098479 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84001e9-6f74-4389-8759-7e4faa92d0a7 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:48.158027 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84001e9-6f74-4389-8759-7e4faa92d0a7 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:48.162679 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a11288-5e8a-4765-aa42-89baddefc05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:48.163336 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a11288-5e8a-4765-aa42-89baddefc05e admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:48.163621 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a11288-5e8a-4765-aa42-89baddefc05e admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:48.163932 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a11288-5e8a-4765-aa42-89baddefc05e admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:48.164627 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a11288-5e8a-4765-aa42-89baddefc05e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:48.166516 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a11288-5e8a-4765-aa42-89baddefc05e admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:48.301153 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1001/1985] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:28:48 2022] POST /identity/v3/projects => generated 375 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:28:48.305288 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfae0e9-daec-41ed-a100-67e40b540104 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:48.316370 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfae0e9-daec-41ed-a100-67e40b540104 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:48.370145 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a9d74-3916-4db0-bf59-e461c6d72bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:48.370808 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a9d74-3916-4db0-bf59-e461c6d72bc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:48.371092 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a9d74-3916-4db0-bf59-e461c6d72bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:48.371368 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a9d74-3916-4db0-bf59-e461c6d72bc9 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:48.372114 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837a9d74-3916-4db0-bf59-e461c6d72bc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:48.374023 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837a9d74-3916-4db0-bf59-e461c6d72bc9 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:48.482626 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 985/1986] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:28:48 2022] POST /identity/v3/users => generated 294 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:28:48.486791 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a11288-5e8a-4765-aa42-89baddefc05e admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:48.497772 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a11288-5e8a-4765-aa42-89baddefc05e admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:48.503568 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372adb1-70f9-4a8a-b6aa-ac85a2e088ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:48.504453 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372adb1-70f9-4a8a-b6aa-ac85a2e088ae admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:48.504739 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372adb1-70f9-4a8a-b6aa-ac85a2e088ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:48.505165 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372adb1-70f9-4a8a-b6aa-ac85a2e088ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:48.505904 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0372adb1-70f9-4a8a-b6aa-ac85a2e088ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:48.508458 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0372adb1-70f9-4a8a-b6aa-ac85a2e088ae admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:48.520452 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1002/1987] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:28:48.524931 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a9d74-3916-4db0-bf59-e461c6d72bc9 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:48.536364 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a9d74-3916-4db0-bf59-e461c6d72bc9 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:48.541032 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce600547-4090-4acd-b2c3-8bdb61a1fbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:48.543913 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce600547-4090-4acd-b2c3-8bdb61a1fbb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:48.543913 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce600547-4090-4acd-b2c3-8bdb61a1fbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:48.543913 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce600547-4090-4acd-b2c3-8bdb61a1fbb7 admin admin] PATH_INFO: `/v3/projects/e85c531aa57740f4b65079cfe0120f90/users/a1d2c5f2f7f64439a5928b05fb0d1fe0/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:48.556828 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce600547-4090-4acd-b2c3-8bdb61a1fbb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e85c531aa57740f4b65079cfe0120f90, user_id=a1d2c5f2f7f64439a5928b05fb0d1fe0, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:48.559577 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce600547-4090-4acd-b2c3-8bdb61a1fbb7 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:48.659402 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 986/1988] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:28:48 2022] PUT /identity/v3/projects/e85c531aa57740f4b65079cfe0120f90/users/a1d2c5f2f7f64439a5928b05fb0d1fe0/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:28:48.663359 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372adb1-70f9-4a8a-b6aa-ac85a2e088ae admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:48.673487 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372adb1-70f9-4a8a-b6aa-ac85a2e088ae admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:48.732687 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d343104-3f74-4f73-9bf3-06007b33b834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:48.733365 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d343104-3f74-4f73-9bf3-06007b33b834 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:48.733650 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d343104-3f74-4f73-9bf3-06007b33b834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:48.733951 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d343104-3f74-4f73-9bf3-06007b33b834 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:48.734678 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d343104-3f74-4f73-9bf3-06007b33b834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:48.736449 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d343104-3f74-4f73-9bf3-06007b33b834 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:48.747865 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1003/1989] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:28:48.752475 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce600547-4090-4acd-b2c3-8bdb61a1fbb7 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:48.762860 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce600547-4090-4acd-b2c3-8bdb61a1fbb7 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:48.768449 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a0d2b6-4fa3-4286-9d1d-6638641d1324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:48.769342 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0d2b6-4fa3-4286-9d1d-6638641d1324 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:48.769631 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0d2b6-4fa3-4286-9d1d-6638641d1324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:48.769997 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0d2b6-4fa3-4286-9d1d-6638641d1324 admin admin] PATH_INFO: `/v3/projects/e85c531aa57740f4b65079cfe0120f90/users/a1d2c5f2f7f64439a5928b05fb0d1fe0/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:48.772510 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a0d2b6-4fa3-4286-9d1d-6638641d1324 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e85c531aa57740f4b65079cfe0120f90, user_id=a1d2c5f2f7f64439a5928b05fb0d1fe0, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:48.775315 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a0d2b6-4fa3-4286-9d1d-6638641d1324 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:48.786619 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 987/1990] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:28:48 2022] PUT /identity/v3/projects/e85c531aa57740f4b65079cfe0120f90/users/a1d2c5f2f7f64439a5928b05fb0d1fe0/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:28:48.798953 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27405d-3a0c-469a-872c-39ef2bafeb7b None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:48.798953 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27405d-3a0c-469a-872c-39ef2bafeb7b None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:48.798953 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27405d-3a0c-469a-872c-39ef2bafeb7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:48.829806 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-6e27405d-3a0c-469a-872c-39ef2bafeb7b None None] MFA Rules not processed for user `a1d2c5f2f7f64439a5928b05fb0d1fe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:28:48.833565 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-6e27405d-3a0c-469a-872c-39ef2bafeb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:48.903994 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1004/1991] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:28:48 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:28:48.930749 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a0d2b6-4fa3-4286-9d1d-6638641d1324 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:48.932529 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-72a0d2b6-4fa3-4286-9d1d-6638641d1324 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:48.990962 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a0d2b6-4fa3-4286-9d1d-6638641d1324 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:48.994767 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4debfbe0-7dd7-4d94-9290-5d5c984604dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:48.995461 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4debfbe0-7dd7-4d94-9290-5d5c984604dd service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:48.995795 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4debfbe0-7dd7-4d94-9290-5d5c984604dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:48.996102 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4debfbe0-7dd7-4d94-9290-5d5c984604dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:49.005892 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4debfbe0-7dd7-4d94-9290-5d5c984604dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:49.007408 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4debfbe0-7dd7-4d94-9290-5d5c984604dd service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:49.016921 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 988/1992] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:28:48 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:28:49.189363 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e27405d-3a0c-469a-872c-39ef2bafeb7b None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:49.190915 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-6e27405d-3a0c-469a-872c-39ef2bafeb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:49.207768 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e27405d-3a0c-469a-872c-39ef2bafeb7b None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:49.212359 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261b3919-97d9-4f3c-b08e-0aab673b3ef0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:49.213768 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b3919-97d9-4f3c-b08e-0aab673b3ef0 service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:49.214238 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b3919-97d9-4f3c-b08e-0aab673b3ef0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:49.214592 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b3919-97d9-4f3c-b08e-0aab673b3ef0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:49.274930 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261b3919-97d9-4f3c-b08e-0aab673b3ef0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:49.276426 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261b3919-97d9-4f3c-b08e-0aab673b3ef0 service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:49.294021 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1005/1993] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:28:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:28:50.102976 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4debfbe0-7dd7-4d94-9290-5d5c984604dd service cinder] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:50.104457 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-4debfbe0-7dd7-4d94-9290-5d5c984604dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:50.169426 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4debfbe0-7dd7-4d94-9290-5d5c984604dd service cinder] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:50.174033 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c1c47-f704-480d-b79a-350805a40aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:50.174937 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c1c47-f704-480d-b79a-350805a40aa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:50.175226 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c1c47-f704-480d-b79a-350805a40aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:50.175502 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c1c47-f704-480d-b79a-350805a40aa5 admin admin] PATH_INFO: `/v3/users/5a3762215c1d48159d160625fe9d8dce` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:50.176720 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876c1c47-f704-480d-b79a-350805a40aa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a3762215c1d48159d160625fe9d8dce)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:50.178646 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876c1c47-f704-480d-b79a-350805a40aa5 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:50.392317 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-876c1c47-f704-480d-b79a-350805a40aa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a3762215c1d48159d160625fe9d8dce'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:50.392969 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-876c1c47-f704-480d-b79a-350805a40aa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a3762215c1d48159d160625fe9d8dce'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:50.493634 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-876c1c47-f704-480d-b79a-350805a40aa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a3762215c1d48159d160625fe9d8dce'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:50.494417 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-876c1c47-f704-480d-b79a-350805a40aa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a3762215c1d48159d160625fe9d8dce'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:50.514621 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-876c1c47-f704-480d-b79a-350805a40aa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a3762215c1d48159d160625fe9d8dce'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:50.533340 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 989/1994] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:28:50 2022] DELETE /identity/v3/users/5a3762215c1d48159d160625fe9d8dce => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:28:50.814990 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261b3919-97d9-4f3c-b08e-0aab673b3ef0 service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:50.827235 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261b3919-97d9-4f3c-b08e-0aab673b3ef0 service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:50.885739 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d8293-ab44-4326-aa8b-d57a1a24804d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:50.886604 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d8293-ab44-4326-aa8b-d57a1a24804d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:50.886890 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d8293-ab44-4326-aa8b-d57a1a24804d admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:50.887174 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d8293-ab44-4326-aa8b-d57a1a24804d admin admin] PATH_INFO: `/v3/projects/d3e8ec8942464f8abbafbd48b6f1f61f` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:50.888379 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d8293-ab44-4326-aa8b-d57a1a24804d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3e8ec8942464f8abbafbd48b6f1f61f)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:50.890272 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d8293-ab44-4326-aa8b-d57a1a24804d admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:51.076824 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7c5d8293-ab44-4326-aa8b-d57a1a24804d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3e8ec8942464f8abbafbd48b6f1f61f', 'request_id': 'req-7c5d8293-ab44-4326-aa8b-d57a1a24804d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:51.082932 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7c5d8293-ab44-4326-aa8b-d57a1a24804d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3e8ec8942464f8abbafbd48b6f1f61f', 'request_id': 'req-7c5d8293-ab44-4326-aa8b-d57a1a24804d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:51.173912 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7c5d8293-ab44-4326-aa8b-d57a1a24804d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3e8ec8942464f8abbafbd48b6f1f61f', 'request_id': 'req-7c5d8293-ab44-4326-aa8b-d57a1a24804d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:51.184735 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7c5d8293-ab44-4326-aa8b-d57a1a24804d admin admin] The token cache is being invalidate because project d3e8ec8942464f8abbafbd48b6f1f61f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:28:51.185025 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7c5d8293-ab44-4326-aa8b-d57a1a24804d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:51.185649 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7c5d8293-ab44-4326-aa8b-d57a1a24804d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:51.187828 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1006/1995] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:28:50 2022] DELETE /identity/v3/projects/d3e8ec8942464f8abbafbd48b6f1f61f => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:28:51.192835 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a697a-a2ee-458d-9e38-513e1d09e4a3 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:51.193301 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a697a-a2ee-458d-9e38-513e1d09e4a3 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:51.193486 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a697a-a2ee-458d-9e38-513e1d09e4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:51.210995 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-ae5a697a-a2ee-458d-9e38-513e1d09e4a3 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:28:51.212236 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-ae5a697a-a2ee-458d-9e38-513e1d09e4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:51.271369 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 990/1996] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:28:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:28:51.280357 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb4e2e-44bf-4f45-850f-2c148b491090 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:51.281585 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb4e2e-44bf-4f45-850f-2c148b491090 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:51.281585 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb4e2e-44bf-4f45-850f-2c148b491090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:51.301856 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-8feb4e2e-44bf-4f45-850f-2c148b491090 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:28:51.305784 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-8feb4e2e-44bf-4f45-850f-2c148b491090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:51.315484 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1007/1997] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:28:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:28:51.320005 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5a697a-a2ee-458d-9e38-513e1d09e4a3 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:51.333754 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5a697a-a2ee-458d-9e38-513e1d09e4a3 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:51.336801 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e227c9ce-d6d6-4fd3-9763-573b761796e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:51.338012 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227c9ce-d6d6-4fd3-9763-573b761796e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:51.338308 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227c9ce-d6d6-4fd3-9763-573b761796e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:51.338584 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227c9ce-d6d6-4fd3-9763-573b761796e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:51.339318 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e227c9ce-d6d6-4fd3-9763-573b761796e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:28:51.339630 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e227c9ce-d6d6-4fd3-9763-573b761796e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:51.341264 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e227c9ce-d6d6-4fd3-9763-573b761796e0 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:51.355773 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 991/1998] 10.222.0.24 () {58 vars in 1152 bytes} [Thu Apr 7 06:28:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:28:51.359320 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb4e2e-44bf-4f45-850f-2c148b491090 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:51.370155 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb4e2e-44bf-4f45-850f-2c148b491090 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:51.375309 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c6e829-af92-4af6-a456-73e087e86f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:51.376064 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6e829-af92-4af6-a456-73e087e86f5d admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:51.376356 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6e829-af92-4af6-a456-73e087e86f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:51.376636 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6e829-af92-4af6-a456-73e087e86f5d admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:51.377374 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c6e829-af92-4af6-a456-73e087e86f5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:51.379341 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c6e829-af92-4af6-a456-73e087e86f5d admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:51.495709 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1008/1999] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:28:51 2022] POST /identity/v3/projects => generated 393 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:28:51.505686 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e227c9ce-d6d6-4fd3-9763-573b761796e0 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:51.518345 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e227c9ce-d6d6-4fd3-9763-573b761796e0 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:51.598760 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd54568-68a9-4889-88b5-3a6ad229cc88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:51.599695 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd54568-68a9-4889-88b5-3a6ad229cc88 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:51.600301 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd54568-68a9-4889-88b5-3a6ad229cc88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:51.600751 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd54568-68a9-4889-88b5-3a6ad229cc88 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:51.601533 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd54568-68a9-4889-88b5-3a6ad229cc88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:51.603464 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd54568-68a9-4889-88b5-3a6ad229cc88 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:51.752065 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 992/2000] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:28:51 2022] POST /identity/v3/users => generated 297 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:28:51.756225 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c6e829-af92-4af6-a456-73e087e86f5d admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:51.790000 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c6e829-af92-4af6-a456-73e087e86f5d admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:51.794658 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fdcfd8-c232-42c5-ab54-8b9245b9fdd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:51.795323 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdcfd8-c232-42c5-ab54-8b9245b9fdd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:51.795610 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdcfd8-c232-42c5-ab54-8b9245b9fdd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:51.795925 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdcfd8-c232-42c5-ab54-8b9245b9fdd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:51.796661 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fdcfd8-c232-42c5-ab54-8b9245b9fdd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:51.798254 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fdcfd8-c232-42c5-ab54-8b9245b9fdd5 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:51.807712 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1009/2001] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:28:51.811735 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd54568-68a9-4889-88b5-3a6ad229cc88 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:51.821548 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd54568-68a9-4889-88b5-3a6ad229cc88 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:51.826308 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc4398b-7cb7-4e2b-9806-6108a65af444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:51.826921 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4398b-7cb7-4e2b-9806-6108a65af444 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:51.827210 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4398b-7cb7-4e2b-9806-6108a65af444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:51.828028 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4398b-7cb7-4e2b-9806-6108a65af444 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:51.828855 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc4398b-7cb7-4e2b-9806-6108a65af444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:51.839888 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc4398b-7cb7-4e2b-9806-6108a65af444 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:51.841354 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 993/2002] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:28:51.845983 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fdcfd8-c232-42c5-ab54-8b9245b9fdd5 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:51.855821 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fdcfd8-c232-42c5-ab54-8b9245b9fdd5 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:51.860599 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f0d3d4-b509-4578-b1b0-4ccb6ad9b550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:51.861487 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0d3d4-b509-4578-b1b0-4ccb6ad9b550 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:51.861774 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0d3d4-b509-4578-b1b0-4ccb6ad9b550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:51.862053 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0d3d4-b509-4578-b1b0-4ccb6ad9b550 admin admin] PATH_INFO: `/v3/projects/7e40ad60e8e7486082b6638b218a786b/users/0d928dfb5b354509a543229ea0836e82/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:51.877409 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f0d3d4-b509-4578-b1b0-4ccb6ad9b550 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e40ad60e8e7486082b6638b218a786b, user_id=0d928dfb5b354509a543229ea0836e82, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:51.880125 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f0d3d4-b509-4578-b1b0-4ccb6ad9b550 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:51.982100 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1010/2003] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:28:51 2022] PUT /identity/v3/projects/7e40ad60e8e7486082b6638b218a786b/users/0d928dfb5b354509a543229ea0836e82/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:28:51.985992 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed8c16-b0a0-44cb-a354-cfcb202be2eb None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:51.986290 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed8c16-b0a0-44cb-a354-cfcb202be2eb None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:51.986576 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed8c16-b0a0-44cb-a354-cfcb202be2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:52.004653 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-e5ed8c16-b0a0-44cb-a354-cfcb202be2eb None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:28:52.005911 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-e5ed8c16-b0a0-44cb-a354-cfcb202be2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:52.061395 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 994/2004] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:28:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:28:52.071198 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f0d3d4-b509-4578-b1b0-4ccb6ad9b550 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:52.072908 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c1f0d3d4-b509-4578-b1b0-4ccb6ad9b550 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:52.163007 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f0d3d4-b509-4578-b1b0-4ccb6ad9b550 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:52.166816 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd06d33-38c2-46c2-87de-084fd835c6ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:52.167490 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd06d33-38c2-46c2-87de-084fd835c6ce service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:52.167808 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd06d33-38c2-46c2-87de-084fd835c6ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:52.168094 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd06d33-38c2-46c2-87de-084fd835c6ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:52.178504 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd06d33-38c2-46c2-87de-084fd835c6ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:52.182263 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd06d33-38c2-46c2-87de-084fd835c6ce service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:52.191019 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1011/2005] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:28:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:28:56.953419 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ed8c16-b0a0-44cb-a354-cfcb202be2eb None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:56.955117 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-e5ed8c16-b0a0-44cb-a354-cfcb202be2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:56.994666 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ed8c16-b0a0-44cb-a354-cfcb202be2eb None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:56.999650 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c195d-5b35-41f4-870a-a0ffa6e7af6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:57.000815 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c195d-5b35-41f4-870a-a0ffa6e7af6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:57.001108 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c195d-5b35-41f4-870a-a0ffa6e7af6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:57.001386 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c195d-5b35-41f4-870a-a0ffa6e7af6d admin admin] PATH_INFO: `/v3/users/1c1beaa4fa4b4284a846b4815b28fa1f` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:57.002744 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0c195d-5b35-41f4-870a-a0ffa6e7af6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c1beaa4fa4b4284a846b4815b28fa1f)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:57.004791 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0c195d-5b35-41f4-870a-a0ffa6e7af6d admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:57.214319 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-1b0c195d-5b35-41f4-870a-a0ffa6e7af6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c1beaa4fa4b4284a846b4815b28fa1f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:57.220350 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-1b0c195d-5b35-41f4-870a-a0ffa6e7af6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c1beaa4fa4b4284a846b4815b28fa1f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:57.379234 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-1b0c195d-5b35-41f4-870a-a0ffa6e7af6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c1beaa4fa4b4284a846b4815b28fa1f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:57.380262 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-1b0c195d-5b35-41f4-870a-a0ffa6e7af6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c1beaa4fa4b4284a846b4815b28fa1f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:57.395413 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-1b0c195d-5b35-41f4-870a-a0ffa6e7af6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c1beaa4fa4b4284a846b4815b28fa1f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:57.417646 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 995/2006] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:28:56 2022] DELETE /identity/v3/users/1c1beaa4fa4b4284a846b4815b28fa1f => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:28:57.422353 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572632b-0010-42f3-903e-a235010c8162 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:57.422817 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572632b-0010-42f3-903e-a235010c8162 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:57.424746 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572632b-0010-42f3-903e-a235010c8162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:57.489472 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-6572632b-0010-42f3-903e-a235010c8162 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:28:57.490546 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-6572632b-0010-42f3-903e-a235010c8162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:57.628816 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1012/2007] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:28:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:28:57.635390 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c195d-5b35-41f4-870a-a0ffa6e7af6d admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:57.638097 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-1b0c195d-5b35-41f4-870a-a0ffa6e7af6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:57.747039 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c195d-5b35-41f4-870a-a0ffa6e7af6d admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:57.751778 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4053a297-0b7e-4968-893c-30c13b414012 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:57.752547 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053a297-0b7e-4968-893c-30c13b414012 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:57.752913 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053a297-0b7e-4968-893c-30c13b414012 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:57.753396 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053a297-0b7e-4968-893c-30c13b414012 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:57.764557 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4053a297-0b7e-4968-893c-30c13b414012 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:57.767079 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4053a297-0b7e-4968-893c-30c13b414012 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:57.779899 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 996/2008] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:28:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:28:58.259827 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585bae8-a272-40ed-baed-20dac7832e75 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:58.260368 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585bae8-a272-40ed-baed-20dac7832e75 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:58.260841 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585bae8-a272-40ed-baed-20dac7832e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:58.312958 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-6585bae8-a272-40ed-baed-20dac7832e75 None None] MFA Rules not processed for user `0d928dfb5b354509a543229ea0836e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:28:58.314882 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-6585bae8-a272-40ed-baed-20dac7832e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:58.403333 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1013/2009] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:28:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:28:58.415829 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bcfb8a-b8c5-4223-ba69-b4251e6efb9e None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:58.416817 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bcfb8a-b8c5-4223-ba69-b4251e6efb9e None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:58.417848 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bcfb8a-b8c5-4223-ba69-b4251e6efb9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:58.444632 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-03bcfb8a-b8c5-4223-ba69-b4251e6efb9e None None] MFA Rules not processed for user `0d928dfb5b354509a543229ea0836e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:28:58.445957 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-03bcfb8a-b8c5-4223-ba69-b4251e6efb9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:58.454013 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 997/2010] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:28:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:28:58.464535 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585bae8-a272-40ed-baed-20dac7832e75 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:58.465922 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-6585bae8-a272-40ed-baed-20dac7832e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:58.491965 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bcfb8a-b8c5-4223-ba69-b4251e6efb9e None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:58.493595 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-03bcfb8a-b8c5-4223-ba69-b4251e6efb9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:58.519475 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bcfb8a-b8c5-4223-ba69-b4251e6efb9e None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:58.527880 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f480220-e208-412c-9fd8-a57775250518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:58.529275 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f480220-e208-412c-9fd8-a57775250518 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:58.529568 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f480220-e208-412c-9fd8-a57775250518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:58.530119 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f480220-e208-412c-9fd8-a57775250518 admin admin] PATH_INFO: `/v3/projects/f21114322b6841f98331b137b7eebb70` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:58.533163 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f480220-e208-412c-9fd8-a57775250518 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f21114322b6841f98331b137b7eebb70)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:58.536117 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f480220-e208-412c-9fd8-a57775250518 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:58.556324 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585bae8-a272-40ed-baed-20dac7832e75 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:58.563016 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b72d183-20f1-438f-97c3-3dd6b30cbaa5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cd81f6620f410db450871fb29961f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:58.563784 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72d183-20f1-438f-97c3-3dd6b30cbaa5 service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:58.564093 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72d183-20f1-438f-97c3-3dd6b30cbaa5 service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:58.564358 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72d183-20f1-438f-97c3-3dd6b30cbaa5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:58.572826 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b72d183-20f1-438f-97c3-3dd6b30cbaa5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:58.575837 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b72d183-20f1-438f-97c3-3dd6b30cbaa5 service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:58.584770 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1014/2011] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:28:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 07 06:28:58.720703 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-8f480220-e208-412c-9fd8-a57775250518 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f21114322b6841f98331b137b7eebb70', 'request_id': 'req-8f480220-e208-412c-9fd8-a57775250518'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:58.727648 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-8f480220-e208-412c-9fd8-a57775250518 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f21114322b6841f98331b137b7eebb70', 'request_id': 'req-8f480220-e208-412c-9fd8-a57775250518'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:58.819545 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-8f480220-e208-412c-9fd8-a57775250518 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f21114322b6841f98331b137b7eebb70', 'request_id': 'req-8f480220-e208-412c-9fd8-a57775250518'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:58.835620 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-8f480220-e208-412c-9fd8-a57775250518 admin admin] The token cache is being invalidate because project f21114322b6841f98331b137b7eebb70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:28:58.836023 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-8f480220-e208-412c-9fd8-a57775250518 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:58.837056 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-8f480220-e208-412c-9fd8-a57775250518 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:58.838855 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 998/2012] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:28:58 2022] DELETE /identity/v3/projects/f21114322b6841f98331b137b7eebb70 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:28:58.842496 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b72d183-20f1-438f-97c3-3dd6b30cbaa5 service nova] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:58.853805 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b72d183-20f1-438f-97c3-3dd6b30cbaa5 service nova] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:28:58.938390 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae112fb-b849-4725-8a32-b14b166f4003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:28:58.939281 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae112fb-b849-4725-8a32-b14b166f4003 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:58.939573 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae112fb-b849-4725-8a32-b14b166f4003 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:58.940054 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae112fb-b849-4725-8a32-b14b166f4003 admin admin] PATH_INFO: `/v3/users/5ef13416488d4eafb23b16ab3788acde` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:58.943381 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae112fb-b849-4725-8a32-b14b166f4003 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ef13416488d4eafb23b16ab3788acde)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:28:58.943829 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae112fb-b849-4725-8a32-b14b166f4003 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:28:59.167103 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2ae112fb-b849-4725-8a32-b14b166f4003 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ef13416488d4eafb23b16ab3788acde'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:59.187244 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2ae112fb-b849-4725-8a32-b14b166f4003 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ef13416488d4eafb23b16ab3788acde'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:59.265202 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2ae112fb-b849-4725-8a32-b14b166f4003 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ef13416488d4eafb23b16ab3788acde'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:59.266268 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2ae112fb-b849-4725-8a32-b14b166f4003 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ef13416488d4eafb23b16ab3788acde'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:59.266469 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2ae112fb-b849-4725-8a32-b14b166f4003 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ef13416488d4eafb23b16ab3788acde'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:28:59.290663 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1015/2013] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:28:58 2022] DELETE /identity/v3/users/5ef13416488d4eafb23b16ab3788acde => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:28:59.428755 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c14c37-8cca-4a79-a5a5-8610d100ec12 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:28:59.429576 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c14c37-8cca-4a79-a5a5-8610d100ec12 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:28:59.430029 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c14c37-8cca-4a79-a5a5-8610d100ec12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:28:59.458989 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-03c14c37-8cca-4a79-a5a5-8610d100ec12 None None] MFA Rules not processed for user `0d928dfb5b354509a543229ea0836e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:28:59.461193 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-03c14c37-8cca-4a79-a5a5-8610d100ec12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:28:59.539535 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 999/2014] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:28:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:28:59.948046 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae112fb-b849-4725-8a32-b14b166f4003 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:28:59.950390 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-2ae112fb-b849-4725-8a32-b14b166f4003 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:00.049426 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae112fb-b849-4725-8a32-b14b166f4003 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:00.061478 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5007126e-2b89-42ef-8086-d945ac6c97d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:00.063486 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007126e-2b89-42ef-8086-d945ac6c97d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:00.063486 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007126e-2b89-42ef-8086-d945ac6c97d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:00.063486 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007126e-2b89-42ef-8086-d945ac6c97d9 admin admin] PATH_INFO: `/v3/projects/d4151d69c9e543cabd99c9b3cb074c82` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:00.064779 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5007126e-2b89-42ef-8086-d945ac6c97d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4151d69c9e543cabd99c9b3cb074c82)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:00.066808 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5007126e-2b89-42ef-8086-d945ac6c97d9 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:00.190093 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5007126e-2b89-42ef-8086-d945ac6c97d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4151d69c9e543cabd99c9b3cb074c82', 'request_id': 'req-5007126e-2b89-42ef-8086-d945ac6c97d9'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:00.201368 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5007126e-2b89-42ef-8086-d945ac6c97d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4151d69c9e543cabd99c9b3cb074c82', 'request_id': 'req-5007126e-2b89-42ef-8086-d945ac6c97d9'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:00.274851 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5007126e-2b89-42ef-8086-d945ac6c97d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4151d69c9e543cabd99c9b3cb074c82', 'request_id': 'req-5007126e-2b89-42ef-8086-d945ac6c97d9'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:00.293126 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5007126e-2b89-42ef-8086-d945ac6c97d9 admin admin] The token cache is being invalidate because project d4151d69c9e543cabd99c9b3cb074c82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:29:00.293420 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5007126e-2b89-42ef-8086-d945ac6c97d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:00.294638 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5007126e-2b89-42ef-8086-d945ac6c97d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:00.302759 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1016/2015] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:28:59 2022] DELETE /identity/v3/projects/d4151d69c9e543cabd99c9b3cb074c82 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:29:00.309479 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c14c37-8cca-4a79-a5a5-8610d100ec12 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:00.318100 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c14c37-8cca-4a79-a5a5-8610d100ec12 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:00.428708 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed34b2-8a3c-4088-ba74-6f8caf10ca90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:00.431508 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed34b2-8a3c-4088-ba74-6f8caf10ca90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:00.434504 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed34b2-8a3c-4088-ba74-6f8caf10ca90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:00.435070 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed34b2-8a3c-4088-ba74-6f8caf10ca90 admin admin] PATH_INFO: `/v3/users/a1d2c5f2f7f64439a5928b05fb0d1fe0` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:00.436944 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ed34b2-8a3c-4088-ba74-6f8caf10ca90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1d2c5f2f7f64439a5928b05fb0d1fe0)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:00.439057 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ed34b2-8a3c-4088-ba74-6f8caf10ca90 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:00.788915 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-99ed34b2-8a3c-4088-ba74-6f8caf10ca90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1d2c5f2f7f64439a5928b05fb0d1fe0'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:00.789615 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-99ed34b2-8a3c-4088-ba74-6f8caf10ca90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1d2c5f2f7f64439a5928b05fb0d1fe0'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:00.860149 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-99ed34b2-8a3c-4088-ba74-6f8caf10ca90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1d2c5f2f7f64439a5928b05fb0d1fe0'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:00.861192 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-99ed34b2-8a3c-4088-ba74-6f8caf10ca90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1d2c5f2f7f64439a5928b05fb0d1fe0'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:00.883598 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-99ed34b2-8a3c-4088-ba74-6f8caf10ca90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1d2c5f2f7f64439a5928b05fb0d1fe0'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:00.899967 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1000/2016] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:29:00 2022] DELETE /identity/v3/users/a1d2c5f2f7f64439a5928b05fb0d1fe0 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:29:01.217846 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5007126e-2b89-42ef-8086-d945ac6c97d9 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:01.221814 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-5007126e-2b89-42ef-8086-d945ac6c97d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:01.246576 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5007126e-2b89-42ef-8086-d945ac6c97d9 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:01.346904 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7403b28e-35da-4c29-abea-e9d0f9ee281a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:01.348206 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403b28e-35da-4c29-abea-e9d0f9ee281a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:01.348636 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403b28e-35da-4c29-abea-e9d0f9ee281a admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:01.349016 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403b28e-35da-4c29-abea-e9d0f9ee281a admin admin] PATH_INFO: `/v3/users/027bccd998444dd7b946d3f06f267300` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:01.350356 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7403b28e-35da-4c29-abea-e9d0f9ee281a admin admin] RBAC: Authorizing `identity:delete_user(user_id=027bccd998444dd7b946d3f06f267300)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:01.352446 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7403b28e-35da-4c29-abea-e9d0f9ee281a admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:01.461559 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed34b2-8a3c-4088-ba74-6f8caf10ca90 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:01.463067 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-99ed34b2-8a3c-4088-ba74-6f8caf10ca90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:01.478015 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed34b2-8a3c-4088-ba74-6f8caf10ca90 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:01.484762 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7380d052-ae43-4a48-b73e-808bc2e4bf06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:01.485673 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380d052-ae43-4a48-b73e-808bc2e4bf06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:01.486031 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380d052-ae43-4a48-b73e-808bc2e4bf06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:01.486487 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380d052-ae43-4a48-b73e-808bc2e4bf06 admin admin] PATH_INFO: `/v3/projects/e85c531aa57740f4b65079cfe0120f90` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:01.488953 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7380d052-ae43-4a48-b73e-808bc2e4bf06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e85c531aa57740f4b65079cfe0120f90)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:01.491546 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7380d052-ae43-4a48-b73e-808bc2e4bf06 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:01.660257 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7403b28e-35da-4c29-abea-e9d0f9ee281a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '027bccd998444dd7b946d3f06f267300'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:01.665936 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7380d052-ae43-4a48-b73e-808bc2e4bf06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e85c531aa57740f4b65079cfe0120f90', 'request_id': 'req-7380d052-ae43-4a48-b73e-808bc2e4bf06'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:01.672267 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7380d052-ae43-4a48-b73e-808bc2e4bf06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e85c531aa57740f4b65079cfe0120f90', 'request_id': 'req-7380d052-ae43-4a48-b73e-808bc2e4bf06'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:01.673355 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7403b28e-35da-4c29-abea-e9d0f9ee281a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '027bccd998444dd7b946d3f06f267300'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:01.757235 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7380d052-ae43-4a48-b73e-808bc2e4bf06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e85c531aa57740f4b65079cfe0120f90', 'request_id': 'req-7380d052-ae43-4a48-b73e-808bc2e4bf06'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:01.780996 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7380d052-ae43-4a48-b73e-808bc2e4bf06 admin admin] The token cache is being invalidate because project e85c531aa57740f4b65079cfe0120f90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:29:01.781306 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7380d052-ae43-4a48-b73e-808bc2e4bf06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:01.781978 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7380d052-ae43-4a48-b73e-808bc2e4bf06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:01.783584 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1001/2017] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:29:01 2022] DELETE /identity/v3/projects/e85c531aa57740f4b65079cfe0120f90 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:29:01.789706 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55287f3c-6b22-4f05-af24-eb4ab94b28b6 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:01.789991 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55287f3c-6b22-4f05-af24-eb4ab94b28b6 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:01.792613 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55287f3c-6b22-4f05-af24-eb4ab94b28b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:01.841329 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-55287f3c-6b22-4f05-af24-eb4ab94b28b6 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:29:01.842550 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-55287f3c-6b22-4f05-af24-eb4ab94b28b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:01.847580 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7403b28e-35da-4c29-abea-e9d0f9ee281a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '027bccd998444dd7b946d3f06f267300'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:01.848490 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7403b28e-35da-4c29-abea-e9d0f9ee281a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '027bccd998444dd7b946d3f06f267300'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:01.849542 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7403b28e-35da-4c29-abea-e9d0f9ee281a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '027bccd998444dd7b946d3f06f267300'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:01.863213 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1017/2018] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:29:01 2022] DELETE /identity/v3/users/027bccd998444dd7b946d3f06f267300 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:29:01.931053 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1002/2019] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:29:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:29:01.939801 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802232fe-453e-4128-b991-15fc04a6c9e9 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:01.940366 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802232fe-453e-4128-b991-15fc04a6c9e9 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:01.940854 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802232fe-453e-4128-b991-15fc04a6c9e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:01.962751 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-802232fe-453e-4128-b991-15fc04a6c9e9 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:29:01.963991 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-802232fe-453e-4128-b991-15fc04a6c9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:02.044149 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1018/2020] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:29:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:29:02.044911 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55287f3c-6b22-4f05-af24-eb4ab94b28b6 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:02.055513 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55287f3c-6b22-4f05-af24-eb4ab94b28b6 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:02.060776 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93261b0b-7e15-41f3-95ef-c67926d09f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:02.062076 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93261b0b-7e15-41f3-95ef-c67926d09f90 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:02.062438 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93261b0b-7e15-41f3-95ef-c67926d09f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:02.062784 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93261b0b-7e15-41f3-95ef-c67926d09f90 admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:02.063520 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93261b0b-7e15-41f3-95ef-c67926d09f90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:29:02.063861 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93261b0b-7e15-41f3-95ef-c67926d09f90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:02.065827 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93261b0b-7e15-41f3-95ef-c67926d09f90 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:02.080825 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1003/2021] 10.222.0.24 () {58 vars in 1152 bytes} [Thu Apr 7 06:29:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:29:02.085018 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802232fe-453e-4128-b991-15fc04a6c9e9 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:02.095341 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802232fe-453e-4128-b991-15fc04a6c9e9 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:02.100360 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfcff64-5033-49f4-adad-0e90d2ecb048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:02.101097 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfcff64-5033-49f4-adad-0e90d2ecb048 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:02.101435 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfcff64-5033-49f4-adad-0e90d2ecb048 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:02.101777 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfcff64-5033-49f4-adad-0e90d2ecb048 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:02.102498 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfcff64-5033-49f4-adad-0e90d2ecb048 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:02.104472 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfcff64-5033-49f4-adad-0e90d2ecb048 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:02.187190 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93261b0b-7e15-41f3-95ef-c67926d09f90 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:02.189543 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-93261b0b-7e15-41f3-95ef-c67926d09f90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:02.203845 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93261b0b-7e15-41f3-95ef-c67926d09f90 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:02.209441 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ca3c7-081e-42ba-a3da-be6eed37f9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:02.210420 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ca3c7-081e-42ba-a3da-be6eed37f9e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:02.210712 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ca3c7-081e-42ba-a3da-be6eed37f9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:02.210988 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ca3c7-081e-42ba-a3da-be6eed37f9e1 admin admin] PATH_INFO: `/v3/projects/bb5d63cbfd0c410c8510a0d5df9d9b6d` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:02.212620 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3ca3c7-081e-42ba-a3da-be6eed37f9e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb5d63cbfd0c410c8510a0d5df9d9b6d)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:02.219162 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3ca3c7-081e-42ba-a3da-be6eed37f9e1 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:02.222367 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1019/2022] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:29:02 2022] POST /identity/v3/projects => generated 379 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:29:02.227460 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfcff64-5033-49f4-adad-0e90d2ecb048 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:02.298389 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfcff64-5033-49f4-adad-0e90d2ecb048 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:02.303437 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7dce2-30c9-4ed4-965e-66dc5be5e92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:02.304406 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7dce2-30c9-4ed4-965e-66dc5be5e92f admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:02.304691 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7dce2-30c9-4ed4-965e-66dc5be5e92f admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:02.305157 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7dce2-30c9-4ed4-965e-66dc5be5e92f admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:02.305853 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7dce2-30c9-4ed4-965e-66dc5be5e92f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:02.307832 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7dce2-30c9-4ed4-965e-66dc5be5e92f admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:02.365642 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-db3ca3c7-081e-42ba-a3da-be6eed37f9e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb5d63cbfd0c410c8510a0d5df9d9b6d', 'request_id': 'req-db3ca3c7-081e-42ba-a3da-be6eed37f9e1'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:02.375521 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-db3ca3c7-081e-42ba-a3da-be6eed37f9e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb5d63cbfd0c410c8510a0d5df9d9b6d', 'request_id': 'req-db3ca3c7-081e-42ba-a3da-be6eed37f9e1'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:02.447934 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-db3ca3c7-081e-42ba-a3da-be6eed37f9e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb5d63cbfd0c410c8510a0d5df9d9b6d', 'request_id': 'req-db3ca3c7-081e-42ba-a3da-be6eed37f9e1'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:02.462604 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-db3ca3c7-081e-42ba-a3da-be6eed37f9e1 admin admin] The token cache is being invalidate because project bb5d63cbfd0c410c8510a0d5df9d9b6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:29:02.467567 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-db3ca3c7-081e-42ba-a3da-be6eed37f9e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:02.467567 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-db3ca3c7-081e-42ba-a3da-be6eed37f9e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:02.467567 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1004/2023] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:29:02 2022] DELETE /identity/v3/projects/bb5d63cbfd0c410c8510a0d5df9d9b6d => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:29:02.470053 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ca3c7-081e-42ba-a3da-be6eed37f9e1 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:02.472271 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-db3ca3c7-081e-42ba-a3da-be6eed37f9e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:02.489844 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1020/2024] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:29:02 2022] POST /identity/v3/users => generated 290 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:29:02.493818 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7dce2-30c9-4ed4-965e-66dc5be5e92f admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:02.496526 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e8a7dce2-30c9-4ed4-965e-66dc5be5e92f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:02.513276 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7dce2-30c9-4ed4-965e-66dc5be5e92f admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:02.553912 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ca3c7-081e-42ba-a3da-be6eed37f9e1 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:02.559021 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6018588d-f953-40bd-995d-f315443895eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:02.560196 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018588d-f953-40bd-995d-f315443895eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:02.560640 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018588d-f953-40bd-995d-f315443895eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:02.561150 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018588d-f953-40bd-995d-f315443895eb admin admin] PATH_INFO: `/v3/users/b6a516cb3ec54d2189fea67143983b49` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:02.562374 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6018588d-f953-40bd-995d-f315443895eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6a516cb3ec54d2189fea67143983b49)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:02.564501 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6018588d-f953-40bd-995d-f315443895eb admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:02.580849 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d137ee-faba-4100-9f16-7d5225b79a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:02.581757 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d137ee-faba-4100-9f16-7d5225b79a62 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:02.582048 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d137ee-faba-4100-9f16-7d5225b79a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:02.582330 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d137ee-faba-4100-9f16-7d5225b79a62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:02.583153 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d137ee-faba-4100-9f16-7d5225b79a62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:02.584818 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d137ee-faba-4100-9f16-7d5225b79a62 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:02.598845 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1021/2025] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 07 06:29:02.600003 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d137ee-faba-4100-9f16-7d5225b79a62 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:02.611924 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d137ee-faba-4100-9f16-7d5225b79a62 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:02.619272 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d69478-c3a9-4cfc-8ead-c328c808fa5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:02.619993 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d69478-c3a9-4cfc-8ead-c328c808fa5f admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:02.620282 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d69478-c3a9-4cfc-8ead-c328c808fa5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:02.620553 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d69478-c3a9-4cfc-8ead-c328c808fa5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:02.621289 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d69478-c3a9-4cfc-8ead-c328c808fa5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:02.622882 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d69478-c3a9-4cfc-8ead-c328c808fa5f admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:02.634308 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1022/2026] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 07 06:29:02.638361 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d69478-c3a9-4cfc-8ead-c328c808fa5f admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:02.651638 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d69478-c3a9-4cfc-8ead-c328c808fa5f admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:02.656520 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2f8775-7d3c-4bc1-9b79-ac3bca87b222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:02.657644 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f8775-7d3c-4bc1-9b79-ac3bca87b222 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:02.658105 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f8775-7d3c-4bc1-9b79-ac3bca87b222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:02.658350 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f8775-7d3c-4bc1-9b79-ac3bca87b222 admin admin] PATH_INFO: `/v3/projects/016d4af803b6478d942ffb0de462f0d7/users/6ad7a67d57aa44be81525782643bd8c2/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:02.673697 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2f8775-7d3c-4bc1-9b79-ac3bca87b222 admin admin] RBAC: Authorizing `identity:create_grant(project_id=016d4af803b6478d942ffb0de462f0d7, user_id=6ad7a67d57aa44be81525782643bd8c2, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:02.676558 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2f8775-7d3c-4bc1-9b79-ac3bca87b222 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:02.791338 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1023/2027] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:29:02 2022] PUT /identity/v3/projects/016d4af803b6478d942ffb0de462f0d7/users/6ad7a67d57aa44be81525782643bd8c2/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:29:02.799066 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-6018588d-f953-40bd-995d-f315443895eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6a516cb3ec54d2189fea67143983b49'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:02.799790 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-6018588d-f953-40bd-995d-f315443895eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6a516cb3ec54d2189fea67143983b49'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:02.803713 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb1691c-403a-491c-8af0-bdef4167c202 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:02.804037 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb1691c-403a-491c-8af0-bdef4167c202 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:02.804312 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb1691c-403a-491c-8af0-bdef4167c202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:02.831457 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-3bb1691c-403a-491c-8af0-bdef4167c202 None None] MFA Rules not processed for user `6ad7a67d57aa44be81525782643bd8c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:29:02.832685 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-3bb1691c-403a-491c-8af0-bdef4167c202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:02.881625 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-6018588d-f953-40bd-995d-f315443895eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6a516cb3ec54d2189fea67143983b49'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:02.882512 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-6018588d-f953-40bd-995d-f315443895eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6a516cb3ec54d2189fea67143983b49'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:02.898376 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1024/2028] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:29:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:29:02.902711 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb1691c-403a-491c-8af0-bdef4167c202 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:02.904158 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-3bb1691c-403a-491c-8af0-bdef4167c202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:02.905403 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-6018588d-f953-40bd-995d-f315443895eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6a516cb3ec54d2189fea67143983b49'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:02.917407 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1005/2029] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:29:02 2022] DELETE /identity/v3/users/b6a516cb3ec54d2189fea67143983b49 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:29:02.967125 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb1691c-403a-491c-8af0-bdef4167c202 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:03.026063 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74cc857-885a-455d-89af-89d9c765abad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:03.026796 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74cc857-885a-455d-89af-89d9c765abad admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:03.027088 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74cc857-885a-455d-89af-89d9c765abad admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:03.027361 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74cc857-885a-455d-89af-89d9c765abad admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:03.028087 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74cc857-885a-455d-89af-89d9c765abad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:03.030051 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74cc857-885a-455d-89af-89d9c765abad admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:03.123515 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1025/2030] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:29:02 2022] POST /identity/v3/projects => generated 381 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:29:03.127996 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6018588d-f953-40bd-995d-f315443895eb admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:03.137606 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6018588d-f953-40bd-995d-f315443895eb admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:03.169730 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74cc857-885a-455d-89af-89d9c765abad admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:03.172005 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a74cc857-885a-455d-89af-89d9c765abad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:03.194740 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c7121f-3529-4a7d-ac86-0d7b211a6813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:03.195954 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7121f-3529-4a7d-ac86-0d7b211a6813 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:03.196501 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7121f-3529-4a7d-ac86-0d7b211a6813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:03.196808 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7121f-3529-4a7d-ac86-0d7b211a6813 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:03.197640 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c7121f-3529-4a7d-ac86-0d7b211a6813 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:03.199874 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c7121f-3529-4a7d-ac86-0d7b211a6813 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:03.239061 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74cc857-885a-455d-89af-89d9c765abad admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:03.243723 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a013eaec-09e2-40db-a1d7-c9a199245307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:03.244615 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013eaec-09e2-40db-a1d7-c9a199245307 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:03.244883 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013eaec-09e2-40db-a1d7-c9a199245307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:03.245153 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013eaec-09e2-40db-a1d7-c9a199245307 admin admin] PATH_INFO: `/v3/projects/7f66e76479bd4801bcc93691d58aeb3c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:03.246389 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a013eaec-09e2-40db-a1d7-c9a199245307 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f66e76479bd4801bcc93691d58aeb3c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:03.248320 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a013eaec-09e2-40db-a1d7-c9a199245307 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:03.273085 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1006/2031] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:29:03 2022] POST /identity/v3/users => generated 297 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:29:03.277057 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c7121f-3529-4a7d-ac86-0d7b211a6813 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:03.288649 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c7121f-3529-4a7d-ac86-0d7b211a6813 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:03.293664 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38226e0-8b27-4790-96e2-9bc0774050d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:03.294327 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38226e0-8b27-4790-96e2-9bc0774050d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:03.294612 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38226e0-8b27-4790-96e2-9bc0774050d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:03.294891 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38226e0-8b27-4790-96e2-9bc0774050d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:03.295620 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38226e0-8b27-4790-96e2-9bc0774050d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:03.297863 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38226e0-8b27-4790-96e2-9bc0774050d5 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:03.307692 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1007/2032] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:29:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 07 06:29:03.312497 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38226e0-8b27-4790-96e2-9bc0774050d5 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:03.321769 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38226e0-8b27-4790-96e2-9bc0774050d5 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:03.327915 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704fbcaa-1307-40e6-bfa4-ed9f6f11dc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:03.327915 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fbcaa-1307-40e6-bfa4-ed9f6f11dc30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:03.327915 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fbcaa-1307-40e6-bfa4-ed9f6f11dc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:03.328185 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fbcaa-1307-40e6-bfa4-ed9f6f11dc30 admin admin] PATH_INFO: `/v3/projects/848395712485487e98b592c13ad8fd22/users/0b9e241009804b27bf46e10c768cd9fa/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:03.342161 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704fbcaa-1307-40e6-bfa4-ed9f6f11dc30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=848395712485487e98b592c13ad8fd22, user_id=0b9e241009804b27bf46e10c768cd9fa, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:03.345443 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704fbcaa-1307-40e6-bfa4-ed9f6f11dc30 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:03.568365 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1008/2033] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:29:03 2022] PUT /identity/v3/projects/848395712485487e98b592c13ad8fd22/users/0b9e241009804b27bf46e10c768cd9fa/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:29:03.572186 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704fbcaa-1307-40e6-bfa4-ed9f6f11dc30 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:03.584216 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a013eaec-09e2-40db-a1d7-c9a199245307 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f66e76479bd4801bcc93691d58aeb3c', 'request_id': 'req-a013eaec-09e2-40db-a1d7-c9a199245307'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:03.593863 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a013eaec-09e2-40db-a1d7-c9a199245307 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f66e76479bd4801bcc93691d58aeb3c', 'request_id': 'req-a013eaec-09e2-40db-a1d7-c9a199245307'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:03.634632 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704fbcaa-1307-40e6-bfa4-ed9f6f11dc30 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:03.704549 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f7adf-672f-4225-bcd9-26ae2d352df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:03.705238 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f7adf-672f-4225-bcd9-26ae2d352df9 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:03.705529 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f7adf-672f-4225-bcd9-26ae2d352df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:03.705816 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f7adf-672f-4225-bcd9-26ae2d352df9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:03.706549 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4f7adf-672f-4225-bcd9-26ae2d352df9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:03.708292 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4f7adf-672f-4225-bcd9-26ae2d352df9 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:03.719279 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1009/2034] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:29:03 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 07 06:29:03.723316 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f7adf-672f-4225-bcd9-26ae2d352df9 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:03.732912 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f7adf-672f-4225-bcd9-26ae2d352df9 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:03.738181 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac43e322-847c-42d3-a579-b9d6b38b1117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:03.739301 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43e322-847c-42d3-a579-b9d6b38b1117 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:03.739586 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43e322-847c-42d3-a579-b9d6b38b1117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:03.739900 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43e322-847c-42d3-a579-b9d6b38b1117 admin admin] PATH_INFO: `/v3/projects/848395712485487e98b592c13ad8fd22/users/0b9e241009804b27bf46e10c768cd9fa/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:03.741949 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac43e322-847c-42d3-a579-b9d6b38b1117 admin admin] RBAC: Authorizing `identity:create_grant(project_id=848395712485487e98b592c13ad8fd22, user_id=0b9e241009804b27bf46e10c768cd9fa, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:03.744906 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac43e322-847c-42d3-a579-b9d6b38b1117 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:03.750255 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a013eaec-09e2-40db-a1d7-c9a199245307 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f66e76479bd4801bcc93691d58aeb3c', 'request_id': 'req-a013eaec-09e2-40db-a1d7-c9a199245307'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:03.765705 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1010/2035] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:29:03 2022] PUT /identity/v3/projects/848395712485487e98b592c13ad8fd22/users/0b9e241009804b27bf46e10c768cd9fa/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:29:03.769898 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa58b5-a302-4c29-8aeb-4ea8ebb4edad None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:03.769898 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa58b5-a302-4c29-8aeb-4ea8ebb4edad None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:03.769898 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa58b5-a302-4c29-8aeb-4ea8ebb4edad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:03.770204 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a013eaec-09e2-40db-a1d7-c9a199245307 admin admin] The token cache is being invalidate because project 7f66e76479bd4801bcc93691d58aeb3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:29:03.770204 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a013eaec-09e2-40db-a1d7-c9a199245307 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:03.771060 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a013eaec-09e2-40db-a1d7-c9a199245307 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:03.773451 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1026/2036] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:29:03 2022] DELETE /identity/v3/projects/7f66e76479bd4801bcc93691d58aeb3c => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:29:03.778399 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecbcbb6-d17d-40d4-868f-4fe692e248c2 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:03.779034 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecbcbb6-d17d-40d4-868f-4fe692e248c2 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:03.779476 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecbcbb6-d17d-40d4-868f-4fe692e248c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:03.803624 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-aecbcbb6-d17d-40d4-868f-4fe692e248c2 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:29:03.805401 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-aecbcbb6-d17d-40d4-868f-4fe692e248c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:03.810617 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-40fa58b5-a302-4c29-8aeb-4ea8ebb4edad None None] MFA Rules not processed for user `0b9e241009804b27bf46e10c768cd9fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:29:03.812095 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-40fa58b5-a302-4c29-8aeb-4ea8ebb4edad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:03.874297 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1027/2037] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:29:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:29:03.882246 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8330a80-b179-4ad5-908a-0258d55b8daf None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:03.882556 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8330a80-b179-4ad5-908a-0258d55b8daf None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:03.882911 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8330a80-b179-4ad5-908a-0258d55b8daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:03.899815 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1011/2038] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:29:03 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:29:03.909748 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-f8330a80-b179-4ad5-908a-0258d55b8daf None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:29:03.910741 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f8330a80-b179-4ad5-908a-0258d55b8daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:03.914838 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa58b5-a302-4c29-8aeb-4ea8ebb4edad None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:03.916897 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-40fa58b5-a302-4c29-8aeb-4ea8ebb4edad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:03.950892 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1028/2039] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:29:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:29:03.956491 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8330a80-b179-4ad5-908a-0258d55b8daf None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:03.974361 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8330a80-b179-4ad5-908a-0258d55b8daf None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:03.980510 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d7ae6d-146b-431a-90e4-81f8ed4b0bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:03.981164 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7ae6d-146b-431a-90e4-81f8ed4b0bea admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:03.981477 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7ae6d-146b-431a-90e4-81f8ed4b0bea admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:03.981756 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7ae6d-146b-431a-90e4-81f8ed4b0bea admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:03.982522 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d7ae6d-146b-431a-90e4-81f8ed4b0bea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:29:03.982876 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d7ae6d-146b-431a-90e4-81f8ed4b0bea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:03.985145 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d7ae6d-146b-431a-90e4-81f8ed4b0bea admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:04.007792 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa58b5-a302-4c29-8aeb-4ea8ebb4edad None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:04.009039 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1029/2040] 10.222.0.24 () {58 vars in 1152 bytes} [Thu Apr 7 06:29:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:29:04.010450 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d7ae6d-146b-431a-90e4-81f8ed4b0bea admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:04.013398 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a639874f-93dd-4b39-a91e-073a2a454560 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:04.015252 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639874f-93dd-4b39-a91e-073a2a454560 service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:04.015628 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639874f-93dd-4b39-a91e-073a2a454560 service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:04.015965 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639874f-93dd-4b39-a91e-073a2a454560 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:04.023383 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d7ae6d-146b-431a-90e4-81f8ed4b0bea admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:04.035895 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac4c6e-98b7-4296-baed-e620c51bbf59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:04.036280 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a639874f-93dd-4b39-a91e-073a2a454560 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:04.036375 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac4c6e-98b7-4296-baed-e620c51bbf59 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:04.036375 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac4c6e-98b7-4296-baed-e620c51bbf59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:04.036375 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac4c6e-98b7-4296-baed-e620c51bbf59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:04.036633 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a639874f-93dd-4b39-a91e-073a2a454560 service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:04.036719 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ac4c6e-98b7-4296-baed-e620c51bbf59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:04.036719 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ac4c6e-98b7-4296-baed-e620c51bbf59 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:04.051913 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1012/2041] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:29:03 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:29:04.175866 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1030/2042] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:29:04 2022] POST /identity/v3/projects => generated 361 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:29:04.178478 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a639874f-93dd-4b39-a91e-073a2a454560 service cinder] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:04.197584 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a639874f-93dd-4b39-a91e-073a2a454560 service cinder] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:04.266098 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011669eb-89b5-4e9c-84c6-3c193380b8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:04.267392 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011669eb-89b5-4e9c-84c6-3c193380b8e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:04.267681 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011669eb-89b5-4e9c-84c6-3c193380b8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:04.268047 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011669eb-89b5-4e9c-84c6-3c193380b8e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:04.269016 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011669eb-89b5-4e9c-84c6-3c193380b8e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:04.271119 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011669eb-89b5-4e9c-84c6-3c193380b8e6 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:04.406867 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac4c6e-98b7-4296-baed-e620c51bbf59 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:04.411974 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1013/2043] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:29:04 2022] POST /identity/v3/users => generated 281 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:29:04.414387 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b4ac4c6e-98b7-4296-baed-e620c51bbf59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:04.414500 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011669eb-89b5-4e9c-84c6-3c193380b8e6 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:04.426045 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac4c6e-98b7-4296-baed-e620c51bbf59 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:04.428301 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011669eb-89b5-4e9c-84c6-3c193380b8e6 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:04.436045 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3223dc4b-4440-46e0-8b1d-0ca1d31659aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:04.438154 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223dc4b-4440-46e0-8b1d-0ca1d31659aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:04.438503 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223dc4b-4440-46e0-8b1d-0ca1d31659aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:04.439197 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee8833c-0b7a-471e-9f72-197e462650be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:04.440440 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8833c-0b7a-471e-9f72-197e462650be admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:04.440440 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8833c-0b7a-471e-9f72-197e462650be admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:04.441075 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223dc4b-4440-46e0-8b1d-0ca1d31659aa admin admin] PATH_INFO: `/v3/users/21c1c527a3c345c6b7f0783a9b5341ff` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:04.441746 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8833c-0b7a-471e-9f72-197e462650be admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:04.444131 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee8833c-0b7a-471e-9f72-197e462650be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:04.444918 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3223dc4b-4440-46e0-8b1d-0ca1d31659aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=21c1c527a3c345c6b7f0783a9b5341ff)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:04.445847 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee8833c-0b7a-471e-9f72-197e462650be admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:04.447488 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3223dc4b-4440-46e0-8b1d-0ca1d31659aa admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:04.460057 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1014/2044] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:29:04 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:29:04.464132 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee8833c-0b7a-471e-9f72-197e462650be admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:04.475322 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee8833c-0b7a-471e-9f72-197e462650be admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:04.480396 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14904b41-f299-407c-88a1-b4f146d00fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:04.481178 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14904b41-f299-407c-88a1-b4f146d00fd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:04.481686 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14904b41-f299-407c-88a1-b4f146d00fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:04.482008 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14904b41-f299-407c-88a1-b4f146d00fd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:04.482808 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14904b41-f299-407c-88a1-b4f146d00fd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:04.485079 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14904b41-f299-407c-88a1-b4f146d00fd9 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:04.495534 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1015/2045] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:29:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:29:04.500177 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14904b41-f299-407c-88a1-b4f146d00fd9 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:04.510655 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14904b41-f299-407c-88a1-b4f146d00fd9 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:04.516603 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339866a8-4ade-4d83-8847-2e36f8d47b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:04.517573 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339866a8-4ade-4d83-8847-2e36f8d47b75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:04.517936 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339866a8-4ade-4d83-8847-2e36f8d47b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:04.518286 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339866a8-4ade-4d83-8847-2e36f8d47b75 admin admin] PATH_INFO: `/v3/projects/18d1a24692564eeba60bff75d7242bf7/users/6d2ae99d7d894843b9f872230366804f/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:04.540124 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339866a8-4ade-4d83-8847-2e36f8d47b75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18d1a24692564eeba60bff75d7242bf7, user_id=6d2ae99d7d894843b9f872230366804f, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:04.542923 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339866a8-4ade-4d83-8847-2e36f8d47b75 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:04.669977 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1016/2046] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:29:04 2022] PUT /identity/v3/projects/18d1a24692564eeba60bff75d7242bf7/users/6d2ae99d7d894843b9f872230366804f/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:29:04.682018 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5eef9-7aae-4d4d-898f-769774bf2bc0 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:04.682313 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5eef9-7aae-4d4d-898f-769774bf2bc0 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:04.682855 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5eef9-7aae-4d4d-898f-769774bf2bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:04.722986 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3223dc4b-4440-46e0-8b1d-0ca1d31659aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21c1c527a3c345c6b7f0783a9b5341ff'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:04.728898 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-d5f5eef9-7aae-4d4d-898f-769774bf2bc0 None None] MFA Rules not processed for user `6d2ae99d7d894843b9f872230366804f`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:29:04.730894 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d5f5eef9-7aae-4d4d-898f-769774bf2bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:04.747629 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3223dc4b-4440-46e0-8b1d-0ca1d31659aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21c1c527a3c345c6b7f0783a9b5341ff'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:04.814149 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3223dc4b-4440-46e0-8b1d-0ca1d31659aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21c1c527a3c345c6b7f0783a9b5341ff'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:04.814769 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3223dc4b-4440-46e0-8b1d-0ca1d31659aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21c1c527a3c345c6b7f0783a9b5341ff'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:04.815376 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3223dc4b-4440-46e0-8b1d-0ca1d31659aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21c1c527a3c345c6b7f0783a9b5341ff'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:04.837835 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1031/2047] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:29:04 2022] DELETE /identity/v3/users/21c1c527a3c345c6b7f0783a9b5341ff => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:29:04.839517 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3223dc4b-4440-46e0-8b1d-0ca1d31659aa admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:04.841524 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-3223dc4b-4440-46e0-8b1d-0ca1d31659aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:04.854006 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1017/2048] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:29:04 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:29:04.870674 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0c318-b232-4c81-b75a-700de95dafeb None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:04.870674 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0c318-b232-4c81-b75a-700de95dafeb None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:04.870674 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0c318-b232-4c81-b75a-700de95dafeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:04.900509 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-15f0c318-b232-4c81-b75a-700de95dafeb None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:29:04.901894 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-15f0c318-b232-4c81-b75a-700de95dafeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:04.991039 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3223dc4b-4440-46e0-8b1d-0ca1d31659aa admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:04.998753 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1018/2049] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:29:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:29:04.999485 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f0c318-b232-4c81-b75a-700de95dafeb None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:05.001441 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-15f0c318-b232-4c81-b75a-700de95dafeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:05.012456 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a33a90-13e3-4bc2-a692-fc33e428c2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:05.013574 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a33a90-13e3-4bc2-a692-fc33e428c2ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:05.013865 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a33a90-13e3-4bc2-a692-fc33e428c2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:05.014147 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a33a90-13e3-4bc2-a692-fc33e428c2ac admin admin] PATH_INFO: `/v3/users/6ad7a67d57aa44be81525782643bd8c2` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:05.017037 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a33a90-13e3-4bc2-a692-fc33e428c2ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ad7a67d57aa44be81525782643bd8c2)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:05.018982 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a33a90-13e3-4bc2-a692-fc33e428c2ac admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:05.074841 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f0c318-b232-4c81-b75a-700de95dafeb None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:05.080980 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9edd91-1556-4cd7-b51a-09f84d6cf138 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:05.082841 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9edd91-1556-4cd7-b51a-09f84d6cf138 service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:05.083205 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9edd91-1556-4cd7-b51a-09f84d6cf138 service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:05.083541 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9edd91-1556-4cd7-b51a-09f84d6cf138 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:05.151288 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9edd91-1556-4cd7-b51a-09f84d6cf138 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:05.152915 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9edd91-1556-4cd7-b51a-09f84d6cf138 service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:05.164453 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1019/2050] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:29:04 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:29:05.165764 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9edd91-1556-4cd7-b51a-09f84d6cf138 service cinder] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:05.170998 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-1f9edd91-1556-4cd7-b51a-09f84d6cf138 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:05.237614 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9edd91-1556-4cd7-b51a-09f84d6cf138 service cinder] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:05.245754 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d630caef-92aa-498d-981f-20438eaee2dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:05.246750 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630caef-92aa-498d-981f-20438eaee2dc service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:05.247086 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630caef-92aa-498d-981f-20438eaee2dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:05.247373 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630caef-92aa-498d-981f-20438eaee2dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:05.259788 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d630caef-92aa-498d-981f-20438eaee2dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:05.261795 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d630caef-92aa-498d-981f-20438eaee2dc service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:05.276693 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1020/2051] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:29:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:29:05.278321 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d630caef-92aa-498d-981f-20438eaee2dc service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:05.280500 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d630caef-92aa-498d-981f-20438eaee2dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:05.283181 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-c3a33a90-13e3-4bc2-a692-fc33e428c2ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ad7a67d57aa44be81525782643bd8c2'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:05.301706 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-c3a33a90-13e3-4bc2-a692-fc33e428c2ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ad7a67d57aa44be81525782643bd8c2'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:05.302256 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d630caef-92aa-498d-981f-20438eaee2dc service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:05.309369 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb82e1-f621-4f99-8a89-b2f6dee3dcde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:05.310315 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb82e1-f621-4f99-8a89-b2f6dee3dcde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:05.310652 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb82e1-f621-4f99-8a89-b2f6dee3dcde admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:05.316477 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb82e1-f621-4f99-8a89-b2f6dee3dcde admin admin] PATH_INFO: `/v3/users/6d2ae99d7d894843b9f872230366804f` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:05.316477 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fb82e1-f621-4f99-8a89-b2f6dee3dcde admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d2ae99d7d894843b9f872230366804f)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:05.316477 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fb82e1-f621-4f99-8a89-b2f6dee3dcde admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:05.425709 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-c3a33a90-13e3-4bc2-a692-fc33e428c2ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ad7a67d57aa44be81525782643bd8c2'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:05.427084 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-c3a33a90-13e3-4bc2-a692-fc33e428c2ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ad7a67d57aa44be81525782643bd8c2'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:05.427940 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-c3a33a90-13e3-4bc2-a692-fc33e428c2ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ad7a67d57aa44be81525782643bd8c2'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:05.445142 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1032/2052] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:29:04 2022] DELETE /identity/v3/users/6ad7a67d57aa44be81525782643bd8c2 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:29:05.450965 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e048b8b-847b-477b-a305-f594e2347ceb None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:05.451540 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e048b8b-847b-477b-a305-f594e2347ceb None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:05.452479 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e048b8b-847b-477b-a305-f594e2347ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:05.472276 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-5e048b8b-847b-477b-a305-f594e2347ceb None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:29:05.473751 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-5e048b8b-847b-477b-a305-f594e2347ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:05.547203 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1033/2053] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:29:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:29:05.556789 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e048b8b-847b-477b-a305-f594e2347ceb None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:05.558140 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-5e048b8b-847b-477b-a305-f594e2347ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:05.617421 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e048b8b-847b-477b-a305-f594e2347ceb None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:05.621222 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea0565-9560-4383-a05b-aa9fdc739baf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:05.621895 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea0565-9560-4383-a05b-aa9fdc739baf service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:05.622180 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea0565-9560-4383-a05b-aa9fdc739baf service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:05.622465 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea0565-9560-4383-a05b-aa9fdc739baf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:05.641120 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ea0565-9560-4383-a05b-aa9fdc739baf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:05.643027 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ea0565-9560-4383-a05b-aa9fdc739baf service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:05.653547 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-f9fb82e1-f621-4f99-8a89-b2f6dee3dcde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d2ae99d7d894843b9f872230366804f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:05.655942 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-f9fb82e1-f621-4f99-8a89-b2f6dee3dcde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d2ae99d7d894843b9f872230366804f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:05.664626 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1034/2054] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:29:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 07 06:29:05.761768 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-f9fb82e1-f621-4f99-8a89-b2f6dee3dcde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d2ae99d7d894843b9f872230366804f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:05.763426 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-f9fb82e1-f621-4f99-8a89-b2f6dee3dcde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d2ae99d7d894843b9f872230366804f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:05.786940 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-f9fb82e1-f621-4f99-8a89-b2f6dee3dcde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d2ae99d7d894843b9f872230366804f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:05.805706 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1021/2055] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:29:05 2022] DELETE /identity/v3/users/6d2ae99d7d894843b9f872230366804f => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:29:05.814906 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e61199-6a5b-4a6b-8181-c76013ed3496 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:05.816000 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e61199-6a5b-4a6b-8181-c76013ed3496 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:05.816524 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e61199-6a5b-4a6b-8181-c76013ed3496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:05.839051 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-84e61199-6a5b-4a6b-8181-c76013ed3496 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:29:05.840726 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-84e61199-6a5b-4a6b-8181-c76013ed3496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:05.935866 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1035/2056] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:29:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:29:05.945416 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb82e1-f621-4f99-8a89-b2f6dee3dcde admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:05.947248 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-f9fb82e1-f621-4f99-8a89-b2f6dee3dcde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:06.023533 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb82e1-f621-4f99-8a89-b2f6dee3dcde admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:06.023533 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88262230-3bee-47c4-9e6f-9a84dc00c063 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:06.023533 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88262230-3bee-47c4-9e6f-9a84dc00c063 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:06.023533 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88262230-3bee-47c4-9e6f-9a84dc00c063 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:06.024215 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88262230-3bee-47c4-9e6f-9a84dc00c063 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:06.037467 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88262230-3bee-47c4-9e6f-9a84dc00c063 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:06.049877 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e61199-6a5b-4a6b-8181-c76013ed3496 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:06.051520 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-84e61199-6a5b-4a6b-8181-c76013ed3496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:06.060883 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88262230-3bee-47c4-9e6f-9a84dc00c063 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:06.086443 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1022/2057] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:29:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:29:06.089774 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e61199-6a5b-4a6b-8181-c76013ed3496 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:06.107688 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaec1ed-8cdc-4fc1-9b1c-17d8da528c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:06.108732 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaec1ed-8cdc-4fc1-9b1c-17d8da528c4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:06.109065 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaec1ed-8cdc-4fc1-9b1c-17d8da528c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:06.109347 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaec1ed-8cdc-4fc1-9b1c-17d8da528c4b admin admin] PATH_INFO: `/v3/projects/22c2aa9950c449a6af74f7aca65560d2` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:06.110620 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaec1ed-8cdc-4fc1-9b1c-17d8da528c4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=22c2aa9950c449a6af74f7aca65560d2)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:06.115324 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaec1ed-8cdc-4fc1-9b1c-17d8da528c4b admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:06.480668 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-0eaec1ed-8cdc-4fc1-9b1c-17d8da528c4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22c2aa9950c449a6af74f7aca65560d2', 'request_id': 'req-0eaec1ed-8cdc-4fc1-9b1c-17d8da528c4b'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:06.515912 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-0eaec1ed-8cdc-4fc1-9b1c-17d8da528c4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22c2aa9950c449a6af74f7aca65560d2', 'request_id': 'req-0eaec1ed-8cdc-4fc1-9b1c-17d8da528c4b'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:06.548805 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88262230-3bee-47c4-9e6f-9a84dc00c063 service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:06.556361 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-88262230-3bee-47c4-9e6f-9a84dc00c063 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:06.563455 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88262230-3bee-47c4-9e6f-9a84dc00c063 service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:06.647924 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-0eaec1ed-8cdc-4fc1-9b1c-17d8da528c4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22c2aa9950c449a6af74f7aca65560d2', 'request_id': 'req-0eaec1ed-8cdc-4fc1-9b1c-17d8da528c4b'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:06.668448 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-0eaec1ed-8cdc-4fc1-9b1c-17d8da528c4b admin admin] The token cache is being invalidate because project 22c2aa9950c449a6af74f7aca65560d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:29:06.673009 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0959f43-b9bf-4129-b970-1869f122c068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:06.673194 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-0eaec1ed-8cdc-4fc1-9b1c-17d8da528c4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:06.673194 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-0eaec1ed-8cdc-4fc1-9b1c-17d8da528c4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:06.673395 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0959f43-b9bf-4129-b970-1869f122c068 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:06.673395 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0959f43-b9bf-4129-b970-1869f122c068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:06.673696 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0959f43-b9bf-4129-b970-1869f122c068 admin admin] PATH_INFO: `/v3/projects/016d4af803b6478d942ffb0de462f0d7` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:06.675449 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0959f43-b9bf-4129-b970-1869f122c068 admin admin] RBAC: Authorizing `identity:delete_project(project_id=016d4af803b6478d942ffb0de462f0d7)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:06.675725 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1036/2058] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:29:06 2022] DELETE /identity/v3/projects/22c2aa9950c449a6af74f7aca65560d2 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:29:06.678963 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0959f43-b9bf-4129-b970-1869f122c068 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:06.679211 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaec1ed-8cdc-4fc1-9b1c-17d8da528c4b admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:06.681112 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-0eaec1ed-8cdc-4fc1-9b1c-17d8da528c4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:06.702298 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaec1ed-8cdc-4fc1-9b1c-17d8da528c4b admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:06.717344 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa2002-ae09-46ba-a7dc-6d58c0c701ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:06.719568 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa2002-ae09-46ba-a7dc-6d58c0c701ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:06.719890 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa2002-ae09-46ba-a7dc-6d58c0c701ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:06.720212 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa2002-ae09-46ba-a7dc-6d58c0c701ca admin admin] PATH_INFO: `/v3/users/c12c8cb597424ee7bc02aa49051e5077` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:06.721613 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aa2002-ae09-46ba-a7dc-6d58c0c701ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=c12c8cb597424ee7bc02aa49051e5077)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:06.723515 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aa2002-ae09-46ba-a7dc-6d58c0c701ca admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:06.903809 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-b0959f43-b9bf-4129-b970-1869f122c068 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '016d4af803b6478d942ffb0de462f0d7', 'request_id': 'req-b0959f43-b9bf-4129-b970-1869f122c068'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:06.914283 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-b0959f43-b9bf-4129-b970-1869f122c068 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '016d4af803b6478d942ffb0de462f0d7', 'request_id': 'req-b0959f43-b9bf-4129-b970-1869f122c068'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:07.024737 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-b0959f43-b9bf-4129-b970-1869f122c068 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '016d4af803b6478d942ffb0de462f0d7', 'request_id': 'req-b0959f43-b9bf-4129-b970-1869f122c068'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:07.030943 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-40aa2002-ae09-46ba-a7dc-6d58c0c701ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c12c8cb597424ee7bc02aa49051e5077'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:07.046524 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-b0959f43-b9bf-4129-b970-1869f122c068 admin admin] The token cache is being invalidate because project 016d4af803b6478d942ffb0de462f0d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:29:07.047346 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-b0959f43-b9bf-4129-b970-1869f122c068 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:07.048065 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-b0959f43-b9bf-4129-b970-1869f122c068 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:07.048380 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-40aa2002-ae09-46ba-a7dc-6d58c0c701ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c12c8cb597424ee7bc02aa49051e5077'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:07.050040 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1023/2059] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:29:06 2022] DELETE /identity/v3/projects/016d4af803b6478d942ffb0de462f0d7 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:29:07.050921 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0959f43-b9bf-4129-b970-1869f122c068 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:07.054208 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b0959f43-b9bf-4129-b970-1869f122c068 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:07.122056 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-40aa2002-ae09-46ba-a7dc-6d58c0c701ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c12c8cb597424ee7bc02aa49051e5077'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:07.122680 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-40aa2002-ae09-46ba-a7dc-6d58c0c701ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c12c8cb597424ee7bc02aa49051e5077'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:07.123299 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-40aa2002-ae09-46ba-a7dc-6d58c0c701ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c12c8cb597424ee7bc02aa49051e5077'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:07.141909 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0959f43-b9bf-4129-b970-1869f122c068 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:07.142899 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1037/2060] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:29:06 2022] DELETE /identity/v3/users/c12c8cb597424ee7bc02aa49051e5077 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:29:07.144083 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa2002-ae09-46ba-a7dc-6d58c0c701ca admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:07.145791 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-40aa2002-ae09-46ba-a7dc-6d58c0c701ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:07.237623 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c39c04-4303-46f3-b28d-b1286bdee023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:07.239077 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c39c04-4303-46f3-b28d-b1286bdee023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:07.240143 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c39c04-4303-46f3-b28d-b1286bdee023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:07.246529 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c39c04-4303-46f3-b28d-b1286bdee023 admin admin] PATH_INFO: `/v3/projects/18d1a24692564eeba60bff75d7242bf7` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:07.246529 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c39c04-4303-46f3-b28d-b1286bdee023 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18d1a24692564eeba60bff75d7242bf7)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:07.246529 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c39c04-4303-46f3-b28d-b1286bdee023 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:07.261428 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa2002-ae09-46ba-a7dc-6d58c0c701ca admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:07.266981 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6576885b-3f0c-4084-ab0b-61075259c10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:07.267908 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576885b-3f0c-4084-ab0b-61075259c10d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:07.268757 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576885b-3f0c-4084-ab0b-61075259c10d admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:07.268757 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576885b-3f0c-4084-ab0b-61075259c10d admin admin] PATH_INFO: `/v3/users/0b9e241009804b27bf46e10c768cd9fa` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:07.270305 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6576885b-3f0c-4084-ab0b-61075259c10d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b9e241009804b27bf46e10c768cd9fa)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:07.272499 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6576885b-3f0c-4084-ab0b-61075259c10d admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:07.350928 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-86c39c04-4303-46f3-b28d-b1286bdee023 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18d1a24692564eeba60bff75d7242bf7', 'request_id': 'req-86c39c04-4303-46f3-b28d-b1286bdee023'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:07.356264 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-86c39c04-4303-46f3-b28d-b1286bdee023 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18d1a24692564eeba60bff75d7242bf7', 'request_id': 'req-86c39c04-4303-46f3-b28d-b1286bdee023'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:07.448252 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-86c39c04-4303-46f3-b28d-b1286bdee023 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18d1a24692564eeba60bff75d7242bf7', 'request_id': 'req-86c39c04-4303-46f3-b28d-b1286bdee023'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:07.460532 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-86c39c04-4303-46f3-b28d-b1286bdee023 admin admin] The token cache is being invalidate because project 18d1a24692564eeba60bff75d7242bf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:29:07.460934 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-86c39c04-4303-46f3-b28d-b1286bdee023 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:07.463594 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-86c39c04-4303-46f3-b28d-b1286bdee023 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:07.482908 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1024/2061] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:29:07 2022] DELETE /identity/v3/projects/18d1a24692564eeba60bff75d7242bf7 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:29:07.495567 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e474a9-1d43-4278-a6a9-b7ba656b580e None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:07.495567 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e474a9-1d43-4278-a6a9-b7ba656b580e None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:07.495567 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e474a9-1d43-4278-a6a9-b7ba656b580e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:07.533527 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-12e474a9-1d43-4278-a6a9-b7ba656b580e None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:29:07.536549 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-12e474a9-1d43-4278-a6a9-b7ba656b580e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:07.547681 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6576885b-3f0c-4084-ab0b-61075259c10d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b9e241009804b27bf46e10c768cd9fa'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:07.569207 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6576885b-3f0c-4084-ab0b-61075259c10d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b9e241009804b27bf46e10c768cd9fa'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:07.641623 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1025/2062] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:29:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:29:07.652622 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d8e8d-cfa1-456f-8876-607578b318d7 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:07.652952 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d8e8d-cfa1-456f-8876-607578b318d7 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:07.653235 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d8e8d-cfa1-456f-8876-607578b318d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:07.687336 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-832d8e8d-cfa1-456f-8876-607578b318d7 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:29:07.688924 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-832d8e8d-cfa1-456f-8876-607578b318d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:07.704812 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6576885b-3f0c-4084-ab0b-61075259c10d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b9e241009804b27bf46e10c768cd9fa'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:07.704812 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6576885b-3f0c-4084-ab0b-61075259c10d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b9e241009804b27bf46e10c768cd9fa'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:07.704812 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6576885b-3f0c-4084-ab0b-61075259c10d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b9e241009804b27bf46e10c768cd9fa'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:07.706974 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1026/2063] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:29:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:29:07.708144 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d8e8d-cfa1-456f-8876-607578b318d7 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:07.716667 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1038/2064] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:29:07 2022] DELETE /identity/v3/users/0b9e241009804b27bf46e10c768cd9fa => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:29:07.727174 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d8e8d-cfa1-456f-8876-607578b318d7 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:07.809554 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c5670d-2a62-4a4b-8e2f-4ec563546796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:07.810177 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5670d-2a62-4a4b-8e2f-4ec563546796 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:07.810458 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5670d-2a62-4a4b-8e2f-4ec563546796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:07.810739 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5670d-2a62-4a4b-8e2f-4ec563546796 admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:07.811502 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c5670d-2a62-4a4b-8e2f-4ec563546796 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:29:07.811927 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c5670d-2a62-4a4b-8e2f-4ec563546796 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:07.813564 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c5670d-2a62-4a4b-8e2f-4ec563546796 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:07.830802 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1027/2065] 10.222.0.24 () {58 vars in 1152 bytes} [Thu Apr 7 06:29:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:29:07.832156 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6576885b-3f0c-4084-ab0b-61075259c10d admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:07.844920 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6576885b-3f0c-4084-ab0b-61075259c10d admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:07.845715 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c5670d-2a62-4a4b-8e2f-4ec563546796 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:07.848362 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-18c5670d-2a62-4a4b-8e2f-4ec563546796 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:07.856944 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47056e9-9d7a-4341-95c1-bf0c489d79f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:07.858030 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47056e9-9d7a-4341-95c1-bf0c489d79f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:07.858540 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47056e9-9d7a-4341-95c1-bf0c489d79f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:07.859141 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47056e9-9d7a-4341-95c1-bf0c489d79f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:07.860248 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47056e9-9d7a-4341-95c1-bf0c489d79f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:07.861669 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c5670d-2a62-4a4b-8e2f-4ec563546796 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:07.865171 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47056e9-9d7a-4341-95c1-bf0c489d79f4 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:07.868442 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5806fa-7c26-416b-bfbb-4232650d8c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:07.877277 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5806fa-7c26-416b-bfbb-4232650d8c56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:07.877589 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5806fa-7c26-416b-bfbb-4232650d8c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:07.882204 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5806fa-7c26-416b-bfbb-4232650d8c56 admin admin] PATH_INFO: `/v3/projects/c6efd89bc5194b36b05112854b35e360` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:07.885552 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5806fa-7c26-416b-bfbb-4232650d8c56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6efd89bc5194b36b05112854b35e360)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:07.887392 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5806fa-7c26-416b-bfbb-4232650d8c56 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:08.052511 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1039/2066] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:29:07 2022] POST /identity/v3/projects => generated 381 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:29:08.056655 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47056e9-9d7a-4341-95c1-bf0c489d79f4 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:08.082621 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-fe5806fa-7c26-416b-bfbb-4232650d8c56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6efd89bc5194b36b05112854b35e360', 'request_id': 'req-fe5806fa-7c26-416b-bfbb-4232650d8c56'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:08.096991 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-fe5806fa-7c26-416b-bfbb-4232650d8c56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6efd89bc5194b36b05112854b35e360', 'request_id': 'req-fe5806fa-7c26-416b-bfbb-4232650d8c56'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:08.151846 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47056e9-9d7a-4341-95c1-bf0c489d79f4 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:08.159040 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade8efd-2e75-4d02-8a45-f00d26c8dfbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:08.159768 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade8efd-2e75-4d02-8a45-f00d26c8dfbd admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:08.160325 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade8efd-2e75-4d02-8a45-f00d26c8dfbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:08.160903 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade8efd-2e75-4d02-8a45-f00d26c8dfbd admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:08.161528 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ade8efd-2e75-4d02-8a45-f00d26c8dfbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:08.163646 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ade8efd-2e75-4d02-8a45-f00d26c8dfbd admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:08.196437 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-fe5806fa-7c26-416b-bfbb-4232650d8c56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6efd89bc5194b36b05112854b35e360', 'request_id': 'req-fe5806fa-7c26-416b-bfbb-4232650d8c56'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:08.209325 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-fe5806fa-7c26-416b-bfbb-4232650d8c56 admin admin] The token cache is being invalidate because project c6efd89bc5194b36b05112854b35e360 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:29:08.209521 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-fe5806fa-7c26-416b-bfbb-4232650d8c56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:08.210184 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-fe5806fa-7c26-416b-bfbb-4232650d8c56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:08.215500 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1028/2067] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:29:07 2022] DELETE /identity/v3/projects/c6efd89bc5194b36b05112854b35e360 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:29:08.216925 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe9731-b183-487b-bc75-3b062f6bb202 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:08.219073 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe9731-b183-487b-bc75-3b062f6bb202 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:08.219364 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe9731-b183-487b-bc75-3b062f6bb202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:08.238796 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-fafe9731-b183-487b-bc75-3b062f6bb202 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:29:08.239737 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-fafe9731-b183-487b-bc75-3b062f6bb202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:08.248051 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1029/2068] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:29:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:29:08.255676 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f696b-cea3-43fa-8ac1-30810df84dd4 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:08.255988 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f696b-cea3-43fa-8ac1-30810df84dd4 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:08.256264 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f696b-cea3-43fa-8ac1-30810df84dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:08.266620 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1040/2069] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:29:08 2022] POST /identity/v3/users => generated 291 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:29:08.276118 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade8efd-2e75-4d02-8a45-f00d26c8dfbd admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:08.278425 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-9ade8efd-2e75-4d02-8a45-f00d26c8dfbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:08.279372 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-7d3f696b-cea3-43fa-8ac1-30810df84dd4 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:29:08.281138 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-7d3f696b-cea3-43fa-8ac1-30810df84dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:08.290767 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1030/2070] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:29:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:29:08.294990 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f696b-cea3-43fa-8ac1-30810df84dd4 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:08.299781 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade8efd-2e75-4d02-8a45-f00d26c8dfbd admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:08.304418 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f696b-cea3-43fa-8ac1-30810df84dd4 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:08.315068 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc20e369-b02d-47de-9856-f6b3f3ee60e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:08.315068 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20e369-b02d-47de-9856-f6b3f3ee60e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:08.315068 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20e369-b02d-47de-9856-f6b3f3ee60e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:08.315068 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20e369-b02d-47de-9856-f6b3f3ee60e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:08.315482 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc20e369-b02d-47de-9856-f6b3f3ee60e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:08.315482 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc20e369-b02d-47de-9856-f6b3f3ee60e7 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:08.315650 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b6ee06-6458-4ea8-a50a-867aab37d8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:08.315650 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6ee06-6458-4ea8-a50a-867aab37d8d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:08.315650 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6ee06-6458-4ea8-a50a-867aab37d8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:08.315650 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6ee06-6458-4ea8-a50a-867aab37d8d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:08.316161 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b6ee06-6458-4ea8-a50a-867aab37d8d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:29:08.316161 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b6ee06-6458-4ea8-a50a-867aab37d8d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:08.316161 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b6ee06-6458-4ea8-a50a-867aab37d8d9 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:08.320516 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1041/2071] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 07 06:29:08.324440 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc20e369-b02d-47de-9856-f6b3f3ee60e7 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:08.328610 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1031/2072] 10.222.0.24 () {58 vars in 1152 bytes} [Thu Apr 7 06:29:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:29:08.332059 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b6ee06-6458-4ea8-a50a-867aab37d8d9 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:08.342772 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc20e369-b02d-47de-9856-f6b3f3ee60e7 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:08.349280 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b6ee06-6458-4ea8-a50a-867aab37d8d9 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:08.349729 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c8dbd-a68d-4039-a426-9ddc37ff3dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:08.350770 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c8dbd-a68d-4039-a426-9ddc37ff3dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:08.351145 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c8dbd-a68d-4039-a426-9ddc37ff3dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:08.351636 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c8dbd-a68d-4039-a426-9ddc37ff3dc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:08.352576 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0c8dbd-a68d-4039-a426-9ddc37ff3dc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:08.353097 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7629cbc2-6114-44bf-96f5-f2c2053d3138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:08.353764 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629cbc2-6114-44bf-96f5-f2c2053d3138 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:08.354964 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629cbc2-6114-44bf-96f5-f2c2053d3138 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:08.355394 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629cbc2-6114-44bf-96f5-f2c2053d3138 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:08.356000 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7629cbc2-6114-44bf-96f5-f2c2053d3138 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:08.357961 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7629cbc2-6114-44bf-96f5-f2c2053d3138 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:08.369189 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0c8dbd-a68d-4039-a426-9ddc37ff3dc0 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:08.385231 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1042/2073] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 07 06:29:08.393268 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c8dbd-a68d-4039-a426-9ddc37ff3dc0 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:08.393268 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-de0c8dbd-a68d-4039-a426-9ddc37ff3dc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:08.402274 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c8dbd-a68d-4039-a426-9ddc37ff3dc0 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:08.407320 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668b2e3a-87dc-4537-82e6-ffaf44672a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:08.408330 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b2e3a-87dc-4537-82e6-ffaf44672a6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:08.408686 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b2e3a-87dc-4537-82e6-ffaf44672a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:08.409135 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b2e3a-87dc-4537-82e6-ffaf44672a6a admin admin] PATH_INFO: `/v3/projects/848395712485487e98b592c13ad8fd22` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:08.410409 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668b2e3a-87dc-4537-82e6-ffaf44672a6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=848395712485487e98b592c13ad8fd22)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:08.412507 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668b2e3a-87dc-4537-82e6-ffaf44672a6a admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:08.449018 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1032/2074] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:29:08 2022] POST /identity/v3/projects => generated 381 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:29:08.452539 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7629cbc2-6114-44bf-96f5-f2c2053d3138 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:08.508481 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7629cbc2-6114-44bf-96f5-f2c2053d3138 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:08.513128 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92126288-7acf-4374-97a7-cc26c1a95d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:08.514982 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92126288-7acf-4374-97a7-cc26c1a95d79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:08.515342 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92126288-7acf-4374-97a7-cc26c1a95d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:08.515616 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92126288-7acf-4374-97a7-cc26c1a95d79 admin admin] PATH_INFO: `/v3/projects/e3434366e8944e198a26127bcfec8e65/users/e2449dbeca2c40339236837cd1e0e6f5/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:08.528894 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92126288-7acf-4374-97a7-cc26c1a95d79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3434366e8944e198a26127bcfec8e65, user_id=e2449dbeca2c40339236837cd1e0e6f5, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:08.532257 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92126288-7acf-4374-97a7-cc26c1a95d79 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:08.591002 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1033/2075] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:29:08 2022] PUT /identity/v3/projects/e3434366e8944e198a26127bcfec8e65/users/e2449dbeca2c40339236837cd1e0e6f5/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:29:08.592159 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92126288-7acf-4374-97a7-cc26c1a95d79 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:08.603541 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-668b2e3a-87dc-4537-82e6-ffaf44672a6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '848395712485487e98b592c13ad8fd22', 'request_id': 'req-668b2e3a-87dc-4537-82e6-ffaf44672a6a'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:08.610324 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-668b2e3a-87dc-4537-82e6-ffaf44672a6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '848395712485487e98b592c13ad8fd22', 'request_id': 'req-668b2e3a-87dc-4537-82e6-ffaf44672a6a'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:08.660033 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92126288-7acf-4374-97a7-cc26c1a95d79 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:08.675902 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-668b2e3a-87dc-4537-82e6-ffaf44672a6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '848395712485487e98b592c13ad8fd22', 'request_id': 'req-668b2e3a-87dc-4537-82e6-ffaf44672a6a'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:08.686574 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-668b2e3a-87dc-4537-82e6-ffaf44672a6a admin admin] The token cache is being invalidate because project 848395712485487e98b592c13ad8fd22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:29:08.687085 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-668b2e3a-87dc-4537-82e6-ffaf44672a6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:08.688247 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-668b2e3a-87dc-4537-82e6-ffaf44672a6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:08.691627 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1043/2076] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:29:08 2022] DELETE /identity/v3/projects/848395712485487e98b592c13ad8fd22 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:29:08.692726 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6cbac-5484-4805-9715-14eeda2b2e13 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:08.693023 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6cbac-5484-4805-9715-14eeda2b2e13 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:08.693442 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6cbac-5484-4805-9715-14eeda2b2e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:08.716675 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-06d6cbac-5484-4805-9715-14eeda2b2e13 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:29:08.718435 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-06d6cbac-5484-4805-9715-14eeda2b2e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:08.722362 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f507e10-09b2-4b6a-9587-e08885c8f30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:08.723036 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f507e10-09b2-4b6a-9587-e08885c8f30b admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:08.723322 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f507e10-09b2-4b6a-9587-e08885c8f30b admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:08.723598 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f507e10-09b2-4b6a-9587-e08885c8f30b admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:08.724330 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f507e10-09b2-4b6a-9587-e08885c8f30b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:08.726244 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f507e10-09b2-4b6a-9587-e08885c8f30b admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:08.726370 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1044/2077] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:29:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:29:08.727861 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67932ba-0078-45f7-98da-8d039ad3de4e None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:08.728149 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67932ba-0078-45f7-98da-8d039ad3de4e None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:08.728423 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67932ba-0078-45f7-98da-8d039ad3de4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:08.747051 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-f67932ba-0078-45f7-98da-8d039ad3de4e None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:29:08.748260 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f67932ba-0078-45f7-98da-8d039ad3de4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:08.756218 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1045/2078] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:29:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:29:08.757099 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67932ba-0078-45f7-98da-8d039ad3de4e None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:08.758275 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f67932ba-0078-45f7-98da-8d039ad3de4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:08.808133 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1034/2079] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:29:08 2022] POST /identity/v3/users => generated 291 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:29:08.809631 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0875c18-2804-428a-bb5b-e4f8256460e0 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:08.809951 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0875c18-2804-428a-bb5b-e4f8256460e0 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:08.810231 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0875c18-2804-428a-bb5b-e4f8256460e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:08.816507 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67932ba-0078-45f7-98da-8d039ad3de4e None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:08.820258 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a26669-2eca-425a-9bf1-72f5c5b39e60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:08.820957 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a26669-2eca-425a-9bf1-72f5c5b39e60 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:08.824677 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a26669-2eca-425a-9bf1-72f5c5b39e60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:08.824677 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a26669-2eca-425a-9bf1-72f5c5b39e60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:08.829870 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-a0875c18-2804-428a-bb5b-e4f8256460e0 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:29:08.831051 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a0875c18-2804-428a-bb5b-e4f8256460e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:08.831160 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a26669-2eca-425a-9bf1-72f5c5b39e60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:08.832636 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a26669-2eca-425a-9bf1-72f5c5b39e60 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:08.839676 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1035/2080] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:29:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:29:08.840575 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0875c18-2804-428a-bb5b-e4f8256460e0 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:08.841743 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a0875c18-2804-428a-bb5b-e4f8256460e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:08.842401 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1046/2081] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:29:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:29:08.844404 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a26669-2eca-425a-9bf1-72f5c5b39e60 service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:08.853795 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0875c18-2804-428a-bb5b-e4f8256460e0 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:08.854432 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a26669-2eca-425a-9bf1-72f5c5b39e60 service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:08.859674 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9485df6a-68cc-4908-863d-9fef15089363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:08.859973 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0ae3a-d6b0-4080-84af-13fd09851dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:08.860631 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0ae3a-d6b0-4080-84af-13fd09851dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:08.860880 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485df6a-68cc-4908-863d-9fef15089363 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:08.860992 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0ae3a-d6b0-4080-84af-13fd09851dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:08.861185 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0ae3a-d6b0-4080-84af-13fd09851dd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:08.861550 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485df6a-68cc-4908-863d-9fef15089363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:08.861913 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc0ae3a-d6b0-4080-84af-13fd09851dd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:29:08.862123 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485df6a-68cc-4908-863d-9fef15089363 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:08.862227 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc0ae3a-d6b0-4080-84af-13fd09851dd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:08.863100 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9485df6a-68cc-4908-863d-9fef15089363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:08.864118 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc0ae3a-d6b0-4080-84af-13fd09851dd6 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:08.865274 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9485df6a-68cc-4908-863d-9fef15089363 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:08.875400 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1036/2082] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:29:08.875534 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1047/2083] 10.222.0.24 () {58 vars in 1152 bytes} [Thu Apr 7 06:29:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:29:08.884774 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0ae3a-d6b0-4080-84af-13fd09851dd6 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:08.884916 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9485df6a-68cc-4908-863d-9fef15089363 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:08.894268 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0ae3a-d6b0-4080-84af-13fd09851dd6 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:08.894397 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9485df6a-68cc-4908-863d-9fef15089363 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:08.898858 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d041a3-15d9-40b8-9054-57f49ac826bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:08.899229 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737fc960-8e7e-4094-901e-0174e815f7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:08.899535 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d041a3-15d9-40b8-9054-57f49ac826bd admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:08.899929 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d041a3-15d9-40b8-9054-57f49ac826bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:08.900037 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fc960-8e7e-4094-901e-0174e815f7fe admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:08.900209 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d041a3-15d9-40b8-9054-57f49ac826bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:08.900307 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fc960-8e7e-4094-901e-0174e815f7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:08.900553 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fc960-8e7e-4094-901e-0174e815f7fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:08.900930 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d041a3-15d9-40b8-9054-57f49ac826bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:08.901235 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737fc960-8e7e-4094-901e-0174e815f7fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:08.902511 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d041a3-15d9-40b8-9054-57f49ac826bd admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:08.903185 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737fc960-8e7e-4094-901e-0174e815f7fe admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:08.913756 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1048/2084] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 07 06:29:08.919453 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d041a3-15d9-40b8-9054-57f49ac826bd admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:08.929933 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d041a3-15d9-40b8-9054-57f49ac826bd admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:08.934940 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce90a155-8bd6-4a58-9fa4-a051ccb7a760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:08.938067 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90a155-8bd6-4a58-9fa4-a051ccb7a760 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:08.938067 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90a155-8bd6-4a58-9fa4-a051ccb7a760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:08.938067 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90a155-8bd6-4a58-9fa4-a051ccb7a760 admin admin] PATH_INFO: `/v3/projects/15941f3fedc24cc48a2abebb4683e794/users/a2c6817e80604aec8ce3449bee84449f/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:08.951321 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce90a155-8bd6-4a58-9fa4-a051ccb7a760 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15941f3fedc24cc48a2abebb4683e794, user_id=a2c6817e80604aec8ce3449bee84449f, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:08.954122 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce90a155-8bd6-4a58-9fa4-a051ccb7a760 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:09.000854 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1037/2085] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:29:08 2022] POST /identity/v3/projects => generated 399 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:29:09.002100 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737fc960-8e7e-4094-901e-0174e815f7fe admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:09.053350 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1049/2086] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:29:08 2022] PUT /identity/v3/projects/15941f3fedc24cc48a2abebb4683e794/users/a2c6817e80604aec8ce3449bee84449f/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:29:09.061865 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737fc960-8e7e-4094-901e-0174e815f7fe admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:09.066470 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e197b-0755-4854-ad81-95682a06cd73 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:09.066470 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e197b-0755-4854-ad81-95682a06cd73 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:09.066470 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e197b-0755-4854-ad81-95682a06cd73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:09.091786 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-646e197b-0755-4854-ad81-95682a06cd73 None None] MFA Rules not processed for user `a2c6817e80604aec8ce3449bee84449f`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:29:09.093633 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-646e197b-0755-4854-ad81-95682a06cd73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:09.121050 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f034c3-7517-4716-b04c-90668350a0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:09.121736 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f034c3-7517-4716-b04c-90668350a0c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:09.122157 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f034c3-7517-4716-b04c-90668350a0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:09.132224 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f034c3-7517-4716-b04c-90668350a0c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:09.132981 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f034c3-7517-4716-b04c-90668350a0c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:09.134942 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f034c3-7517-4716-b04c-90668350a0c3 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:09.163529 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1050/2087] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:29:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:29:09.167606 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e197b-0755-4854-ad81-95682a06cd73 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:09.178085 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e197b-0755-4854-ad81-95682a06cd73 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:09.182663 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c838c0f-99f9-4459-8a39-5581c92c3af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:09.183312 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c838c0f-99f9-4459-8a39-5581c92c3af9 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:09.183601 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c838c0f-99f9-4459-8a39-5581c92c3af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:09.183907 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c838c0f-99f9-4459-8a39-5581c92c3af9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:09.184746 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c838c0f-99f9-4459-8a39-5581c92c3af9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:09.186649 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c838c0f-99f9-4459-8a39-5581c92c3af9 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:09.220141 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1038/2088] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:29:09 2022] POST /identity/v3/users => generated 300 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:29:09.224007 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f034c3-7517-4716-b04c-90668350a0c3 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:09.233751 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f034c3-7517-4716-b04c-90668350a0c3 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:09.238263 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec315987-db94-44d4-a75c-9eaf10312c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:09.239169 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec315987-db94-44d4-a75c-9eaf10312c88 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:09.239514 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec315987-db94-44d4-a75c-9eaf10312c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:09.239830 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec315987-db94-44d4-a75c-9eaf10312c88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:09.240630 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec315987-db94-44d4-a75c-9eaf10312c88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:09.242294 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec315987-db94-44d4-a75c-9eaf10312c88 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:09.252528 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1039/2089] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 07 06:29:09.258554 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec315987-db94-44d4-a75c-9eaf10312c88 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:09.268549 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec315987-db94-44d4-a75c-9eaf10312c88 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:09.273304 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead905a-983c-474e-a869-7231eedd3087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:09.273968 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead905a-983c-474e-a869-7231eedd3087 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:09.274259 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead905a-983c-474e-a869-7231eedd3087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:09.274567 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead905a-983c-474e-a869-7231eedd3087 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:09.275494 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ead905a-983c-474e-a869-7231eedd3087 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:09.277157 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ead905a-983c-474e-a869-7231eedd3087 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:09.291277 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1040/2090] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 07 06:29:09.292317 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead905a-983c-474e-a869-7231eedd3087 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:09.302213 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead905a-983c-474e-a869-7231eedd3087 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:09.307336 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa7ad5-7465-4ab9-aeb5-d9f8654a626e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:09.308215 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa7ad5-7465-4ab9-aeb5-d9f8654a626e admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:09.308505 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa7ad5-7465-4ab9-aeb5-d9f8654a626e admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:09.308796 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa7ad5-7465-4ab9-aeb5-d9f8654a626e admin admin] PATH_INFO: `/v3/projects/7ee3a57839d64592b097e00d58acf53f/users/d52a3f6d2c8b49c09ec485f8c90a04a5/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:09.314794 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1051/2091] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:29:09 2022] POST /identity/v3/projects => generated 377 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:29:09.319223 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c838c0f-99f9-4459-8a39-5581c92c3af9 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:09.329110 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fa7ad5-7465-4ab9-aeb5-d9f8654a626e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ee3a57839d64592b097e00d58acf53f, user_id=d52a3f6d2c8b49c09ec485f8c90a04a5, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:09.332172 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fa7ad5-7465-4ab9-aeb5-d9f8654a626e admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:09.389143 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c838c0f-99f9-4459-8a39-5581c92c3af9 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:09.394456 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600aefe-6f3d-40de-bccf-f83fabb96e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:09.395142 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600aefe-6f3d-40de-bccf-f83fabb96e8f admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:09.395421 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600aefe-6f3d-40de-bccf-f83fabb96e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:09.395696 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600aefe-6f3d-40de-bccf-f83fabb96e8f admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:09.396410 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9600aefe-6f3d-40de-bccf-f83fabb96e8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:09.398346 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9600aefe-6f3d-40de-bccf-f83fabb96e8f admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:09.476795 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1041/2092] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:29:09 2022] PUT /identity/v3/projects/7ee3a57839d64592b097e00d58acf53f/users/d52a3f6d2c8b49c09ec485f8c90a04a5/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:29:09.488304 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe7f0b-f8de-4b9e-a603-c4db90293646 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:09.488853 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe7f0b-f8de-4b9e-a603-c4db90293646 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:09.489128 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe7f0b-f8de-4b9e-a603-c4db90293646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:09.516223 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-9bbe7f0b-f8de-4b9e-a603-c4db90293646 None None] MFA Rules not processed for user `d52a3f6d2c8b49c09ec485f8c90a04a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:29:09.517422 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-9bbe7f0b-f8de-4b9e-a603-c4db90293646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:09.580717 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1052/2093] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:29:09 2022] POST /identity/v3/users => generated 295 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:29:09.583997 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1042/2094] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:29:09 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:29:09.584944 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600aefe-6f3d-40de-bccf-f83fabb96e8f admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:09.595982 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600aefe-6f3d-40de-bccf-f83fabb96e8f admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:09.596212 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe7f0b-f8de-4b9e-a603-c4db90293646 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:09.597615 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-9bbe7f0b-f8de-4b9e-a603-c4db90293646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:09.672432 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983d03d6-5e4e-4a37-9274-a2715dabb3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:09.673218 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d03d6-5e4e-4a37-9274-a2715dabb3ac admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:09.676378 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d03d6-5e4e-4a37-9274-a2715dabb3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:09.676378 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d03d6-5e4e-4a37-9274-a2715dabb3ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:09.676378 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983d03d6-5e4e-4a37-9274-a2715dabb3ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:09.676378 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983d03d6-5e4e-4a37-9274-a2715dabb3ac admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:09.686921 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe7f0b-f8de-4b9e-a603-c4db90293646 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:09.694044 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1053/2095] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:29:09.695121 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983d03d6-5e4e-4a37-9274-a2715dabb3ac admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:09.698307 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba8ff82-c185-4b95-b268-dd0487b5ded3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:09.699170 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8ff82-c185-4b95-b268-dd0487b5ded3 service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:09.699788 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8ff82-c185-4b95-b268-dd0487b5ded3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:09.700234 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8ff82-c185-4b95-b268-dd0487b5ded3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:09.707552 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983d03d6-5e4e-4a37-9274-a2715dabb3ac admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:09.711488 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba8ff82-c185-4b95-b268-dd0487b5ded3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:09.712469 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142eebb-c7a8-4da3-8739-c7e9a6ff6fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:09.713390 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba8ff82-c185-4b95-b268-dd0487b5ded3 service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:09.713577 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142eebb-c7a8-4da3-8739-c7e9a6ff6fad admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:09.713864 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142eebb-c7a8-4da3-8739-c7e9a6ff6fad admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:09.714139 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142eebb-c7a8-4da3-8739-c7e9a6ff6fad admin admin] PATH_INFO: `/v3/projects/55d69e55007e425abf926190eef1b6f0/users/709f9e685db3404590dcdee6b7f33117/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:09.724037 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1043/2096] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:29:09 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:29:09.730501 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9142eebb-c7a8-4da3-8739-c7e9a6ff6fad admin admin] RBAC: Authorizing `identity:create_grant(project_id=55d69e55007e425abf926190eef1b6f0, user_id=709f9e685db3404590dcdee6b7f33117, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:09.734344 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9142eebb-c7a8-4da3-8739-c7e9a6ff6fad admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:09.816059 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1054/2097] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:29:09 2022] PUT /identity/v3/projects/55d69e55007e425abf926190eef1b6f0/users/709f9e685db3404590dcdee6b7f33117/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:29:09.816177 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba8ff82-c185-4b95-b268-dd0487b5ded3 service cinder] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:09.823502 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba8ff82-c185-4b95-b268-dd0487b5ded3 service cinder] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:09.884595 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce1c80-be95-40c5-a4b2-2a8e4ba1cf78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:09.885340 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce1c80-be95-40c5-a4b2-2a8e4ba1cf78 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:09.885632 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce1c80-be95-40c5-a4b2-2a8e4ba1cf78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:09.886101 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce1c80-be95-40c5-a4b2-2a8e4ba1cf78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:09.886856 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecce1c80-be95-40c5-a4b2-2a8e4ba1cf78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:09.888646 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecce1c80-be95-40c5-a4b2-2a8e4ba1cf78 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:09.898874 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1044/2098] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:29:09.903136 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142eebb-c7a8-4da3-8739-c7e9a6ff6fad admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:09.913750 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142eebb-c7a8-4da3-8739-c7e9a6ff6fad admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:09.919317 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ad5c9c-29ad-47a0-9ba6-8218dac0b25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:09.920295 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad5c9c-29ad-47a0-9ba6-8218dac0b25f admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:09.921103 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad5c9c-29ad-47a0-9ba6-8218dac0b25f admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:09.921392 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad5c9c-29ad-47a0-9ba6-8218dac0b25f admin admin] PATH_INFO: `/v3/projects/55d69e55007e425abf926190eef1b6f0/users/709f9e685db3404590dcdee6b7f33117/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:09.923367 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ad5c9c-29ad-47a0-9ba6-8218dac0b25f admin admin] RBAC: Authorizing `identity:create_grant(project_id=55d69e55007e425abf926190eef1b6f0, user_id=709f9e685db3404590dcdee6b7f33117, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:09.926140 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ad5c9c-29ad-47a0-9ba6-8218dac0b25f admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:09.939843 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1055/2099] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:29:09 2022] PUT /identity/v3/projects/55d69e55007e425abf926190eef1b6f0/users/709f9e685db3404590dcdee6b7f33117/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:29:09.948612 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695464ec-3d87-4143-83d1-e61be291b738 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:09.948927 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695464ec-3d87-4143-83d1-e61be291b738 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:09.949208 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695464ec-3d87-4143-83d1-e61be291b738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:09.977493 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-695464ec-3d87-4143-83d1-e61be291b738 None None] MFA Rules not processed for user `709f9e685db3404590dcdee6b7f33117`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:29:09.978898 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-695464ec-3d87-4143-83d1-e61be291b738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:10.046630 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1045/2100] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:29:09 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:29:10.059074 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ad5c9c-29ad-47a0-9ba6-8218dac0b25f admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:10.114653 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ad5c9c-29ad-47a0-9ba6-8218dac0b25f admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:10.118428 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a169c8c-3495-49df-9938-2c1741c8579e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:10.119086 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a169c8c-3495-49df-9938-2c1741c8579e service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:10.119389 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a169c8c-3495-49df-9938-2c1741c8579e service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:10.119652 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a169c8c-3495-49df-9938-2c1741c8579e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:10.128879 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a169c8c-3495-49df-9938-2c1741c8579e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:10.130306 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a169c8c-3495-49df-9938-2c1741c8579e service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:10.139541 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1056/2101] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:29:10 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:29:10.372952 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719a852-3a43-4bd6-99ba-a88d8165c7e1 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:10.373422 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719a852-3a43-4bd6-99ba-a88d8165c7e1 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:10.373510 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719a852-3a43-4bd6-99ba-a88d8165c7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:10.407893 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-9719a852-3a43-4bd6-99ba-a88d8165c7e1 None None] MFA Rules not processed for user `e2449dbeca2c40339236837cd1e0e6f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:29:10.409275 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-9719a852-3a43-4bd6-99ba-a88d8165c7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:10.473646 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1046/2102] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:29:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:29:10.563253 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a169c8c-3495-49df-9938-2c1741c8579e service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:10.564699 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-1a169c8c-3495-49df-9938-2c1741c8579e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:10.575586 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a169c8c-3495-49df-9938-2c1741c8579e service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:10.579671 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300dc409-3419-4586-b5d9-6b71dbdaa845 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:10.580338 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300dc409-3419-4586-b5d9-6b71dbdaa845 service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:10.580649 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300dc409-3419-4586-b5d9-6b71dbdaa845 service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:10.580923 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300dc409-3419-4586-b5d9-6b71dbdaa845 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:10.588990 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300dc409-3419-4586-b5d9-6b71dbdaa845 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:10.590403 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300dc409-3419-4586-b5d9-6b71dbdaa845 service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:10.599665 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1057/2103] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:29:10 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:29:11.330671 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719a852-3a43-4bd6-99ba-a88d8165c7e1 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:11.341019 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719a852-3a43-4bd6-99ba-a88d8165c7e1 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:11.347353 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990b6f5c-de4e-49ca-ba60-6862a6efa297 tempest-VolumeQuotaClassesTest-61280369 tempest-VolumeQuotaClassesTest-61280369-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '709f9e685db3404590dcdee6b7f33117', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55d69e55007e425abf926190eef1b6f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:11.347353 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b6f5c-de4e-49ca-ba60-6862a6efa297 tempest-VolumeQuotaClassesTest-61280369 tempest-VolumeQuotaClassesTest-61280369-project-admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:11.347353 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b6f5c-de4e-49ca-ba60-6862a6efa297 tempest-VolumeQuotaClassesTest-61280369 tempest-VolumeQuotaClassesTest-61280369-project-admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:11.347668 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b6f5c-de4e-49ca-ba60-6862a6efa297 tempest-VolumeQuotaClassesTest-61280369 tempest-VolumeQuotaClassesTest-61280369-project-admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:11.347668 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990b6f5c-de4e-49ca-ba60-6862a6efa297 tempest-VolumeQuotaClassesTest-61280369 tempest-VolumeQuotaClassesTest-61280369-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:29:11.347877 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990b6f5c-de4e-49ca-ba60-6862a6efa297 tempest-VolumeQuotaClassesTest-61280369 tempest-VolumeQuotaClassesTest-61280369-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:11.349709 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990b6f5c-de4e-49ca-ba60-6862a6efa297 tempest-VolumeQuotaClassesTest-61280369 tempest-VolumeQuotaClassesTest-61280369-project-admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:11.361722 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1047/2104] 10.222.0.24 () {58 vars in 1152 bytes} [Thu Apr 7 06:29:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:29:11.368875 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300dc409-3419-4586-b5d9-6b71dbdaa845 service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:11.379764 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300dc409-3419-4586-b5d9-6b71dbdaa845 service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:11.384231 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0d10e-ebcb-4ce8-809b-eb50ecb019f7 tempest-VolumeQuotaClassesTest-61280369 tempest-VolumeQuotaClassesTest-61280369-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '709f9e685db3404590dcdee6b7f33117', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55d69e55007e425abf926190eef1b6f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:11.384907 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0d10e-ebcb-4ce8-809b-eb50ecb019f7 tempest-VolumeQuotaClassesTest-61280369 tempest-VolumeQuotaClassesTest-61280369-project-admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:11.385194 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0d10e-ebcb-4ce8-809b-eb50ecb019f7 tempest-VolumeQuotaClassesTest-61280369 tempest-VolumeQuotaClassesTest-61280369-project-admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:11.385471 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0d10e-ebcb-4ce8-809b-eb50ecb019f7 tempest-VolumeQuotaClassesTest-61280369 tempest-VolumeQuotaClassesTest-61280369-project-admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:11.386167 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb0d10e-ebcb-4ce8-809b-eb50ecb019f7 tempest-VolumeQuotaClassesTest-61280369 tempest-VolumeQuotaClassesTest-61280369-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:11.388067 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb0d10e-ebcb-4ce8-809b-eb50ecb019f7 tempest-VolumeQuotaClassesTest-61280369 tempest-VolumeQuotaClassesTest-61280369-project-admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:11.555057 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1058/2105] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:29:11 2022] POST /identity/v3/projects => generated 355 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:29:11.556450 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990b6f5c-de4e-49ca-ba60-6862a6efa297 tempest-VolumeQuotaClassesTest-61280369 tempest-VolumeQuotaClassesTest-61280369-project-admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:11.566466 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990b6f5c-de4e-49ca-ba60-6862a6efa297 tempest-VolumeQuotaClassesTest-61280369 tempest-VolumeQuotaClassesTest-61280369-project-admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:11.621341 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886e8ebf-ecfb-43e8-9c65-5e6a4e456a90 tempest-VolumeQuotaClassesTest-61280369 tempest-VolumeQuotaClassesTest-61280369-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '709f9e685db3404590dcdee6b7f33117', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55d69e55007e425abf926190eef1b6f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:11.622004 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e8ebf-ecfb-43e8-9c65-5e6a4e456a90 tempest-VolumeQuotaClassesTest-61280369 tempest-VolumeQuotaClassesTest-61280369-project-admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:11.622293 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e8ebf-ecfb-43e8-9c65-5e6a4e456a90 tempest-VolumeQuotaClassesTest-61280369 tempest-VolumeQuotaClassesTest-61280369-project-admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:11.622571 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e8ebf-ecfb-43e8-9c65-5e6a4e456a90 tempest-VolumeQuotaClassesTest-61280369 tempest-VolumeQuotaClassesTest-61280369-project-admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:11.623336 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886e8ebf-ecfb-43e8-9c65-5e6a4e456a90 tempest-VolumeQuotaClassesTest-61280369 tempest-VolumeQuotaClassesTest-61280369-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:29:11.624178 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886e8ebf-ecfb-43e8-9c65-5e6a4e456a90 tempest-VolumeQuotaClassesTest-61280369 tempest-VolumeQuotaClassesTest-61280369-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:11.625785 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886e8ebf-ecfb-43e8-9c65-5e6a4e456a90 tempest-VolumeQuotaClassesTest-61280369 tempest-VolumeQuotaClassesTest-61280369-project-admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:11.636623 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1048/2106] 10.222.0.24 () {58 vars in 1152 bytes} [Thu Apr 7 06:29:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:29:11.671600 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0d10e-ebcb-4ce8-809b-eb50ecb019f7 tempest-VolumeQuotaClassesTest-61280369 tempest-VolumeQuotaClassesTest-61280369-project-admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:11.681723 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0d10e-ebcb-4ce8-809b-eb50ecb019f7 tempest-VolumeQuotaClassesTest-61280369 tempest-VolumeQuotaClassesTest-61280369-project-admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:11.686882 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b04203b-3fdf-4bcb-aa2b-2791efb0fd39 tempest-VolumeQuotaClassesTest-61280369 tempest-VolumeQuotaClassesTest-61280369-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '709f9e685db3404590dcdee6b7f33117', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55d69e55007e425abf926190eef1b6f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:11.687762 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b04203b-3fdf-4bcb-aa2b-2791efb0fd39 tempest-VolumeQuotaClassesTest-61280369 tempest-VolumeQuotaClassesTest-61280369-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:11.688858 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b04203b-3fdf-4bcb-aa2b-2791efb0fd39 tempest-VolumeQuotaClassesTest-61280369 tempest-VolumeQuotaClassesTest-61280369-project-admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:11.688858 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b04203b-3fdf-4bcb-aa2b-2791efb0fd39 tempest-VolumeQuotaClassesTest-61280369 tempest-VolumeQuotaClassesTest-61280369-project-admin] PATH_INFO: `/v3/projects/9f89936b41e4480a80c203ff60398cb8` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:11.690964 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b04203b-3fdf-4bcb-aa2b-2791efb0fd39 tempest-VolumeQuotaClassesTest-61280369 tempest-VolumeQuotaClassesTest-61280369-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9f89936b41e4480a80c203ff60398cb8)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:11.693072 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b04203b-3fdf-4bcb-aa2b-2791efb0fd39 tempest-VolumeQuotaClassesTest-61280369 tempest-VolumeQuotaClassesTest-61280369-project-admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:11.859659 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6b04203b-3fdf-4bcb-aa2b-2791efb0fd39 tempest-VolumeQuotaClassesTest-61280369 tempest-VolumeQuotaClassesTest-61280369-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f89936b41e4480a80c203ff60398cb8', 'request_id': 'req-6b04203b-3fdf-4bcb-aa2b-2791efb0fd39'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:11.866572 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6b04203b-3fdf-4bcb-aa2b-2791efb0fd39 tempest-VolumeQuotaClassesTest-61280369 tempest-VolumeQuotaClassesTest-61280369-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f89936b41e4480a80c203ff60398cb8', 'request_id': 'req-6b04203b-3fdf-4bcb-aa2b-2791efb0fd39'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:11.933292 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6b04203b-3fdf-4bcb-aa2b-2791efb0fd39 tempest-VolumeQuotaClassesTest-61280369 tempest-VolumeQuotaClassesTest-61280369-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f89936b41e4480a80c203ff60398cb8', 'request_id': 'req-6b04203b-3fdf-4bcb-aa2b-2791efb0fd39'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:11.944998 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6b04203b-3fdf-4bcb-aa2b-2791efb0fd39 tempest-VolumeQuotaClassesTest-61280369 tempest-VolumeQuotaClassesTest-61280369-project-admin] The token cache is being invalidate because project 9f89936b41e4480a80c203ff60398cb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:29:11.945293 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6b04203b-3fdf-4bcb-aa2b-2791efb0fd39 tempest-VolumeQuotaClassesTest-61280369 tempest-VolumeQuotaClassesTest-61280369-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:11.945986 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6b04203b-3fdf-4bcb-aa2b-2791efb0fd39 tempest-VolumeQuotaClassesTest-61280369 tempest-VolumeQuotaClassesTest-61280369-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:11.947789 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1059/2107] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:29:11 2022] DELETE /identity/v3/projects/9f89936b41e4480a80c203ff60398cb8 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:29:12.491200 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8dcb03-9583-406a-89e2-bd6ca44c4d74 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:12.491490 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8dcb03-9583-406a-89e2-bd6ca44c4d74 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:12.491821 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8dcb03-9583-406a-89e2-bd6ca44c4d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:12.510158 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-7e8dcb03-9583-406a-89e2-bd6ca44c4d74 None None] MFA Rules not processed for user `e2449dbeca2c40339236837cd1e0e6f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:29:12.510506 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-7e8dcb03-9583-406a-89e2-bd6ca44c4d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:12.566792 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1049/2108] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:29:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:29:12.934489 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b04203b-3fdf-4bcb-aa2b-2791efb0fd39 tempest-VolumeQuotaClassesTest-61280369 tempest-VolumeQuotaClassesTest-61280369-project-admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:12.937069 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-6b04203b-3fdf-4bcb-aa2b-2791efb0fd39 tempest-VolumeQuotaClassesTest-61280369 tempest-VolumeQuotaClassesTest-61280369-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:13.027136 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b04203b-3fdf-4bcb-aa2b-2791efb0fd39 tempest-VolumeQuotaClassesTest-61280369 tempest-VolumeQuotaClassesTest-61280369-project-admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:13.032196 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87907ade-8a58-4fde-ae69-092da6f1e06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:13.033098 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87907ade-8a58-4fde-ae69-092da6f1e06e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:13.033384 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87907ade-8a58-4fde-ae69-092da6f1e06e admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:13.033662 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87907ade-8a58-4fde-ae69-092da6f1e06e admin admin] PATH_INFO: `/v3/users/a2c6817e80604aec8ce3449bee84449f` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:13.035046 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87907ade-8a58-4fde-ae69-092da6f1e06e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2c6817e80604aec8ce3449bee84449f)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:13.037039 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87907ade-8a58-4fde-ae69-092da6f1e06e admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:13.286201 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-87907ade-8a58-4fde-ae69-092da6f1e06e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2c6817e80604aec8ce3449bee84449f'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:13.300065 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-87907ade-8a58-4fde-ae69-092da6f1e06e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2c6817e80604aec8ce3449bee84449f'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:13.424635 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-87907ade-8a58-4fde-ae69-092da6f1e06e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2c6817e80604aec8ce3449bee84449f'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:13.425301 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-87907ade-8a58-4fde-ae69-092da6f1e06e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2c6817e80604aec8ce3449bee84449f'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:13.425909 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-87907ade-8a58-4fde-ae69-092da6f1e06e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2c6817e80604aec8ce3449bee84449f'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:13.438331 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1060/2109] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:29:12 2022] DELETE /identity/v3/users/a2c6817e80604aec8ce3449bee84449f => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:29:13.442773 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc465ba5-6611-4f7d-9b6f-afbbca8da652 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:13.443137 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc465ba5-6611-4f7d-9b6f-afbbca8da652 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:13.443491 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc465ba5-6611-4f7d-9b6f-afbbca8da652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:13.460597 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-dc465ba5-6611-4f7d-9b6f-afbbca8da652 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:29:13.461787 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-dc465ba5-6611-4f7d-9b6f-afbbca8da652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:13.519315 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1050/2110] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:29:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:29:13.529098 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87907ade-8a58-4fde-ae69-092da6f1e06e admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:13.531125 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-87907ade-8a58-4fde-ae69-092da6f1e06e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:13.585542 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87907ade-8a58-4fde-ae69-092da6f1e06e admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:13.589192 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c6ab2d-ffe4-432a-9e73-1c813324b061 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:13.595320 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6ab2d-ffe4-432a-9e73-1c813324b061 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:13.595320 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6ab2d-ffe4-432a-9e73-1c813324b061 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:13.595320 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6ab2d-ffe4-432a-9e73-1c813324b061 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:13.600683 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c6ab2d-ffe4-432a-9e73-1c813324b061 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:13.602100 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c6ab2d-ffe4-432a-9e73-1c813324b061 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:13.613910 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1061/2111] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:29:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:29:14.008771 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc465ba5-6611-4f7d-9b6f-afbbca8da652 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:14.010303 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-dc465ba5-6611-4f7d-9b6f-afbbca8da652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:14.025342 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc465ba5-6611-4f7d-9b6f-afbbca8da652 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:14.033038 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df568e53-ceee-4795-a5eb-2ff2f3d4daee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:14.033038 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df568e53-ceee-4795-a5eb-2ff2f3d4daee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:14.033038 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df568e53-ceee-4795-a5eb-2ff2f3d4daee admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:14.033406 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df568e53-ceee-4795-a5eb-2ff2f3d4daee admin admin] PATH_INFO: `/v3/projects/15941f3fedc24cc48a2abebb4683e794` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:14.034368 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df568e53-ceee-4795-a5eb-2ff2f3d4daee admin admin] RBAC: Authorizing `identity:delete_project(project_id=15941f3fedc24cc48a2abebb4683e794)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:14.036337 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df568e53-ceee-4795-a5eb-2ff2f3d4daee admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:14.161949 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-df568e53-ceee-4795-a5eb-2ff2f3d4daee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15941f3fedc24cc48a2abebb4683e794', 'request_id': 'req-df568e53-ceee-4795-a5eb-2ff2f3d4daee'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:14.167319 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-df568e53-ceee-4795-a5eb-2ff2f3d4daee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15941f3fedc24cc48a2abebb4683e794', 'request_id': 'req-df568e53-ceee-4795-a5eb-2ff2f3d4daee'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:14.247710 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-df568e53-ceee-4795-a5eb-2ff2f3d4daee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15941f3fedc24cc48a2abebb4683e794', 'request_id': 'req-df568e53-ceee-4795-a5eb-2ff2f3d4daee'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:14.260766 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-df568e53-ceee-4795-a5eb-2ff2f3d4daee admin admin] The token cache is being invalidate because project 15941f3fedc24cc48a2abebb4683e794 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:29:14.261218 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-df568e53-ceee-4795-a5eb-2ff2f3d4daee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:14.262141 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-df568e53-ceee-4795-a5eb-2ff2f3d4daee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:14.266960 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1051/2112] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:29:14 2022] DELETE /identity/v3/projects/15941f3fedc24cc48a2abebb4683e794 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:29:14.268237 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c6ab2d-ffe4-432a-9e73-1c813324b061 service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:14.277941 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c6ab2d-ffe4-432a-9e73-1c813324b061 service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:14.336496 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92386f2-751c-4212-a44a-686d48b1be36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:14.337361 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92386f2-751c-4212-a44a-686d48b1be36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:14.337657 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92386f2-751c-4212-a44a-686d48b1be36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:14.337932 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92386f2-751c-4212-a44a-686d48b1be36 admin admin] PATH_INFO: `/v3/users/709f9e685db3404590dcdee6b7f33117` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:14.339139 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92386f2-751c-4212-a44a-686d48b1be36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=709f9e685db3404590dcdee6b7f33117)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:14.341105 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92386f2-751c-4212-a44a-686d48b1be36 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:14.573245 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b92386f2-751c-4212-a44a-686d48b1be36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '709f9e685db3404590dcdee6b7f33117'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:14.584863 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b92386f2-751c-4212-a44a-686d48b1be36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '709f9e685db3404590dcdee6b7f33117'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:14.683848 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b92386f2-751c-4212-a44a-686d48b1be36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '709f9e685db3404590dcdee6b7f33117'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:14.683848 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b92386f2-751c-4212-a44a-686d48b1be36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '709f9e685db3404590dcdee6b7f33117'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:14.683848 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b92386f2-751c-4212-a44a-686d48b1be36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '709f9e685db3404590dcdee6b7f33117'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:14.700894 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1062/2113] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:29:14 2022] DELETE /identity/v3/users/709f9e685db3404590dcdee6b7f33117 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:29:15.146377 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df568e53-ceee-4795-a5eb-2ff2f3d4daee admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:15.147866 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-df568e53-ceee-4795-a5eb-2ff2f3d4daee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:15.160931 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df568e53-ceee-4795-a5eb-2ff2f3d4daee admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:15.215499 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fb1401-1d0d-41f6-a199-00e27fab9ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:15.216401 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb1401-1d0d-41f6-a199-00e27fab9ad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:15.216692 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb1401-1d0d-41f6-a199-00e27fab9ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:15.216964 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb1401-1d0d-41f6-a199-00e27fab9ad5 admin admin] PATH_INFO: `/v3/projects/55d69e55007e425abf926190eef1b6f0` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:15.218780 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fb1401-1d0d-41f6-a199-00e27fab9ad5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55d69e55007e425abf926190eef1b6f0)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:15.220723 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fb1401-1d0d-41f6-a199-00e27fab9ad5 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:15.336382 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-56fb1401-1d0d-41f6-a199-00e27fab9ad5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55d69e55007e425abf926190eef1b6f0', 'request_id': 'req-56fb1401-1d0d-41f6-a199-00e27fab9ad5'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:15.343343 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-56fb1401-1d0d-41f6-a199-00e27fab9ad5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55d69e55007e425abf926190eef1b6f0', 'request_id': 'req-56fb1401-1d0d-41f6-a199-00e27fab9ad5'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:15.413354 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-56fb1401-1d0d-41f6-a199-00e27fab9ad5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55d69e55007e425abf926190eef1b6f0', 'request_id': 'req-56fb1401-1d0d-41f6-a199-00e27fab9ad5'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:15.424574 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-56fb1401-1d0d-41f6-a199-00e27fab9ad5 admin admin] The token cache is being invalidate because project 55d69e55007e425abf926190eef1b6f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:29:15.424861 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-56fb1401-1d0d-41f6-a199-00e27fab9ad5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:15.425491 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-56fb1401-1d0d-41f6-a199-00e27fab9ad5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:15.427015 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1052/2114] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:29:15 2022] DELETE /identity/v3/projects/55d69e55007e425abf926190eef1b6f0 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:29:15.431861 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fdaaa-9aaf-4364-8651-60dc62343365 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:15.432358 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fdaaa-9aaf-4364-8651-60dc62343365 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:15.432470 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fdaaa-9aaf-4364-8651-60dc62343365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:15.460859 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-693fdaaa-9aaf-4364-8651-60dc62343365 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:29:15.462040 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-693fdaaa-9aaf-4364-8651-60dc62343365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:15.518228 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1063/2115] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:29:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:29:15.525952 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa0840-2aae-4e73-86d0-46c7f49795c5 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:15.526237 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa0840-2aae-4e73-86d0-46c7f49795c5 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:15.526518 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa0840-2aae-4e73-86d0-46c7f49795c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:15.544527 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-69aa0840-2aae-4e73-86d0-46c7f49795c5 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:29:15.545726 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-69aa0840-2aae-4e73-86d0-46c7f49795c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:15.553477 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1053/2116] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:29:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:29:15.557466 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693fdaaa-9aaf-4364-8651-60dc62343365 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:15.567618 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693fdaaa-9aaf-4364-8651-60dc62343365 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:15.572217 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d9e01-db5b-4dca-b78f-317bea8f54d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:15.572882 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d9e01-db5b-4dca-b78f-317bea8f54d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:15.573170 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d9e01-db5b-4dca-b78f-317bea8f54d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:15.573448 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d9e01-db5b-4dca-b78f-317bea8f54d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:15.574185 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061d9e01-db5b-4dca-b78f-317bea8f54d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:29:15.574496 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061d9e01-db5b-4dca-b78f-317bea8f54d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:15.576152 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061d9e01-db5b-4dca-b78f-317bea8f54d8 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:15.589845 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1064/2117] 10.222.0.24 () {58 vars in 1152 bytes} [Thu Apr 7 06:29:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:29:15.598751 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa0840-2aae-4e73-86d0-46c7f49795c5 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:15.607646 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa0840-2aae-4e73-86d0-46c7f49795c5 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:15.612370 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e01bef-a5ff-4f72-b02a-de8b0d7d2cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:15.613023 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e01bef-a5ff-4f72-b02a-de8b0d7d2cf9 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:15.613309 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e01bef-a5ff-4f72-b02a-de8b0d7d2cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:15.613837 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e01bef-a5ff-4f72-b02a-de8b0d7d2cf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:15.614524 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e01bef-a5ff-4f72-b02a-de8b0d7d2cf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:15.616468 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e01bef-a5ff-4f72-b02a-de8b0d7d2cf9 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:15.746532 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1054/2118] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:29:15 2022] POST /identity/v3/projects => generated 407 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:29:15.751231 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d9e01-db5b-4dca-b78f-317bea8f54d8 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:15.761255 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d9e01-db5b-4dca-b78f-317bea8f54d8 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:15.819119 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66006a-1586-4aed-b01f-873e83217aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:15.819861 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66006a-1586-4aed-b01f-873e83217aa1 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:15.820149 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66006a-1586-4aed-b01f-873e83217aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:15.820432 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66006a-1586-4aed-b01f-873e83217aa1 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:15.821129 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee66006a-1586-4aed-b01f-873e83217aa1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:15.823130 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee66006a-1586-4aed-b01f-873e83217aa1 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:15.916723 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1065/2119] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:29:15 2022] POST /identity/v3/users => generated 304 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:29:15.922998 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e01bef-a5ff-4f72-b02a-de8b0d7d2cf9 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:15.933062 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e01bef-a5ff-4f72-b02a-de8b0d7d2cf9 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:15.938350 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7a6f36-1d38-4829-b54b-77ad23851642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:15.939005 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a6f36-1d38-4829-b54b-77ad23851642 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:15.939290 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a6f36-1d38-4829-b54b-77ad23851642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:15.939585 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a6f36-1d38-4829-b54b-77ad23851642 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:15.940340 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7a6f36-1d38-4829-b54b-77ad23851642 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:15.941975 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7a6f36-1d38-4829-b54b-77ad23851642 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:15.952334 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1055/2120] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:29:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 07 06:29:15.956163 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66006a-1586-4aed-b01f-873e83217aa1 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:15.965957 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66006a-1586-4aed-b01f-873e83217aa1 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:15.970542 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb779ab3-d7fa-4c5d-9c45-e338cdfb19fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:15.971191 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb779ab3-d7fa-4c5d-9c45-e338cdfb19fe admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:15.971475 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb779ab3-d7fa-4c5d-9c45-e338cdfb19fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:15.971768 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb779ab3-d7fa-4c5d-9c45-e338cdfb19fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:15.972508 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb779ab3-d7fa-4c5d-9c45-e338cdfb19fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:15.974103 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb779ab3-d7fa-4c5d-9c45-e338cdfb19fe admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:15.984141 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1066/2121] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:29:15 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:29:15.988014 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7a6f36-1d38-4829-b54b-77ad23851642 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:15.997899 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7a6f36-1d38-4829-b54b-77ad23851642 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:16.002961 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea0a14-2650-447d-8628-cb037a282882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:16.003858 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea0a14-2650-447d-8628-cb037a282882 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:16.004147 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea0a14-2650-447d-8628-cb037a282882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:16.004422 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea0a14-2650-447d-8628-cb037a282882 admin admin] PATH_INFO: `/v3/projects/25fd9aaa60524cc0b9e57e5f17b55fb4/users/ee1cbc341583498e8865a5fc0a2f8458/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:16.039070 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fea0a14-2650-447d-8628-cb037a282882 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25fd9aaa60524cc0b9e57e5f17b55fb4, user_id=ee1cbc341583498e8865a5fc0a2f8458, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:16.041852 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fea0a14-2650-447d-8628-cb037a282882 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:16.121441 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1056/2122] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:29:15 2022] PUT /identity/v3/projects/25fd9aaa60524cc0b9e57e5f17b55fb4/users/ee1cbc341583498e8865a5fc0a2f8458/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:29:16.131517 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876ee61-8298-410e-a92b-66197af55e50 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:16.131864 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876ee61-8298-410e-a92b-66197af55e50 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:16.132146 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876ee61-8298-410e-a92b-66197af55e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:16.166551 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-b876ee61-8298-410e-a92b-66197af55e50 None None] MFA Rules not processed for user `ee1cbc341583498e8865a5fc0a2f8458`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:29:16.173100 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b876ee61-8298-410e-a92b-66197af55e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:16.243599 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1067/2123] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:29:16 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:29:16.248110 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea0a14-2650-447d-8628-cb037a282882 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:16.309180 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea0a14-2650-447d-8628-cb037a282882 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:16.314346 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e2b69f-a6a2-402e-9f9c-f34fa8bb1935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:16.315010 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2b69f-a6a2-402e-9f9c-f34fa8bb1935 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:16.315298 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2b69f-a6a2-402e-9f9c-f34fa8bb1935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:16.315584 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2b69f-a6a2-402e-9f9c-f34fa8bb1935 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:16.316321 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e2b69f-a6a2-402e-9f9c-f34fa8bb1935 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:16.318226 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e2b69f-a6a2-402e-9f9c-f34fa8bb1935 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:16.427006 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1057/2124] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:29:16 2022] POST /identity/v3/projects => generated 409 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:29:16.431005 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b876ee61-8298-410e-a92b-66197af55e50 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:16.442920 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b876ee61-8298-410e-a92b-66197af55e50 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:16.504153 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45733570-3d8b-48e1-ad2e-9205cb333bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:16.504836 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45733570-3d8b-48e1-ad2e-9205cb333bcc admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:16.505122 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45733570-3d8b-48e1-ad2e-9205cb333bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:16.505401 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45733570-3d8b-48e1-ad2e-9205cb333bcc admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:16.506091 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45733570-3d8b-48e1-ad2e-9205cb333bcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:16.508076 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45733570-3d8b-48e1-ad2e-9205cb333bcc admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:16.602385 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1068/2125] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:29:16 2022] POST /identity/v3/users => generated 311 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:29:16.606195 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e2b69f-a6a2-402e-9f9c-f34fa8bb1935 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:16.616551 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e2b69f-a6a2-402e-9f9c-f34fa8bb1935 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:16.621175 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc9774a-131e-4687-9685-b09a3c96bb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:16.621822 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc9774a-131e-4687-9685-b09a3c96bb27 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:16.622103 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc9774a-131e-4687-9685-b09a3c96bb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:16.622373 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc9774a-131e-4687-9685-b09a3c96bb27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:16.623096 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc9774a-131e-4687-9685-b09a3c96bb27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:16.624703 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc9774a-131e-4687-9685-b09a3c96bb27 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:16.634985 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1058/2126] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:29:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:29:16.641291 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45733570-3d8b-48e1-ad2e-9205cb333bcc admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:16.651801 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45733570-3d8b-48e1-ad2e-9205cb333bcc admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:16.657181 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c24a9e8-1d1b-43dd-a890-840b41ddb456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:16.658177 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24a9e8-1d1b-43dd-a890-840b41ddb456 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:16.658524 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24a9e8-1d1b-43dd-a890-840b41ddb456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:16.658867 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24a9e8-1d1b-43dd-a890-840b41ddb456 admin admin] PATH_INFO: `/v3/projects/3c5d319d2d1243fd8291b1309a4571c5/users/b4f35beae1e844e58841439193afab3f/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:16.673786 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c24a9e8-1d1b-43dd-a890-840b41ddb456 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c5d319d2d1243fd8291b1309a4571c5, user_id=b4f35beae1e844e58841439193afab3f, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:16.676573 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c24a9e8-1d1b-43dd-a890-840b41ddb456 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:16.752061 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1069/2127] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:29:16 2022] PUT /identity/v3/projects/3c5d319d2d1243fd8291b1309a4571c5/users/b4f35beae1e844e58841439193afab3f/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:29:16.756051 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc9774a-131e-4687-9685-b09a3c96bb27 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:16.779090 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc9774a-131e-4687-9685-b09a3c96bb27 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:16.839807 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309c43d-35cb-469e-8e0b-861aa4ba3e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:16.840483 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309c43d-35cb-469e-8e0b-861aa4ba3e61 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:16.840770 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309c43d-35cb-469e-8e0b-861aa4ba3e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:16.841074 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309c43d-35cb-469e-8e0b-861aa4ba3e61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:16.841818 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8309c43d-35cb-469e-8e0b-861aa4ba3e61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:16.843484 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8309c43d-35cb-469e-8e0b-861aa4ba3e61 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:16.853306 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1059/2128] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:29:16 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:29:16.857195 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c24a9e8-1d1b-43dd-a890-840b41ddb456 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:16.869401 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c24a9e8-1d1b-43dd-a890-840b41ddb456 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:16.875152 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b2f4f0-0c77-485b-a639-b08209f1500a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:16.876161 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b2f4f0-0c77-485b-a639-b08209f1500a admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:16.876519 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b2f4f0-0c77-485b-a639-b08209f1500a admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:16.876863 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b2f4f0-0c77-485b-a639-b08209f1500a admin admin] PATH_INFO: `/v3/projects/3c5d319d2d1243fd8291b1309a4571c5/users/b4f35beae1e844e58841439193afab3f/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:16.879705 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b2f4f0-0c77-485b-a639-b08209f1500a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c5d319d2d1243fd8291b1309a4571c5, user_id=b4f35beae1e844e58841439193afab3f, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:16.882534 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b2f4f0-0c77-485b-a639-b08209f1500a admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:16.894382 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1070/2129] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:29:16 2022] PUT /identity/v3/projects/3c5d319d2d1243fd8291b1309a4571c5/users/b4f35beae1e844e58841439193afab3f/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:29:16.904401 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866f603-0626-4495-b2ce-8ef3e8b4f8cb None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:16.905236 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866f603-0626-4495-b2ce-8ef3e8b4f8cb None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:16.905524 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866f603-0626-4495-b2ce-8ef3e8b4f8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:16.939253 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-d866f603-0626-4495-b2ce-8ef3e8b4f8cb None None] MFA Rules not processed for user `b4f35beae1e844e58841439193afab3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:29:16.940571 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d866f603-0626-4495-b2ce-8ef3e8b4f8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:17.008086 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1060/2130] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:29:16 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:29:17.019464 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b2f4f0-0c77-485b-a639-b08209f1500a admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:17.021579 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-14b2f4f0-0c77-485b-a639-b08209f1500a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:17.088248 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b2f4f0-0c77-485b-a639-b08209f1500a admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:17.088248 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d51e9d-0b92-4564-9be4-84fc101b5dc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:17.088248 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d51e9d-0b92-4564-9be4-84fc101b5dc0 service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:17.088248 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d51e9d-0b92-4564-9be4-84fc101b5dc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:17.088612 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d51e9d-0b92-4564-9be4-84fc101b5dc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:17.092430 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d51e9d-0b92-4564-9be4-84fc101b5dc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:17.093909 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d51e9d-0b92-4564-9be4-84fc101b5dc0 service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:17.103516 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1071/2131] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:29:17 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:29:17.597087 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d866f603-0626-4495-b2ce-8ef3e8b4f8cb None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:17.610839 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d866f603-0626-4495-b2ce-8ef3e8b4f8cb None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:17.615814 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ec2dc-d7d8-44c7-97cd-953dedc4547f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:17.616764 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ec2dc-d7d8-44c7-97cd-953dedc4547f service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:17.617049 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ec2dc-d7d8-44c7-97cd-953dedc4547f service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:17.617620 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ec2dc-d7d8-44c7-97cd-953dedc4547f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:17.686915 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7ec2dc-d7d8-44c7-97cd-953dedc4547f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:17.688483 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7ec2dc-d7d8-44c7-97cd-953dedc4547f service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:17.698540 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1061/2132] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:29:17 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:29:19.676044 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d51e9d-0b92-4564-9be4-84fc101b5dc0 service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:19.676044 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-34d51e9d-0b92-4564-9be4-84fc101b5dc0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:19.740778 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d51e9d-0b92-4564-9be4-84fc101b5dc0 service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:19.745372 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b254ac7-3aed-4d58-a65e-bd4771b1bfde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:19.746274 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b254ac7-3aed-4d58-a65e-bd4771b1bfde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:19.746563 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b254ac7-3aed-4d58-a65e-bd4771b1bfde admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:19.746843 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b254ac7-3aed-4d58-a65e-bd4771b1bfde admin admin] PATH_INFO: `/v3/users/d52a3f6d2c8b49c09ec485f8c90a04a5` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:19.748061 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b254ac7-3aed-4d58-a65e-bd4771b1bfde admin admin] RBAC: Authorizing `identity:delete_user(user_id=d52a3f6d2c8b49c09ec485f8c90a04a5)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:19.750501 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b254ac7-3aed-4d58-a65e-bd4771b1bfde admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:19.952097 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5b254ac7-3aed-4d58-a65e-bd4771b1bfde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd52a3f6d2c8b49c09ec485f8c90a04a5'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:19.963409 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5b254ac7-3aed-4d58-a65e-bd4771b1bfde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd52a3f6d2c8b49c09ec485f8c90a04a5'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:20.001982 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ec2dc-d7d8-44c7-97cd-953dedc4547f service cinder] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:20.004263 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-8e7ec2dc-d7d8-44c7-97cd-953dedc4547f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:20.019826 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ec2dc-d7d8-44c7-97cd-953dedc4547f service cinder] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:20.024805 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c020c38a-2ce0-4c3c-8118-f2b4bf1051ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:20.025754 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020c38a-2ce0-4c3c-8118-f2b4bf1051ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:20.026115 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020c38a-2ce0-4c3c-8118-f2b4bf1051ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:20.026469 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020c38a-2ce0-4c3c-8118-f2b4bf1051ad admin admin] PATH_INFO: `/v3/users/4ab986cd7e8e4ac78cc00b3c56ff3021` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:20.027754 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c020c38a-2ce0-4c3c-8118-f2b4bf1051ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ab986cd7e8e4ac78cc00b3c56ff3021)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:20.029805 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c020c38a-2ce0-4c3c-8118-f2b4bf1051ad admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:20.064723 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5b254ac7-3aed-4d58-a65e-bd4771b1bfde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd52a3f6d2c8b49c09ec485f8c90a04a5'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:20.065376 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5b254ac7-3aed-4d58-a65e-bd4771b1bfde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd52a3f6d2c8b49c09ec485f8c90a04a5'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:20.065992 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5b254ac7-3aed-4d58-a65e-bd4771b1bfde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd52a3f6d2c8b49c09ec485f8c90a04a5'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:20.078977 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1072/2133] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:29:19 2022] DELETE /identity/v3/users/d52a3f6d2c8b49c09ec485f8c90a04a5 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:29:20.083435 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f547b1d-04d7-4846-9205-f91a7ef78ec5 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:20.083822 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f547b1d-04d7-4846-9205-f91a7ef78ec5 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:20.084191 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f547b1d-04d7-4846-9205-f91a7ef78ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:20.100774 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-5f547b1d-04d7-4846-9205-f91a7ef78ec5 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:29:20.101980 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-5f547b1d-04d7-4846-9205-f91a7ef78ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:20.173343 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1073/2134] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:29:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:29:20.188657 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f547b1d-04d7-4846-9205-f91a7ef78ec5 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:20.190063 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-5f547b1d-04d7-4846-9205-f91a7ef78ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:20.250614 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f547b1d-04d7-4846-9205-f91a7ef78ec5 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:20.254249 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b39cad-44c8-425b-911c-1d2bb794c9f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:20.257963 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b39cad-44c8-425b-911c-1d2bb794c9f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:20.257963 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b39cad-44c8-425b-911c-1d2bb794c9f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:20.257963 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b39cad-44c8-425b-911c-1d2bb794c9f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:20.261131 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-c020c38a-2ce0-4c3c-8118-f2b4bf1051ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ab986cd7e8e4ac78cc00b3c56ff3021'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:20.261777 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-c020c38a-2ce0-4c3c-8118-f2b4bf1051ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ab986cd7e8e4ac78cc00b3c56ff3021'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:20.264498 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b39cad-44c8-425b-911c-1d2bb794c9f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:20.265924 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b39cad-44c8-425b-911c-1d2bb794c9f9 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:20.275368 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1074/2135] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:29:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 07 06:29:20.333525 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-c020c38a-2ce0-4c3c-8118-f2b4bf1051ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ab986cd7e8e4ac78cc00b3c56ff3021'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:20.334221 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-c020c38a-2ce0-4c3c-8118-f2b4bf1051ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ab986cd7e8e4ac78cc00b3c56ff3021'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:20.347518 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-c020c38a-2ce0-4c3c-8118-f2b4bf1051ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ab986cd7e8e4ac78cc00b3c56ff3021'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:20.360077 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1062/2136] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:29:20 2022] DELETE /identity/v3/users/4ab986cd7e8e4ac78cc00b3c56ff3021 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:29:20.365115 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9fba8c-4e60-4bac-acda-61baedc56c63 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:20.365406 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9fba8c-4e60-4bac-acda-61baedc56c63 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:20.365703 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9fba8c-4e60-4bac-acda-61baedc56c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:20.382629 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-4c9fba8c-4e60-4bac-acda-61baedc56c63 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:29:20.383838 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-4c9fba8c-4e60-4bac-acda-61baedc56c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:20.439674 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1075/2137] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:29:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:29:20.449375 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c020c38a-2ce0-4c3c-8118-f2b4bf1051ad admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:20.450798 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-c020c38a-2ce0-4c3c-8118-f2b4bf1051ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:20.510528 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c020c38a-2ce0-4c3c-8118-f2b4bf1051ad admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:20.523238 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d14e1-765f-4f85-a77e-089df45a6ffa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:20.523957 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d14e1-765f-4f85-a77e-089df45a6ffa service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:20.524248 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d14e1-765f-4f85-a77e-089df45a6ffa service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:20.524525 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d14e1-765f-4f85-a77e-089df45a6ffa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:20.535614 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9d14e1-765f-4f85-a77e-089df45a6ffa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:20.541226 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9d14e1-765f-4f85-a77e-089df45a6ffa service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:20.554591 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1063/2138] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:29:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 07 06:29:20.734711 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9fba8c-4e60-4bac-acda-61baedc56c63 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:20.736387 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-4c9fba8c-4e60-4bac-acda-61baedc56c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:20.751035 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9fba8c-4e60-4bac-acda-61baedc56c63 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:20.756785 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d610177a-7f0e-4d8e-9ef7-c2df58437beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:20.757790 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610177a-7f0e-4d8e-9ef7-c2df58437beb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:20.758236 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610177a-7f0e-4d8e-9ef7-c2df58437beb admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:20.758553 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610177a-7f0e-4d8e-9ef7-c2df58437beb admin admin] PATH_INFO: `/v3/projects/7ee3a57839d64592b097e00d58acf53f` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:20.759930 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d610177a-7f0e-4d8e-9ef7-c2df58437beb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ee3a57839d64592b097e00d58acf53f)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:20.762156 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d610177a-7f0e-4d8e-9ef7-c2df58437beb admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:20.921812 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d610177a-7f0e-4d8e-9ef7-c2df58437beb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ee3a57839d64592b097e00d58acf53f', 'request_id': 'req-d610177a-7f0e-4d8e-9ef7-c2df58437beb'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:20.927961 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d610177a-7f0e-4d8e-9ef7-c2df58437beb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ee3a57839d64592b097e00d58acf53f', 'request_id': 'req-d610177a-7f0e-4d8e-9ef7-c2df58437beb'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:21.013209 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d610177a-7f0e-4d8e-9ef7-c2df58437beb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ee3a57839d64592b097e00d58acf53f', 'request_id': 'req-d610177a-7f0e-4d8e-9ef7-c2df58437beb'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:21.024479 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d610177a-7f0e-4d8e-9ef7-c2df58437beb admin admin] The token cache is being invalidate because project 7ee3a57839d64592b097e00d58acf53f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:29:21.024765 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d610177a-7f0e-4d8e-9ef7-c2df58437beb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:21.025391 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d610177a-7f0e-4d8e-9ef7-c2df58437beb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:21.027030 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1076/2139] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:29:20 2022] DELETE /identity/v3/projects/7ee3a57839d64592b097e00d58acf53f => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:29:21.204439 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d14e1-765f-4f85-a77e-089df45a6ffa service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:21.206510 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-bb9d14e1-765f-4f85-a77e-089df45a6ffa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:21.224690 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d14e1-765f-4f85-a77e-089df45a6ffa service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:21.282539 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b13ff-ff06-4df2-a5a2-fd49b50827bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:21.283389 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b13ff-ff06-4df2-a5a2-fd49b50827bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:21.283667 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b13ff-ff06-4df2-a5a2-fd49b50827bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:21.283964 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b13ff-ff06-4df2-a5a2-fd49b50827bb admin admin] PATH_INFO: `/v3/projects/8a92d3afbcc04f4ea373ef097d274f99` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:21.285128 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694b13ff-ff06-4df2-a5a2-fd49b50827bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a92d3afbcc04f4ea373ef097d274f99)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:21.287070 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694b13ff-ff06-4df2-a5a2-fd49b50827bb admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:21.481250 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-694b13ff-ff06-4df2-a5a2-fd49b50827bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a92d3afbcc04f4ea373ef097d274f99', 'request_id': 'req-694b13ff-ff06-4df2-a5a2-fd49b50827bb'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:21.486467 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-694b13ff-ff06-4df2-a5a2-fd49b50827bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a92d3afbcc04f4ea373ef097d274f99', 'request_id': 'req-694b13ff-ff06-4df2-a5a2-fd49b50827bb'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:21.578867 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-694b13ff-ff06-4df2-a5a2-fd49b50827bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a92d3afbcc04f4ea373ef097d274f99', 'request_id': 'req-694b13ff-ff06-4df2-a5a2-fd49b50827bb'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:21.590007 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-694b13ff-ff06-4df2-a5a2-fd49b50827bb admin admin] The token cache is being invalidate because project 8a92d3afbcc04f4ea373ef097d274f99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:29:21.594580 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-694b13ff-ff06-4df2-a5a2-fd49b50827bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:21.594580 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-694b13ff-ff06-4df2-a5a2-fd49b50827bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:21.594580 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1064/2140] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:29:21 2022] DELETE /identity/v3/projects/8a92d3afbcc04f4ea373ef097d274f99 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:29:21.598019 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec02df8-dde9-40aa-a1c5-d8ed312f9545 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:21.598307 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec02df8-dde9-40aa-a1c5-d8ed312f9545 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:21.598580 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec02df8-dde9-40aa-a1c5-d8ed312f9545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:21.616401 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-5ec02df8-dde9-40aa-a1c5-d8ed312f9545 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:29:21.617631 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-5ec02df8-dde9-40aa-a1c5-d8ed312f9545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:21.675123 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1077/2141] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:29:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:29:21.682543 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d2dec-f83a-443f-9744-045c4dcea459 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:21.682826 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d2dec-f83a-443f-9744-045c4dcea459 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:21.683108 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d2dec-f83a-443f-9744-045c4dcea459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:21.701269 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-627d2dec-f83a-443f-9744-045c4dcea459 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:29:21.703049 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-627d2dec-f83a-443f-9744-045c4dcea459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:21.710907 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1065/2142] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:29:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:29:21.715208 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec02df8-dde9-40aa-a1c5-d8ed312f9545 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:21.725279 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec02df8-dde9-40aa-a1c5-d8ed312f9545 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:21.729897 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a70b5e-c673-4d95-a69f-bf69db8c6373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:21.730552 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a70b5e-c673-4d95-a69f-bf69db8c6373 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:21.730836 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a70b5e-c673-4d95-a69f-bf69db8c6373 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:21.731108 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a70b5e-c673-4d95-a69f-bf69db8c6373 admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:21.731881 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a70b5e-c673-4d95-a69f-bf69db8c6373 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:29:21.732191 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a70b5e-c673-4d95-a69f-bf69db8c6373 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:21.733805 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a70b5e-c673-4d95-a69f-bf69db8c6373 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:21.745508 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1078/2143] 10.222.0.24 () {58 vars in 1152 bytes} [Thu Apr 7 06:29:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:29:21.750294 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d2dec-f83a-443f-9744-045c4dcea459 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:21.761771 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d2dec-f83a-443f-9744-045c4dcea459 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:21.772638 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07d4b77-de51-4360-a5b6-80de882a473d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:21.773322 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d4b77-de51-4360-a5b6-80de882a473d admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:21.773652 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d4b77-de51-4360-a5b6-80de882a473d admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:21.773930 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d4b77-de51-4360-a5b6-80de882a473d admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:21.774728 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07d4b77-de51-4360-a5b6-80de882a473d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:21.776659 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07d4b77-de51-4360-a5b6-80de882a473d admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:21.943439 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1066/2144] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:29:21 2022] POST /identity/v3/projects => generated 385 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:29:21.944624 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a70b5e-c673-4d95-a69f-bf69db8c6373 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:21.954194 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a70b5e-c673-4d95-a69f-bf69db8c6373 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:22.018392 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad9e85e-d2ae-4821-9632-fc088b45c93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:22.018392 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9e85e-d2ae-4821-9632-fc088b45c93a admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:22.018392 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9e85e-d2ae-4821-9632-fc088b45c93a admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:22.018392 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9e85e-d2ae-4821-9632-fc088b45c93a admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:22.018770 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad9e85e-d2ae-4821-9632-fc088b45c93a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:22.019164 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad9e85e-d2ae-4821-9632-fc088b45c93a admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:22.116296 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1079/2145] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:29:21 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:29:22.120208 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07d4b77-de51-4360-a5b6-80de882a473d admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:22.130567 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07d4b77-de51-4360-a5b6-80de882a473d admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:22.135532 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bb3437-0d6b-4634-ac2a-1438797d1d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:22.136236 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb3437-0d6b-4634-ac2a-1438797d1d77 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:22.136520 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb3437-0d6b-4634-ac2a-1438797d1d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:22.136796 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb3437-0d6b-4634-ac2a-1438797d1d77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:22.137550 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bb3437-0d6b-4634-ac2a-1438797d1d77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:22.139629 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bb3437-0d6b-4634-ac2a-1438797d1d77 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:22.150126 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1067/2146] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:29:22.154240 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad9e85e-d2ae-4821-9632-fc088b45c93a admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:22.164701 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad9e85e-d2ae-4821-9632-fc088b45c93a admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:22.169226 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad144d-ea35-493c-b2d8-74704098c3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:22.169879 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad144d-ea35-493c-b2d8-74704098c3d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:22.170165 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad144d-ea35-493c-b2d8-74704098c3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:22.170445 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad144d-ea35-493c-b2d8-74704098c3d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:22.171174 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad144d-ea35-493c-b2d8-74704098c3d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:22.172813 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad144d-ea35-493c-b2d8-74704098c3d7 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:22.183535 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1080/2147] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:29:22.186812 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bb3437-0d6b-4634-ac2a-1438797d1d77 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:22.198246 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bb3437-0d6b-4634-ac2a-1438797d1d77 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:22.203559 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9ce1c8-4aae-48a2-91f2-8710e9be86d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:22.204537 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ce1c8-4aae-48a2-91f2-8710e9be86d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:22.209042 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ce1c8-4aae-48a2-91f2-8710e9be86d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:22.209042 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ce1c8-4aae-48a2-91f2-8710e9be86d5 admin admin] PATH_INFO: `/v3/projects/3b48f9cff8c14cc08138fdf80d7d24e4/users/f7ce91e37e3d4377a4a6c5dcd35b7736/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:22.220523 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9ce1c8-4aae-48a2-91f2-8710e9be86d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b48f9cff8c14cc08138fdf80d7d24e4, user_id=f7ce91e37e3d4377a4a6c5dcd35b7736, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:22.223192 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9ce1c8-4aae-48a2-91f2-8710e9be86d5 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:22.310227 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1068/2148] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:29:22 2022] PUT /identity/v3/projects/3b48f9cff8c14cc08138fdf80d7d24e4/users/f7ce91e37e3d4377a4a6c5dcd35b7736/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:29:22.320678 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab1e89-412f-4767-add3-646672f81681 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:22.320955 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab1e89-412f-4767-add3-646672f81681 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:22.321241 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab1e89-412f-4767-add3-646672f81681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:22.347920 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-47ab1e89-412f-4767-add3-646672f81681 None None] MFA Rules not processed for user `f7ce91e37e3d4377a4a6c5dcd35b7736`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:29:22.349097 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-47ab1e89-412f-4767-add3-646672f81681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:22.413291 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1081/2149] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:29:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:29:22.424757 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9ce1c8-4aae-48a2-91f2-8710e9be86d5 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:22.426506 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-4b9ce1c8-4aae-48a2-91f2-8710e9be86d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:22.483081 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9ce1c8-4aae-48a2-91f2-8710e9be86d5 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:22.488105 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43485fe-f081-4a2a-878a-104be487d2c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:22.488105 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43485fe-f081-4a2a-878a-104be487d2c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:22.488105 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43485fe-f081-4a2a-878a-104be487d2c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:22.488105 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43485fe-f081-4a2a-878a-104be487d2c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:22.497770 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43485fe-f081-4a2a-878a-104be487d2c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:22.500086 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43485fe-f081-4a2a-878a-104be487d2c6 service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:22.509250 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1069/2150] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:29:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:29:25.724801 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ab1e89-412f-4767-add3-646672f81681 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:25.793710 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ab1e89-412f-4767-add3-646672f81681 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:25.799271 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9ee81-ce3c-4be3-81f8-0c5da8f14520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:25.800349 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9ee81-ce3c-4be3-81f8-0c5da8f14520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:25.800580 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9ee81-ce3c-4be3-81f8-0c5da8f14520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:25.800853 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9ee81-ce3c-4be3-81f8-0c5da8f14520 admin admin] PATH_INFO: `/v3/users/f7ce91e37e3d4377a4a6c5dcd35b7736` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:25.802123 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c9ee81-ce3c-4be3-81f8-0c5da8f14520 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7ce91e37e3d4377a4a6c5dcd35b7736)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:25.804093 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c9ee81-ce3c-4be3-81f8-0c5da8f14520 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:26.061159 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-63c9ee81-ce3c-4be3-81f8-0c5da8f14520 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7ce91e37e3d4377a4a6c5dcd35b7736'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:26.073342 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-63c9ee81-ce3c-4be3-81f8-0c5da8f14520 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7ce91e37e3d4377a4a6c5dcd35b7736'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:26.167215 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-63c9ee81-ce3c-4be3-81f8-0c5da8f14520 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7ce91e37e3d4377a4a6c5dcd35b7736'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:26.168390 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-63c9ee81-ce3c-4be3-81f8-0c5da8f14520 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7ce91e37e3d4377a4a6c5dcd35b7736'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:26.168620 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-63c9ee81-ce3c-4be3-81f8-0c5da8f14520 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7ce91e37e3d4377a4a6c5dcd35b7736'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:26.181503 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1082/2151] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:29:25 2022] DELETE /identity/v3/users/f7ce91e37e3d4377a4a6c5dcd35b7736 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:29:26.186047 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f6861-3d91-46f2-8657-d09a100cacd7 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:26.186520 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f6861-3d91-46f2-8657-d09a100cacd7 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:26.186610 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f6861-3d91-46f2-8657-d09a100cacd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:26.204052 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-3e4f6861-3d91-46f2-8657-d09a100cacd7 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:29:26.205274 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-3e4f6861-3d91-46f2-8657-d09a100cacd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:26.265726 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1070/2152] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:29:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:29:26.276515 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9ee81-ce3c-4be3-81f8-0c5da8f14520 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:26.278057 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-63c9ee81-ce3c-4be3-81f8-0c5da8f14520 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:26.344380 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9ee81-ce3c-4be3-81f8-0c5da8f14520 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:26.348053 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbeb989-3f1a-4530-b021-2273d6b69da5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:26.348732 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbeb989-3f1a-4530-b021-2273d6b69da5 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:26.353192 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbeb989-3f1a-4530-b021-2273d6b69da5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:26.353192 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbeb989-3f1a-4530-b021-2273d6b69da5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:26.358506 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbeb989-3f1a-4530-b021-2273d6b69da5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:26.360609 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbeb989-3f1a-4530-b021-2273d6b69da5 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:26.370560 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1083/2153] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:29:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:29:26.790454 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4f6861-3d91-46f2-8657-d09a100cacd7 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:26.791938 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-3e4f6861-3d91-46f2-8657-d09a100cacd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:26.804920 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4f6861-3d91-46f2-8657-d09a100cacd7 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:26.809532 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb8178-e4c1-4263-855d-addd2cc5660c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:26.810397 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb8178-e4c1-4263-855d-addd2cc5660c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:26.810679 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb8178-e4c1-4263-855d-addd2cc5660c admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:26.810953 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb8178-e4c1-4263-855d-addd2cc5660c admin admin] PATH_INFO: `/v3/projects/3b48f9cff8c14cc08138fdf80d7d24e4` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:26.812212 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cb8178-e4c1-4263-855d-addd2cc5660c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b48f9cff8c14cc08138fdf80d7d24e4)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:26.814130 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cb8178-e4c1-4263-855d-addd2cc5660c admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:26.938384 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-69cb8178-e4c1-4263-855d-addd2cc5660c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b48f9cff8c14cc08138fdf80d7d24e4', 'request_id': 'req-69cb8178-e4c1-4263-855d-addd2cc5660c'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:26.944686 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-69cb8178-e4c1-4263-855d-addd2cc5660c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b48f9cff8c14cc08138fdf80d7d24e4', 'request_id': 'req-69cb8178-e4c1-4263-855d-addd2cc5660c'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:27.013429 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-69cb8178-e4c1-4263-855d-addd2cc5660c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b48f9cff8c14cc08138fdf80d7d24e4', 'request_id': 'req-69cb8178-e4c1-4263-855d-addd2cc5660c'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:27.029904 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-69cb8178-e4c1-4263-855d-addd2cc5660c admin admin] The token cache is being invalidate because project 3b48f9cff8c14cc08138fdf80d7d24e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:29:27.029904 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-69cb8178-e4c1-4263-855d-addd2cc5660c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:27.030547 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-69cb8178-e4c1-4263-855d-addd2cc5660c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:27.032392 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1071/2154] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:29:26 2022] DELETE /identity/v3/projects/3b48f9cff8c14cc08138fdf80d7d24e4 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:29:27.037602 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f96728e-60a8-4d69-b6e2-dc0a98d84160 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:27.038885 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f96728e-60a8-4d69-b6e2-dc0a98d84160 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:27.039430 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f96728e-60a8-4d69-b6e2-dc0a98d84160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:27.060988 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-7f96728e-60a8-4d69-b6e2-dc0a98d84160 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:29:27.062864 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-7f96728e-60a8-4d69-b6e2-dc0a98d84160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:27.123611 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1084/2155] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:29:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:29:27.132667 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd4a5d-696a-4e6f-ac62-6f1bd96c1722 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:27.132947 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd4a5d-696a-4e6f-ac62-6f1bd96c1722 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:27.133225 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd4a5d-696a-4e6f-ac62-6f1bd96c1722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:27.151344 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-accd4a5d-696a-4e6f-ac62-6f1bd96c1722 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:29:27.152589 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-accd4a5d-696a-4e6f-ac62-6f1bd96c1722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:27.161315 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1072/2156] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:29:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:29:27.165827 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f96728e-60a8-4d69-b6e2-dc0a98d84160 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:27.176315 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f96728e-60a8-4d69-b6e2-dc0a98d84160 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:27.181855 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461049cf-3199-4867-9cbc-08fb3bfcb076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:27.182530 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461049cf-3199-4867-9cbc-08fb3bfcb076 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:27.182905 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461049cf-3199-4867-9cbc-08fb3bfcb076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:27.183271 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461049cf-3199-4867-9cbc-08fb3bfcb076 admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:27.184043 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461049cf-3199-4867-9cbc-08fb3bfcb076 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:29:27.184356 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461049cf-3199-4867-9cbc-08fb3bfcb076 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:27.186149 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461049cf-3199-4867-9cbc-08fb3bfcb076 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:27.197741 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1085/2157] 10.222.0.24 () {58 vars in 1152 bytes} [Thu Apr 7 06:29:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:29:27.207439 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd4a5d-696a-4e6f-ac62-6f1bd96c1722 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:27.216600 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd4a5d-696a-4e6f-ac62-6f1bd96c1722 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:27.221824 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877727ba-e020-489f-b9e1-f0f1dd996826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:27.222468 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877727ba-e020-489f-b9e1-f0f1dd996826 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:27.222756 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877727ba-e020-489f-b9e1-f0f1dd996826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:27.223037 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877727ba-e020-489f-b9e1-f0f1dd996826 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:27.223762 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877727ba-e020-489f-b9e1-f0f1dd996826 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:27.225847 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877727ba-e020-489f-b9e1-f0f1dd996826 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:27.317155 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1073/2158] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:29:27 2022] POST /identity/v3/projects => generated 375 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:29:27.321272 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461049cf-3199-4867-9cbc-08fb3bfcb076 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:27.331453 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461049cf-3199-4867-9cbc-08fb3bfcb076 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:27.385396 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b02529-b025-489c-8c23-3202fdc0b59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:27.386069 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b02529-b025-489c-8c23-3202fdc0b59a admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:27.386360 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b02529-b025-489c-8c23-3202fdc0b59a admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:27.386672 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b02529-b025-489c-8c23-3202fdc0b59a admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:27.387374 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b02529-b025-489c-8c23-3202fdc0b59a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:27.389323 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b02529-b025-489c-8c23-3202fdc0b59a admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:27.519673 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1086/2159] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:29:27 2022] POST /identity/v3/users => generated 288 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:29:27.520896 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877727ba-e020-489f-b9e1-f0f1dd996826 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:27.531581 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877727ba-e020-489f-b9e1-f0f1dd996826 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:27.536144 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a53e70-ec57-4b9f-9ebe-98fe411630e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:27.537014 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a53e70-ec57-4b9f-9ebe-98fe411630e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:27.537244 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a53e70-ec57-4b9f-9ebe-98fe411630e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:27.537524 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a53e70-ec57-4b9f-9ebe-98fe411630e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:27.538259 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a53e70-ec57-4b9f-9ebe-98fe411630e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:27.539878 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a53e70-ec57-4b9f-9ebe-98fe411630e8 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:27.553373 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1074/2160] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 07 06:29:27.554350 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b02529-b025-489c-8c23-3202fdc0b59a admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:27.564176 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b02529-b025-489c-8c23-3202fdc0b59a admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:27.568944 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e4289c-6c15-4e1a-a0bf-febf046e224f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:27.569541 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4289c-6c15-4e1a-a0bf-febf046e224f admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:27.569830 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4289c-6c15-4e1a-a0bf-febf046e224f admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:27.570107 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4289c-6c15-4e1a-a0bf-febf046e224f admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:27.570833 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e4289c-6c15-4e1a-a0bf-febf046e224f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:27.572468 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e4289c-6c15-4e1a-a0bf-febf046e224f admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:27.582529 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1087/2161] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:29:27.586433 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a53e70-ec57-4b9f-9ebe-98fe411630e8 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:27.596253 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a53e70-ec57-4b9f-9ebe-98fe411630e8 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:27.600890 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf1c98b-a70e-431d-921f-babbac9ea4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:27.601860 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1c98b-a70e-431d-921f-babbac9ea4a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:27.602033 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1c98b-a70e-431d-921f-babbac9ea4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:27.602313 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1c98b-a70e-431d-921f-babbac9ea4a7 admin admin] PATH_INFO: `/v3/projects/cdda24c5092f4244a724c551324165fe/users/9260af21404840168be51023c5171fdd/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:27.617481 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf1c98b-a70e-431d-921f-babbac9ea4a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdda24c5092f4244a724c551324165fe, user_id=9260af21404840168be51023c5171fdd, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:27.620192 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf1c98b-a70e-431d-921f-babbac9ea4a7 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:27.698692 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1075/2162] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:29:27 2022] PUT /identity/v3/projects/cdda24c5092f4244a724c551324165fe/users/9260af21404840168be51023c5171fdd/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:29:27.709274 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f118a-025d-48bd-9fc6-1cd433ac6054 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:27.709576 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f118a-025d-48bd-9fc6-1cd433ac6054 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:27.709862 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f118a-025d-48bd-9fc6-1cd433ac6054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:27.737087 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-782f118a-025d-48bd-9fc6-1cd433ac6054 None None] MFA Rules not processed for user `9260af21404840168be51023c5171fdd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:29:27.738342 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-782f118a-025d-48bd-9fc6-1cd433ac6054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:27.801255 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1088/2163] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:29:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:29:27.811858 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf1c98b-a70e-431d-921f-babbac9ea4a7 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:27.813603 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-6bf1c98b-a70e-431d-921f-babbac9ea4a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:27.878157 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf1c98b-a70e-431d-921f-babbac9ea4a7 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:27.881756 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd2121-8c93-4329-ad30-7efa990b941f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:27.882418 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd2121-8c93-4329-ad30-7efa990b941f service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:27.882702 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd2121-8c93-4329-ad30-7efa990b941f service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:27.882978 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd2121-8c93-4329-ad30-7efa990b941f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:27.891045 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bd2121-8c93-4329-ad30-7efa990b941f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:27.892557 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bd2121-8c93-4329-ad30-7efa990b941f service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:27.901081 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1076/2164] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:29:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:29:28.253421 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f118a-025d-48bd-9fc6-1cd433ac6054 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:28.254816 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-782f118a-025d-48bd-9fc6-1cd433ac6054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:28.317706 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f118a-025d-48bd-9fc6-1cd433ac6054 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:28.322207 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a227673-bb31-40a0-99a2-65c6f3852c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:28.323076 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a227673-bb31-40a0-99a2-65c6f3852c65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:28.323360 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a227673-bb31-40a0-99a2-65c6f3852c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:28.323634 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a227673-bb31-40a0-99a2-65c6f3852c65 admin admin] PATH_INFO: `/v3/users/ee1cbc341583498e8865a5fc0a2f8458` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:28.324847 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a227673-bb31-40a0-99a2-65c6f3852c65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee1cbc341583498e8865a5fc0a2f8458)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:28.326855 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a227673-bb31-40a0-99a2-65c6f3852c65 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:28.610567 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7a227673-bb31-40a0-99a2-65c6f3852c65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee1cbc341583498e8865a5fc0a2f8458'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:28.624223 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7a227673-bb31-40a0-99a2-65c6f3852c65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee1cbc341583498e8865a5fc0a2f8458'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:28.779312 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7a227673-bb31-40a0-99a2-65c6f3852c65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee1cbc341583498e8865a5fc0a2f8458'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:28.782460 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7a227673-bb31-40a0-99a2-65c6f3852c65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee1cbc341583498e8865a5fc0a2f8458'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:28.785035 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7a227673-bb31-40a0-99a2-65c6f3852c65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee1cbc341583498e8865a5fc0a2f8458'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:28.817299 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1089/2165] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:29:28 2022] DELETE /identity/v3/users/ee1cbc341583498e8865a5fc0a2f8458 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:29:28.821826 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ef092-a241-459d-b7a1-72573feab767 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:28.822269 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ef092-a241-459d-b7a1-72573feab767 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:28.822429 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ef092-a241-459d-b7a1-72573feab767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:28.880533 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-df4ef092-a241-459d-b7a1-72573feab767 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:29:28.883905 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-df4ef092-a241-459d-b7a1-72573feab767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:28.964315 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1077/2166] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:29:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:29:28.976799 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a227673-bb31-40a0-99a2-65c6f3852c65 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:28.978416 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-7a227673-bb31-40a0-99a2-65c6f3852c65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:29.035446 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a227673-bb31-40a0-99a2-65c6f3852c65 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:29.039602 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb92a7-b58c-4d99-96f7-457addc52034 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:29.040312 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb92a7-b58c-4d99-96f7-457addc52034 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:29.040592 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb92a7-b58c-4d99-96f7-457addc52034 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:29.040872 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb92a7-b58c-4d99-96f7-457addc52034 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:29.051102 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acb92a7-b58c-4d99-96f7-457addc52034 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:29.052568 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acb92a7-b58c-4d99-96f7-457addc52034 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:29.062834 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1090/2167] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:29:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 07 06:29:29.769651 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ef092-a241-459d-b7a1-72573feab767 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:29.771090 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-df4ef092-a241-459d-b7a1-72573feab767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:29.784893 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ef092-a241-459d-b7a1-72573feab767 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:29.791073 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ba51d7-ccea-4451-b985-b68e6db548ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:29.792183 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba51d7-ccea-4451-b985-b68e6db548ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:29.792919 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba51d7-ccea-4451-b985-b68e6db548ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:29.793624 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba51d7-ccea-4451-b985-b68e6db548ca admin admin] PATH_INFO: `/v3/projects/25fd9aaa60524cc0b9e57e5f17b55fb4` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:29.794580 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ba51d7-ccea-4451-b985-b68e6db548ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=25fd9aaa60524cc0b9e57e5f17b55fb4)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:29.798184 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ba51d7-ccea-4451-b985-b68e6db548ca admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:29.913728 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-12ba51d7-ccea-4451-b985-b68e6db548ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25fd9aaa60524cc0b9e57e5f17b55fb4', 'request_id': 'req-12ba51d7-ccea-4451-b985-b68e6db548ca'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:29.923832 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-12ba51d7-ccea-4451-b985-b68e6db548ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25fd9aaa60524cc0b9e57e5f17b55fb4', 'request_id': 'req-12ba51d7-ccea-4451-b985-b68e6db548ca'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:29.973063 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-12ba51d7-ccea-4451-b985-b68e6db548ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25fd9aaa60524cc0b9e57e5f17b55fb4', 'request_id': 'req-12ba51d7-ccea-4451-b985-b68e6db548ca'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:30.004859 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-12ba51d7-ccea-4451-b985-b68e6db548ca admin admin] The token cache is being invalidate because project 25fd9aaa60524cc0b9e57e5f17b55fb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:29:30.005206 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-12ba51d7-ccea-4451-b985-b68e6db548ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:30.005968 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-12ba51d7-ccea-4451-b985-b68e6db548ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:30.007530 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1078/2168] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:29:29 2022] DELETE /identity/v3/projects/25fd9aaa60524cc0b9e57e5f17b55fb4 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:29:30.011553 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb92a7-b58c-4d99-96f7-457addc52034 service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:30.021733 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb92a7-b58c-4d99-96f7-457addc52034 service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:30.085717 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ee185-d58a-4d2d-b52c-78206351b629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:30.086815 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ee185-d58a-4d2d-b52c-78206351b629 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:30.086930 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ee185-d58a-4d2d-b52c-78206351b629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:30.087291 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ee185-d58a-4d2d-b52c-78206351b629 admin admin] PATH_INFO: `/v3/users/b4f35beae1e844e58841439193afab3f` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:30.088402 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0ee185-d58a-4d2d-b52c-78206351b629 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4f35beae1e844e58841439193afab3f)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:30.090551 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0ee185-d58a-4d2d-b52c-78206351b629 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:30.277993 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7c0ee185-d58a-4d2d-b52c-78206351b629 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4f35beae1e844e58841439193afab3f'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:30.290744 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7c0ee185-d58a-4d2d-b52c-78206351b629 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4f35beae1e844e58841439193afab3f'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:30.384621 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7c0ee185-d58a-4d2d-b52c-78206351b629 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4f35beae1e844e58841439193afab3f'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:30.385258 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7c0ee185-d58a-4d2d-b52c-78206351b629 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4f35beae1e844e58841439193afab3f'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:30.385868 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7c0ee185-d58a-4d2d-b52c-78206351b629 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4f35beae1e844e58841439193afab3f'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:30.398989 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1091/2169] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:29:30 2022] DELETE /identity/v3/users/b4f35beae1e844e58841439193afab3f => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:29:30.874345 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ba51d7-ccea-4451-b985-b68e6db548ca admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:30.876936 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-12ba51d7-ccea-4451-b985-b68e6db548ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:30.891700 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ba51d7-ccea-4451-b985-b68e6db548ca admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:30.955373 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3816588-56e2-452b-b9be-ae20cbd4d9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:30.956316 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3816588-56e2-452b-b9be-ae20cbd4d9a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:30.956599 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3816588-56e2-452b-b9be-ae20cbd4d9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:30.956878 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3816588-56e2-452b-b9be-ae20cbd4d9a4 admin admin] PATH_INFO: `/v3/projects/3c5d319d2d1243fd8291b1309a4571c5` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:30.958118 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3816588-56e2-452b-b9be-ae20cbd4d9a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c5d319d2d1243fd8291b1309a4571c5)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:30.960082 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3816588-56e2-452b-b9be-ae20cbd4d9a4 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:31.095663 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-f3816588-56e2-452b-b9be-ae20cbd4d9a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c5d319d2d1243fd8291b1309a4571c5', 'request_id': 'req-f3816588-56e2-452b-b9be-ae20cbd4d9a4'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:31.101700 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-f3816588-56e2-452b-b9be-ae20cbd4d9a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c5d319d2d1243fd8291b1309a4571c5', 'request_id': 'req-f3816588-56e2-452b-b9be-ae20cbd4d9a4'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:31.179119 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-f3816588-56e2-452b-b9be-ae20cbd4d9a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c5d319d2d1243fd8291b1309a4571c5', 'request_id': 'req-f3816588-56e2-452b-b9be-ae20cbd4d9a4'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:31.191858 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-f3816588-56e2-452b-b9be-ae20cbd4d9a4 admin admin] The token cache is being invalidate because project 3c5d319d2d1243fd8291b1309a4571c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:29:31.192158 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-f3816588-56e2-452b-b9be-ae20cbd4d9a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:31.193344 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-f3816588-56e2-452b-b9be-ae20cbd4d9a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:31.198071 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1079/2170] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:29:30 2022] DELETE /identity/v3/projects/3c5d319d2d1243fd8291b1309a4571c5 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:29:31.201073 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51a238-e92a-4616-8bcb-09bcf89e1484 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:31.201527 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51a238-e92a-4616-8bcb-09bcf89e1484 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:31.201527 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51a238-e92a-4616-8bcb-09bcf89e1484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:31.228114 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-7b51a238-e92a-4616-8bcb-09bcf89e1484 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:29:31.229355 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-7b51a238-e92a-4616-8bcb-09bcf89e1484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:31.297327 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1092/2171] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:29:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:29:31.306931 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f44f31-517f-42cb-9f2e-0e2a956b50ab None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:31.307276 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f44f31-517f-42cb-9f2e-0e2a956b50ab None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:31.307562 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f44f31-517f-42cb-9f2e-0e2a956b50ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:31.325491 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-c7f44f31-517f-42cb-9f2e-0e2a956b50ab None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:29:31.326696 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-c7f44f31-517f-42cb-9f2e-0e2a956b50ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:31.335178 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1080/2172] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:29:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:29:31.339565 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b51a238-e92a-4616-8bcb-09bcf89e1484 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:31.350234 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b51a238-e92a-4616-8bcb-09bcf89e1484 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:31.354826 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a6aea5-6c62-4fe0-b960-b05c5d8c2bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:31.356953 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6aea5-6c62-4fe0-b960-b05c5d8c2bcf admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:31.356953 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6aea5-6c62-4fe0-b960-b05c5d8c2bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:31.356953 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6aea5-6c62-4fe0-b960-b05c5d8c2bcf admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:31.356953 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a6aea5-6c62-4fe0-b960-b05c5d8c2bcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:29:31.357275 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a6aea5-6c62-4fe0-b960-b05c5d8c2bcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:31.358715 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a6aea5-6c62-4fe0-b960-b05c5d8c2bcf admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:31.370234 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1093/2173] 10.222.0.24 () {58 vars in 1152 bytes} [Thu Apr 7 06:29:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:29:31.374527 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f44f31-517f-42cb-9f2e-0e2a956b50ab None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:31.383986 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f44f31-517f-42cb-9f2e-0e2a956b50ab None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:31.388668 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fefee5-d453-47ec-a15d-e7abef07bc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:31.391468 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fefee5-d453-47ec-a15d-e7abef07bc15 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:31.391468 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fefee5-d453-47ec-a15d-e7abef07bc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:31.391468 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fefee5-d453-47ec-a15d-e7abef07bc15 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:31.391468 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fefee5-d453-47ec-a15d-e7abef07bc15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:31.393090 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fefee5-d453-47ec-a15d-e7abef07bc15 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:31.478859 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1081/2174] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:29:31 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:29:31.482661 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a6aea5-6c62-4fe0-b960-b05c5d8c2bcf admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:31.494186 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a6aea5-6c62-4fe0-b960-b05c5d8c2bcf admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:31.553818 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d02ff8-dfae-4a96-bcbd-a94d351f0fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:31.554506 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d02ff8-dfae-4a96-bcbd-a94d351f0fd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:31.554802 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d02ff8-dfae-4a96-bcbd-a94d351f0fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:31.555082 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d02ff8-dfae-4a96-bcbd-a94d351f0fd7 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:31.555836 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d02ff8-dfae-4a96-bcbd-a94d351f0fd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:31.557784 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d02ff8-dfae-4a96-bcbd-a94d351f0fd7 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:31.653764 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1094/2175] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:29:31 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:29:31.658450 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fefee5-d453-47ec-a15d-e7abef07bc15 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:31.669023 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fefee5-d453-47ec-a15d-e7abef07bc15 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:31.674520 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14fd61-ac98-464f-9fc3-4c49db6d64ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:31.675504 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14fd61-ac98-464f-9fc3-4c49db6d64ba admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:31.675835 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14fd61-ac98-464f-9fc3-4c49db6d64ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:31.676116 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14fd61-ac98-464f-9fc3-4c49db6d64ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:31.676857 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14fd61-ac98-464f-9fc3-4c49db6d64ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:31.678450 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14fd61-ac98-464f-9fc3-4c49db6d64ba admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:31.692479 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1082/2176] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:29:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:29:31.693545 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d02ff8-dfae-4a96-bcbd-a94d351f0fd7 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:31.703528 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d02ff8-dfae-4a96-bcbd-a94d351f0fd7 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:31.708422 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e29cc9d-1f48-41d9-8d44-52928fe60815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:31.709105 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29cc9d-1f48-41d9-8d44-52928fe60815 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:31.709379 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29cc9d-1f48-41d9-8d44-52928fe60815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:31.709656 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29cc9d-1f48-41d9-8d44-52928fe60815 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:31.710420 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e29cc9d-1f48-41d9-8d44-52928fe60815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:31.712042 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e29cc9d-1f48-41d9-8d44-52928fe60815 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:31.722666 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1095/2177] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:29:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 07 06:29:31.726827 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14fd61-ac98-464f-9fc3-4c49db6d64ba admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:31.738113 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14fd61-ac98-464f-9fc3-4c49db6d64ba admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:31.743234 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391314d9-71bd-4d12-91a9-087aeccd9a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:31.744348 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391314d9-71bd-4d12-91a9-087aeccd9a83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:31.744725 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391314d9-71bd-4d12-91a9-087aeccd9a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:31.745079 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391314d9-71bd-4d12-91a9-087aeccd9a83 admin admin] PATH_INFO: `/v3/projects/80a9cbd1f11e4fb4af788df0809bb390/users/0e78c227560945cfb1cf6a8cc4edf3e6/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:31.776540 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391314d9-71bd-4d12-91a9-087aeccd9a83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80a9cbd1f11e4fb4af788df0809bb390, user_id=0e78c227560945cfb1cf6a8cc4edf3e6, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:31.779435 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391314d9-71bd-4d12-91a9-087aeccd9a83 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:31.854003 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1083/2178] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:29:31 2022] PUT /identity/v3/projects/80a9cbd1f11e4fb4af788df0809bb390/users/0e78c227560945cfb1cf6a8cc4edf3e6/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:29:31.864694 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d57a60-29d6-4748-9275-3307c9a5f385 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:31.872204 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d57a60-29d6-4748-9275-3307c9a5f385 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:31.872603 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d57a60-29d6-4748-9275-3307c9a5f385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:31.899907 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-18d57a60-29d6-4748-9275-3307c9a5f385 None None] MFA Rules not processed for user `0e78c227560945cfb1cf6a8cc4edf3e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:29:31.901102 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-18d57a60-29d6-4748-9275-3307c9a5f385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:31.975781 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1096/2179] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:29:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:29:31.976810 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391314d9-71bd-4d12-91a9-087aeccd9a83 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:32.038135 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391314d9-71bd-4d12-91a9-087aeccd9a83 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:32.043051 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e9059-143c-431d-9985-a0d8371f75fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:32.043784 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e9059-143c-431d-9985-a0d8371f75fa admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:32.044253 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e9059-143c-431d-9985-a0d8371f75fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:32.044463 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e9059-143c-431d-9985-a0d8371f75fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:32.045184 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532e9059-143c-431d-9985-a0d8371f75fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:32.047189 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532e9059-143c-431d-9985-a0d8371f75fa admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:32.140385 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1084/2180] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:29:31 2022] POST /identity/v3/projects => generated 381 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:29:32.144661 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d57a60-29d6-4748-9275-3307c9a5f385 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:32.155653 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d57a60-29d6-4748-9275-3307c9a5f385 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:32.210024 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e90527-b22a-40d9-a57d-f94ebd1f6b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:32.210737 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e90527-b22a-40d9-a57d-f94ebd1f6b57 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:32.211025 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e90527-b22a-40d9-a57d-f94ebd1f6b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:32.211300 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e90527-b22a-40d9-a57d-f94ebd1f6b57 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:32.213587 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e90527-b22a-40d9-a57d-f94ebd1f6b57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:32.215542 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e90527-b22a-40d9-a57d-f94ebd1f6b57 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:32.330068 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1097/2181] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:29:32 2022] POST /identity/v3/users => generated 297 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:29:32.334121 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e9059-143c-431d-9985-a0d8371f75fa admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:32.373191 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e9059-143c-431d-9985-a0d8371f75fa admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:32.388482 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9703510-b817-49a7-bd8d-2bc374937fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:32.389186 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9703510-b817-49a7-bd8d-2bc374937fdc admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:32.389481 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9703510-b817-49a7-bd8d-2bc374937fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:32.389756 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9703510-b817-49a7-bd8d-2bc374937fdc admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:32.390719 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9703510-b817-49a7-bd8d-2bc374937fdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:32.392384 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9703510-b817-49a7-bd8d-2bc374937fdc admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:32.404316 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1085/2182] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:29:32.420431 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e90527-b22a-40d9-a57d-f94ebd1f6b57 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:32.424748 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e90527-b22a-40d9-a57d-f94ebd1f6b57 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:32.429698 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86944675-9ec0-4c66-87f1-137c4537914a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:32.430594 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86944675-9ec0-4c66-87f1-137c4537914a admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:32.430884 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86944675-9ec0-4c66-87f1-137c4537914a admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:32.433645 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86944675-9ec0-4c66-87f1-137c4537914a admin admin] PATH_INFO: `/v3/projects/4f57c83cf08d4f4ca2f74edb56cffdae/users/bfa8077a1ee0408681e21ecd1defd3fc/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:32.447337 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86944675-9ec0-4c66-87f1-137c4537914a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f57c83cf08d4f4ca2f74edb56cffdae, user_id=bfa8077a1ee0408681e21ecd1defd3fc, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:32.450067 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86944675-9ec0-4c66-87f1-137c4537914a admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:32.636028 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1098/2183] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:29:32 2022] PUT /identity/v3/projects/4f57c83cf08d4f4ca2f74edb56cffdae/users/bfa8077a1ee0408681e21ecd1defd3fc/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:29:32.639969 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9703510-b817-49a7-bd8d-2bc374937fdc admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:32.651484 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9703510-b817-49a7-bd8d-2bc374937fdc admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:32.707820 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a097ada-9a39-42a0-9218-65c0ce83e011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:32.708501 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a097ada-9a39-42a0-9218-65c0ce83e011 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:32.708789 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a097ada-9a39-42a0-9218-65c0ce83e011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:32.709071 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a097ada-9a39-42a0-9218-65c0ce83e011 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:32.709805 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a097ada-9a39-42a0-9218-65c0ce83e011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:32.711412 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a097ada-9a39-42a0-9218-65c0ce83e011 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:32.721116 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1086/2184] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:29:32.725224 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86944675-9ec0-4c66-87f1-137c4537914a admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:32.736179 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86944675-9ec0-4c66-87f1-137c4537914a admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:32.741311 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68d7cf-02e8-4203-9d75-0fd2023e3a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:32.742234 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68d7cf-02e8-4203-9d75-0fd2023e3a96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:32.742515 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68d7cf-02e8-4203-9d75-0fd2023e3a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:32.742798 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68d7cf-02e8-4203-9d75-0fd2023e3a96 admin admin] PATH_INFO: `/v3/projects/4f57c83cf08d4f4ca2f74edb56cffdae/users/bfa8077a1ee0408681e21ecd1defd3fc/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:32.744820 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd68d7cf-02e8-4203-9d75-0fd2023e3a96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f57c83cf08d4f4ca2f74edb56cffdae, user_id=bfa8077a1ee0408681e21ecd1defd3fc, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:32.747475 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd68d7cf-02e8-4203-9d75-0fd2023e3a96 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:32.759695 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1099/2185] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:29:32 2022] PUT /identity/v3/projects/4f57c83cf08d4f4ca2f74edb56cffdae/users/bfa8077a1ee0408681e21ecd1defd3fc/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:29:32.769414 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd3c05-927b-4a98-b488-632826e6a5e0 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:32.769802 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd3c05-927b-4a98-b488-632826e6a5e0 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:32.770148 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd3c05-927b-4a98-b488-632826e6a5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:32.798313 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-13bd3c05-927b-4a98-b488-632826e6a5e0 None None] MFA Rules not processed for user `bfa8077a1ee0408681e21ecd1defd3fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:29:32.799762 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-13bd3c05-927b-4a98-b488-632826e6a5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:32.865602 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1087/2186] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:29:32 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:29:32.876311 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68d7cf-02e8-4203-9d75-0fd2023e3a96 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:32.878134 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-cd68d7cf-02e8-4203-9d75-0fd2023e3a96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:32.956285 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68d7cf-02e8-4203-9d75-0fd2023e3a96 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:32.959913 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe2176-40c4-4899-9fa0-3f624553ae41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:32.960563 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe2176-40c4-4899-9fa0-3f624553ae41 service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:32.960844 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe2176-40c4-4899-9fa0-3f624553ae41 service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:32.961118 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe2176-40c4-4899-9fa0-3f624553ae41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:32.970477 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbe2176-40c4-4899-9fa0-3f624553ae41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:32.971924 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbe2176-40c4-4899-9fa0-3f624553ae41 service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:32.981259 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1100/2187] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:29:32 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:29:34.280240 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd3c05-927b-4a98-b488-632826e6a5e0 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:34.360466 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd3c05-927b-4a98-b488-632826e6a5e0 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:34.365365 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b53bee-9622-48c0-95bc-9fc2c03bbd1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:34.368656 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b53bee-9622-48c0-95bc-9fc2c03bbd1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:34.369027 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b53bee-9622-48c0-95bc-9fc2c03bbd1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:34.369312 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b53bee-9622-48c0-95bc-9fc2c03bbd1f admin admin] PATH_INFO: `/v3/users/0e78c227560945cfb1cf6a8cc4edf3e6` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:34.370593 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b53bee-9622-48c0-95bc-9fc2c03bbd1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e78c227560945cfb1cf6a8cc4edf3e6)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:34.372700 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b53bee-9622-48c0-95bc-9fc2c03bbd1f admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:34.721272 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-62b53bee-9622-48c0-95bc-9fc2c03bbd1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e78c227560945cfb1cf6a8cc4edf3e6'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:34.721272 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-62b53bee-9622-48c0-95bc-9fc2c03bbd1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e78c227560945cfb1cf6a8cc4edf3e6'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:34.841422 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-62b53bee-9622-48c0-95bc-9fc2c03bbd1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e78c227560945cfb1cf6a8cc4edf3e6'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:34.842211 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-62b53bee-9622-48c0-95bc-9fc2c03bbd1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e78c227560945cfb1cf6a8cc4edf3e6'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:34.856314 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-62b53bee-9622-48c0-95bc-9fc2c03bbd1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e78c227560945cfb1cf6a8cc4edf3e6'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:34.877363 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1088/2188] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:29:34 2022] DELETE /identity/v3/users/0e78c227560945cfb1cf6a8cc4edf3e6 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:29:34.883782 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8f810-26ac-420b-a1ca-aa01ba660bd4 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:34.884492 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8f810-26ac-420b-a1ca-aa01ba660bd4 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:34.885132 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8f810-26ac-420b-a1ca-aa01ba660bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:34.916016 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-2ac8f810-26ac-420b-a1ca-aa01ba660bd4 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:29:34.917244 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-2ac8f810-26ac-420b-a1ca-aa01ba660bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:34.989108 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1101/2189] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:29:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:29:35.001939 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b53bee-9622-48c0-95bc-9fc2c03bbd1f admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:35.010378 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-62b53bee-9622-48c0-95bc-9fc2c03bbd1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:35.067649 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b53bee-9622-48c0-95bc-9fc2c03bbd1f admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:35.072606 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7cbe7-50b7-4de6-8eda-6aa089b625c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:35.073295 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7cbe7-50b7-4de6-8eda-6aa089b625c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:35.073590 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7cbe7-50b7-4de6-8eda-6aa089b625c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:35.073898 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7cbe7-50b7-4de6-8eda-6aa089b625c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:35.083984 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7cbe7-50b7-4de6-8eda-6aa089b625c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:35.085434 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7cbe7-50b7-4de6-8eda-6aa089b625c2 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:35.095302 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1089/2190] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:29:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:29:35.612319 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac8f810-26ac-420b-a1ca-aa01ba660bd4 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:35.612319 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-2ac8f810-26ac-420b-a1ca-aa01ba660bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:35.621997 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac8f810-26ac-420b-a1ca-aa01ba660bd4 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:35.627227 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76232f6-bfd0-4adc-bc44-b583d1b12c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:35.628427 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76232f6-bfd0-4adc-bc44-b583d1b12c04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:35.628895 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76232f6-bfd0-4adc-bc44-b583d1b12c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:35.629110 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76232f6-bfd0-4adc-bc44-b583d1b12c04 admin admin] PATH_INFO: `/v3/projects/80a9cbd1f11e4fb4af788df0809bb390` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:35.630983 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76232f6-bfd0-4adc-bc44-b583d1b12c04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80a9cbd1f11e4fb4af788df0809bb390)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:35.633220 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76232f6-bfd0-4adc-bc44-b583d1b12c04 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:35.751580 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d76232f6-bfd0-4adc-bc44-b583d1b12c04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80a9cbd1f11e4fb4af788df0809bb390', 'request_id': 'req-d76232f6-bfd0-4adc-bc44-b583d1b12c04'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:35.759017 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d76232f6-bfd0-4adc-bc44-b583d1b12c04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80a9cbd1f11e4fb4af788df0809bb390', 'request_id': 'req-d76232f6-bfd0-4adc-bc44-b583d1b12c04'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:35.847651 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d76232f6-bfd0-4adc-bc44-b583d1b12c04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80a9cbd1f11e4fb4af788df0809bb390', 'request_id': 'req-d76232f6-bfd0-4adc-bc44-b583d1b12c04'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:35.858533 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d76232f6-bfd0-4adc-bc44-b583d1b12c04 admin admin] The token cache is being invalidate because project 80a9cbd1f11e4fb4af788df0809bb390 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:29:35.858828 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d76232f6-bfd0-4adc-bc44-b583d1b12c04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:35.859578 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d76232f6-bfd0-4adc-bc44-b583d1b12c04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:35.861191 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1102/2191] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:29:35 2022] DELETE /identity/v3/projects/80a9cbd1f11e4fb4af788df0809bb390 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:29:35.865729 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7cbe7-50b7-4de6-8eda-6aa089b625c2 service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:35.876724 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7cbe7-50b7-4de6-8eda-6aa089b625c2 service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:35.944238 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52a044-09d7-40d6-ba24-4fab8e6750fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:35.945334 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52a044-09d7-40d6-ba24-4fab8e6750fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:35.945798 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52a044-09d7-40d6-ba24-4fab8e6750fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:35.946258 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52a044-09d7-40d6-ba24-4fab8e6750fe admin admin] PATH_INFO: `/v3/users/bfa8077a1ee0408681e21ecd1defd3fc` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:35.947468 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e52a044-09d7-40d6-ba24-4fab8e6750fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfa8077a1ee0408681e21ecd1defd3fc)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:35.950052 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e52a044-09d7-40d6-ba24-4fab8e6750fe admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:36.209504 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-4e52a044-09d7-40d6-ba24-4fab8e6750fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfa8077a1ee0408681e21ecd1defd3fc'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:36.210263 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-4e52a044-09d7-40d6-ba24-4fab8e6750fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfa8077a1ee0408681e21ecd1defd3fc'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:36.281353 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-4e52a044-09d7-40d6-ba24-4fab8e6750fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfa8077a1ee0408681e21ecd1defd3fc'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:36.281982 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-4e52a044-09d7-40d6-ba24-4fab8e6750fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfa8077a1ee0408681e21ecd1defd3fc'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:36.294049 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-4e52a044-09d7-40d6-ba24-4fab8e6750fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfa8077a1ee0408681e21ecd1defd3fc'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:36.305932 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1090/2192] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:29:35 2022] DELETE /identity/v3/users/bfa8077a1ee0408681e21ecd1defd3fc => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:29:36.780121 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76232f6-bfd0-4adc-bc44-b583d1b12c04 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:36.780121 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d76232f6-bfd0-4adc-bc44-b583d1b12c04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:36.790081 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76232f6-bfd0-4adc-bc44-b583d1b12c04 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:36.844943 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ececa3-92aa-4640-b4b5-ef133b12ba80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:36.845801 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ececa3-92aa-4640-b4b5-ef133b12ba80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:36.846082 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ececa3-92aa-4640-b4b5-ef133b12ba80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:36.846357 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ececa3-92aa-4640-b4b5-ef133b12ba80 admin admin] PATH_INFO: `/v3/projects/4f57c83cf08d4f4ca2f74edb56cffdae` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:36.847522 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ececa3-92aa-4640-b4b5-ef133b12ba80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f57c83cf08d4f4ca2f74edb56cffdae)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:36.849454 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ececa3-92aa-4640-b4b5-ef133b12ba80 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:36.972585 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-11ececa3-92aa-4640-b4b5-ef133b12ba80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f57c83cf08d4f4ca2f74edb56cffdae', 'request_id': 'req-11ececa3-92aa-4640-b4b5-ef133b12ba80'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:36.978922 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-11ececa3-92aa-4640-b4b5-ef133b12ba80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f57c83cf08d4f4ca2f74edb56cffdae', 'request_id': 'req-11ececa3-92aa-4640-b4b5-ef133b12ba80'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:37.104519 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-11ececa3-92aa-4640-b4b5-ef133b12ba80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f57c83cf08d4f4ca2f74edb56cffdae', 'request_id': 'req-11ececa3-92aa-4640-b4b5-ef133b12ba80'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:37.116396 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-11ececa3-92aa-4640-b4b5-ef133b12ba80 admin admin] The token cache is being invalidate because project 4f57c83cf08d4f4ca2f74edb56cffdae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:29:37.116689 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-11ececa3-92aa-4640-b4b5-ef133b12ba80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:37.117354 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-11ececa3-92aa-4640-b4b5-ef133b12ba80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:37.119121 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1103/2193] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:29:36 2022] DELETE /identity/v3/projects/4f57c83cf08d4f4ca2f74edb56cffdae => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:29:37.125240 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5629a5c4-acbb-4b0d-92e3-8fc567cc04fa None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:37.126833 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5629a5c4-acbb-4b0d-92e3-8fc567cc04fa None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:37.127326 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5629a5c4-acbb-4b0d-92e3-8fc567cc04fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:37.146470 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-5629a5c4-acbb-4b0d-92e3-8fc567cc04fa None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:29:37.147685 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-5629a5c4-acbb-4b0d-92e3-8fc567cc04fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:37.206458 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1091/2194] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:29:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:29:37.214734 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2974c-6244-4d67-b947-25404d1e988e None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:37.214734 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2974c-6244-4d67-b947-25404d1e988e None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:37.214734 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2974c-6244-4d67-b947-25404d1e988e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:37.245642 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-1ec2974c-6244-4d67-b947-25404d1e988e None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:29:37.246877 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-1ec2974c-6244-4d67-b947-25404d1e988e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:37.256329 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1104/2195] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:29:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:29:37.267603 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5629a5c4-acbb-4b0d-92e3-8fc567cc04fa None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:37.277797 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5629a5c4-acbb-4b0d-92e3-8fc567cc04fa None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:37.286852 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2508a-55b7-4afc-af73-4c7654fb73df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:37.287532 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2508a-55b7-4afc-af73-4c7654fb73df admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:37.289461 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2508a-55b7-4afc-af73-4c7654fb73df admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:37.289754 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2508a-55b7-4afc-af73-4c7654fb73df admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:37.290511 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de2508a-55b7-4afc-af73-4c7654fb73df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:29:37.290835 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de2508a-55b7-4afc-af73-4c7654fb73df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:37.292455 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de2508a-55b7-4afc-af73-4c7654fb73df admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:37.311350 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1092/2196] 10.222.0.24 () {58 vars in 1152 bytes} [Thu Apr 7 06:29:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:29:37.317628 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec2974c-6244-4d67-b947-25404d1e988e None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:37.326847 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec2974c-6244-4d67-b947-25404d1e988e None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:37.331689 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9fea98-2298-44d1-9ae4-4c472782d721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:37.332375 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9fea98-2298-44d1-9ae4-4c472782d721 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:37.332659 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9fea98-2298-44d1-9ae4-4c472782d721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:37.332961 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9fea98-2298-44d1-9ae4-4c472782d721 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:37.333660 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9fea98-2298-44d1-9ae4-4c472782d721 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:37.335656 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9fea98-2298-44d1-9ae4-4c472782d721 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:37.666005 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1105/2197] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:29:37 2022] POST /identity/v3/projects => generated 385 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:29:37.670145 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2508a-55b7-4afc-af73-4c7654fb73df admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:37.680602 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2508a-55b7-4afc-af73-4c7654fb73df admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:37.777683 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa8dff-f4c8-44d3-abf4-2fcd6af6021a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:37.778371 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa8dff-f4c8-44d3-abf4-2fcd6af6021a admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:37.778659 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa8dff-f4c8-44d3-abf4-2fcd6af6021a admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:37.778936 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa8dff-f4c8-44d3-abf4-2fcd6af6021a admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:37.779646 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aa8dff-f4c8-44d3-abf4-2fcd6af6021a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:37.782115 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aa8dff-f4c8-44d3-abf4-2fcd6af6021a admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:37.905051 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1093/2198] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:29:37 2022] POST /identity/v3/users => generated 293 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:29:37.909672 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9fea98-2298-44d1-9ae4-4c472782d721 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:37.919976 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9fea98-2298-44d1-9ae4-4c472782d721 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:37.924606 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f570dde-ec0b-4c62-a8bc-c5e1beaa9865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:37.925259 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f570dde-ec0b-4c62-a8bc-c5e1beaa9865 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:37.925548 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f570dde-ec0b-4c62-a8bc-c5e1beaa9865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:37.925848 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f570dde-ec0b-4c62-a8bc-c5e1beaa9865 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:37.926667 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f570dde-ec0b-4c62-a8bc-c5e1beaa9865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:37.928332 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f570dde-ec0b-4c62-a8bc-c5e1beaa9865 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:37.939107 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1106/2199] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:29:37.942823 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa8dff-f4c8-44d3-abf4-2fcd6af6021a admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:37.953362 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa8dff-f4c8-44d3-abf4-2fcd6af6021a admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:37.957969 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3b3b73-9a55-48e5-862d-f8389425c03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:37.958615 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b3b73-9a55-48e5-862d-f8389425c03c admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:37.958895 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b3b73-9a55-48e5-862d-f8389425c03c admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:37.959169 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b3b73-9a55-48e5-862d-f8389425c03c admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:37.959983 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3b3b73-9a55-48e5-862d-f8389425c03c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:37.961639 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3b3b73-9a55-48e5-862d-f8389425c03c admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:37.971977 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1094/2200] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:29:37.975703 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f570dde-ec0b-4c62-a8bc-c5e1beaa9865 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:37.985592 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f570dde-ec0b-4c62-a8bc-c5e1beaa9865 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:37.990444 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48032f2-170e-40dd-b329-f87571fc6cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:37.994886 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48032f2-170e-40dd-b329-f87571fc6cfa admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:37.994886 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48032f2-170e-40dd-b329-f87571fc6cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:37.994886 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48032f2-170e-40dd-b329-f87571fc6cfa admin admin] PATH_INFO: `/v3/projects/c75b87ecc76f4b539a1f43f4713481e3/users/8ab38093d25d4e2db6bcc0d75972a6bb/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:38.009000 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48032f2-170e-40dd-b329-f87571fc6cfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=c75b87ecc76f4b539a1f43f4713481e3, user_id=8ab38093d25d4e2db6bcc0d75972a6bb, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:38.011997 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48032f2-170e-40dd-b329-f87571fc6cfa admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:38.110595 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1107/2201] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:29:37 2022] PUT /identity/v3/projects/c75b87ecc76f4b539a1f43f4713481e3/users/8ab38093d25d4e2db6bcc0d75972a6bb/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:29:38.121314 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9516930-9859-473c-b66c-942f429e9f5d None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:38.121633 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9516930-9859-473c-b66c-942f429e9f5d None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:38.121919 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9516930-9859-473c-b66c-942f429e9f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:38.148037 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-a9516930-9859-473c-b66c-942f429e9f5d None None] MFA Rules not processed for user `8ab38093d25d4e2db6bcc0d75972a6bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:29:38.149240 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a9516930-9859-473c-b66c-942f429e9f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:38.211242 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1095/2202] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:29:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:29:38.215789 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48032f2-170e-40dd-b329-f87571fc6cfa admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:38.279775 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48032f2-170e-40dd-b329-f87571fc6cfa admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:38.284508 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec1bcfc-8cfd-4b72-804d-42c9b4ef476f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:38.285163 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec1bcfc-8cfd-4b72-804d-42c9b4ef476f admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:38.285474 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec1bcfc-8cfd-4b72-804d-42c9b4ef476f admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:38.285771 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec1bcfc-8cfd-4b72-804d-42c9b4ef476f admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:38.286456 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec1bcfc-8cfd-4b72-804d-42c9b4ef476f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:38.288420 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec1bcfc-8cfd-4b72-804d-42c9b4ef476f admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:38.380992 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1108/2203] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:29:38 2022] POST /identity/v3/projects => generated 383 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:29:38.382764 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9516930-9859-473c-b66c-942f429e9f5d None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:38.394064 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9516930-9859-473c-b66c-942f429e9f5d None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:38.455570 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d1c916-7a72-454c-b5c7-1836868a7ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:38.457563 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d1c916-7a72-454c-b5c7-1836868a7ce2 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:38.457563 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d1c916-7a72-454c-b5c7-1836868a7ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:38.457563 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d1c916-7a72-454c-b5c7-1836868a7ce2 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:38.457563 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d1c916-7a72-454c-b5c7-1836868a7ce2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:38.459604 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d1c916-7a72-454c-b5c7-1836868a7ce2 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:38.551414 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1096/2204] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:29:38 2022] POST /identity/v3/users => generated 298 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:29:38.555297 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec1bcfc-8cfd-4b72-804d-42c9b4ef476f admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:38.566695 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec1bcfc-8cfd-4b72-804d-42c9b4ef476f admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:38.579922 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00278852-6508-4a56-b59b-43e539dc8a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:38.580621 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00278852-6508-4a56-b59b-43e539dc8a15 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:38.580905 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00278852-6508-4a56-b59b-43e539dc8a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:38.581178 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00278852-6508-4a56-b59b-43e539dc8a15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:38.581914 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00278852-6508-4a56-b59b-43e539dc8a15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:38.583627 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00278852-6508-4a56-b59b-43e539dc8a15 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:38.595429 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1109/2205] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:29:38 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 07 06:29:38.599383 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d1c916-7a72-454c-b5c7-1836868a7ce2 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:38.609306 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d1c916-7a72-454c-b5c7-1836868a7ce2 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:38.614233 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a181b323-e021-4bc3-9deb-288ec5cc0f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:38.615101 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181b323-e021-4bc3-9deb-288ec5cc0f7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:38.615386 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181b323-e021-4bc3-9deb-288ec5cc0f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:38.615662 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181b323-e021-4bc3-9deb-288ec5cc0f7a admin admin] PATH_INFO: `/v3/projects/c239e8c2b349421a9c01b296a77ba7a2/users/d6b3ac0c91bf44b8bda72322f6d1b22d/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:38.630353 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a181b323-e021-4bc3-9deb-288ec5cc0f7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c239e8c2b349421a9c01b296a77ba7a2, user_id=d6b3ac0c91bf44b8bda72322f6d1b22d, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:38.633051 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a181b323-e021-4bc3-9deb-288ec5cc0f7a admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:38.705617 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1097/2206] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:29:38 2022] PUT /identity/v3/projects/c239e8c2b349421a9c01b296a77ba7a2/users/d6b3ac0c91bf44b8bda72322f6d1b22d/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:29:38.709690 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00278852-6508-4a56-b59b-43e539dc8a15 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:38.720297 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00278852-6508-4a56-b59b-43e539dc8a15 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:38.778821 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083779d0-168c-4c0b-a1a5-50e193bd7d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:38.779498 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083779d0-168c-4c0b-a1a5-50e193bd7d4d admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:38.779805 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083779d0-168c-4c0b-a1a5-50e193bd7d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:38.780086 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083779d0-168c-4c0b-a1a5-50e193bd7d4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:38.781399 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083779d0-168c-4c0b-a1a5-50e193bd7d4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:38.782981 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083779d0-168c-4c0b-a1a5-50e193bd7d4d admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:38.796002 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1110/2207] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:29:38 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:29:38.797146 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a181b323-e021-4bc3-9deb-288ec5cc0f7a admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:38.807227 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a181b323-e021-4bc3-9deb-288ec5cc0f7a admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:38.811918 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95766e5d-7cbf-4296-97d5-deeb2f8e6674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:38.812849 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95766e5d-7cbf-4296-97d5-deeb2f8e6674 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:38.813159 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95766e5d-7cbf-4296-97d5-deeb2f8e6674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:38.813443 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95766e5d-7cbf-4296-97d5-deeb2f8e6674 admin admin] PATH_INFO: `/v3/projects/c239e8c2b349421a9c01b296a77ba7a2/users/d6b3ac0c91bf44b8bda72322f6d1b22d/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:38.815429 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95766e5d-7cbf-4296-97d5-deeb2f8e6674 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c239e8c2b349421a9c01b296a77ba7a2, user_id=d6b3ac0c91bf44b8bda72322f6d1b22d, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:38.818108 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95766e5d-7cbf-4296-97d5-deeb2f8e6674 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:38.828866 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1098/2208] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:29:38 2022] PUT /identity/v3/projects/c239e8c2b349421a9c01b296a77ba7a2/users/d6b3ac0c91bf44b8bda72322f6d1b22d/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:29:38.839789 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0aa08-baa8-4995-a168-40eb37258a99 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:38.840121 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0aa08-baa8-4995-a168-40eb37258a99 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:38.840456 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0aa08-baa8-4995-a168-40eb37258a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:38.868627 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-49d0aa08-baa8-4995-a168-40eb37258a99 None None] MFA Rules not processed for user `d6b3ac0c91bf44b8bda72322f6d1b22d`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:29:38.869835 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-49d0aa08-baa8-4995-a168-40eb37258a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:38.934607 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1111/2209] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:29:38 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:29:38.945227 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95766e5d-7cbf-4296-97d5-deeb2f8e6674 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:38.946956 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-95766e5d-7cbf-4296-97d5-deeb2f8e6674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:39.009911 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95766e5d-7cbf-4296-97d5-deeb2f8e6674 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:39.013567 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8402d3-029a-4123-9c70-8540f511b1e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:39.014210 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8402d3-029a-4123-9c70-8540f511b1e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:39.014497 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8402d3-029a-4123-9c70-8540f511b1e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:39.014780 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8402d3-029a-4123-9c70-8540f511b1e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:39.072536 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8402d3-029a-4123-9c70-8540f511b1e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:39.074037 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8402d3-029a-4123-9c70-8540f511b1e1 service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:39.083618 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1099/2210] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:29:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:29:40.032409 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d0aa08-baa8-4995-a168-40eb37258a99 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:40.033959 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-49d0aa08-baa8-4995-a168-40eb37258a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:40.100464 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d0aa08-baa8-4995-a168-40eb37258a99 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:40.105318 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad578e-1d32-455d-805e-314c97730147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:40.106218 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad578e-1d32-455d-805e-314c97730147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:40.106501 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad578e-1d32-455d-805e-314c97730147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:40.106775 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad578e-1d32-455d-805e-314c97730147 admin admin] PATH_INFO: `/v3/users/9260af21404840168be51023c5171fdd` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:40.108021 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ad578e-1d32-455d-805e-314c97730147 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9260af21404840168be51023c5171fdd)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:40.109989 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ad578e-1d32-455d-805e-314c97730147 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:40.283810 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-c6ad578e-1d32-455d-805e-314c97730147 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9260af21404840168be51023c5171fdd'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:40.295321 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-c6ad578e-1d32-455d-805e-314c97730147 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9260af21404840168be51023c5171fdd'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:40.355316 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-c6ad578e-1d32-455d-805e-314c97730147 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9260af21404840168be51023c5171fdd'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:40.356001 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-c6ad578e-1d32-455d-805e-314c97730147 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9260af21404840168be51023c5171fdd'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:40.356647 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-c6ad578e-1d32-455d-805e-314c97730147 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9260af21404840168be51023c5171fdd'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:40.369803 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1112/2211] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:29:40 2022] DELETE /identity/v3/users/9260af21404840168be51023c5171fdd => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:29:40.381417 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e6290-b3d3-4fbb-b303-a1c82d9a6cb8 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:40.381886 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e6290-b3d3-4fbb-b303-a1c82d9a6cb8 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:40.381980 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e6290-b3d3-4fbb-b303-a1c82d9a6cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:40.399019 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-212e6290-b3d3-4fbb-b303-a1c82d9a6cb8 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:29:40.400282 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-212e6290-b3d3-4fbb-b303-a1c82d9a6cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:40.455874 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1100/2212] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:29:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:29:40.472992 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad578e-1d32-455d-805e-314c97730147 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:40.474376 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c6ad578e-1d32-455d-805e-314c97730147 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:40.532717 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad578e-1d32-455d-805e-314c97730147 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:40.536608 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ac039-778f-44ce-8b71-0d90152d4b7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:40.537279 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ac039-778f-44ce-8b71-0d90152d4b7b service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:40.537640 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ac039-778f-44ce-8b71-0d90152d4b7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:40.537924 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ac039-778f-44ce-8b71-0d90152d4b7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:40.546851 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ac039-778f-44ce-8b71-0d90152d4b7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:40.548305 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ac039-778f-44ce-8b71-0d90152d4b7b service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:40.557700 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1113/2213] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:29:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:29:41.037693 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212e6290-b3d3-4fbb-b303-a1c82d9a6cb8 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:41.047030 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-212e6290-b3d3-4fbb-b303-a1c82d9a6cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:41.054412 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212e6290-b3d3-4fbb-b303-a1c82d9a6cb8 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:41.060148 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4050b3-62db-450b-af6c-5e7f8574d243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:41.061138 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4050b3-62db-450b-af6c-5e7f8574d243 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:41.061458 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4050b3-62db-450b-af6c-5e7f8574d243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:41.061853 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4050b3-62db-450b-af6c-5e7f8574d243 admin admin] PATH_INFO: `/v3/projects/cdda24c5092f4244a724c551324165fe` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:41.063784 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4050b3-62db-450b-af6c-5e7f8574d243 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdda24c5092f4244a724c551324165fe)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:41.066161 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4050b3-62db-450b-af6c-5e7f8574d243 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:41.177413 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-6e4050b3-62db-450b-af6c-5e7f8574d243 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdda24c5092f4244a724c551324165fe', 'request_id': 'req-6e4050b3-62db-450b-af6c-5e7f8574d243'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:41.188330 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-6e4050b3-62db-450b-af6c-5e7f8574d243 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdda24c5092f4244a724c551324165fe', 'request_id': 'req-6e4050b3-62db-450b-af6c-5e7f8574d243'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:41.258821 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-6e4050b3-62db-450b-af6c-5e7f8574d243 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdda24c5092f4244a724c551324165fe', 'request_id': 'req-6e4050b3-62db-450b-af6c-5e7f8574d243'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:41.271964 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-6e4050b3-62db-450b-af6c-5e7f8574d243 admin admin] The token cache is being invalidate because project cdda24c5092f4244a724c551324165fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:29:41.272253 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-6e4050b3-62db-450b-af6c-5e7f8574d243 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:41.272894 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-6e4050b3-62db-450b-af6c-5e7f8574d243 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:41.274542 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1101/2214] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:29:41 2022] DELETE /identity/v3/projects/cdda24c5092f4244a724c551324165fe => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:29:44.557917 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ac039-778f-44ce-8b71-0d90152d4b7b service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:44.560123 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-527ac039-778f-44ce-8b71-0d90152d4b7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:44.627407 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ac039-778f-44ce-8b71-0d90152d4b7b service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:44.677174 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb4324-d92e-4419-bbd1-b1c9e8a99030 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:44.678087 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb4324-d92e-4419-bbd1-b1c9e8a99030 service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:44.678256 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb4324-d92e-4419-bbd1-b1c9e8a99030 service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:44.678532 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb4324-d92e-4419-bbd1-b1c9e8a99030 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:44.680343 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b6bb4324-d92e-4419-bbd1-b1c9e8a99030 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:44.749212 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb4324-d92e-4419-bbd1-b1c9e8a99030 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:44.750613 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb4324-d92e-4419-bbd1-b1c9e8a99030 service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:44.760756 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1114/2215] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:29:44 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:29:47.311219 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6b353-b757-4df8-8e28-ab186dafbae5 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:47.311702 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6b353-b757-4df8-8e28-ab186dafbae5 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:47.311822 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6b353-b757-4df8-8e28-ab186dafbae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:47.329627 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-10c6b353-b757-4df8-8e28-ab186dafbae5 None None] MFA Rules not processed for user `c9ac85053def476489ee1843bbd02316`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:29:47.330813 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-10c6b353-b757-4df8-8e28-ab186dafbae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:47.384268 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1102/2216] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:29:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:29:50.844286 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb4324-d92e-4419-bbd1-b1c9e8a99030 service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:50.845730 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b6bb4324-d92e-4419-bbd1-b1c9e8a99030 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:50.915316 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb4324-d92e-4419-bbd1-b1c9e8a99030 service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:50.920107 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de586f-20f5-4541-8a69-c53392cf183c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:50.921022 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de586f-20f5-4541-8a69-c53392cf183c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:50.921307 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de586f-20f5-4541-8a69-c53392cf183c admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:50.926441 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de586f-20f5-4541-8a69-c53392cf183c admin admin] PATH_INFO: `/v3/users/8ab38093d25d4e2db6bcc0d75972a6bb` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:50.926441 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de586f-20f5-4541-8a69-c53392cf183c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ab38093d25d4e2db6bcc0d75972a6bb)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:50.926441 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de586f-20f5-4541-8a69-c53392cf183c admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:51.195261 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-e4de586f-20f5-4541-8a69-c53392cf183c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ab38093d25d4e2db6bcc0d75972a6bb'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:51.210072 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-e4de586f-20f5-4541-8a69-c53392cf183c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ab38093d25d4e2db6bcc0d75972a6bb'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:51.292846 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-e4de586f-20f5-4541-8a69-c53392cf183c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ab38093d25d4e2db6bcc0d75972a6bb'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:51.293500 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-e4de586f-20f5-4541-8a69-c53392cf183c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ab38093d25d4e2db6bcc0d75972a6bb'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:51.294190 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-e4de586f-20f5-4541-8a69-c53392cf183c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ab38093d25d4e2db6bcc0d75972a6bb'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:51.308077 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1115/2217] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:29:50 2022] DELETE /identity/v3/users/8ab38093d25d4e2db6bcc0d75972a6bb => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:29:51.313222 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc4c04-63f2-4ef5-ad0e-16fc2c421abf None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:51.313725 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc4c04-63f2-4ef5-ad0e-16fc2c421abf None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:51.313820 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc4c04-63f2-4ef5-ad0e-16fc2c421abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:51.333112 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-9dcc4c04-63f2-4ef5-ad0e-16fc2c421abf None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:29:51.335844 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-9dcc4c04-63f2-4ef5-ad0e-16fc2c421abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:51.402041 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1103/2218] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:29:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:29:51.411835 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de586f-20f5-4541-8a69-c53392cf183c admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:51.413270 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e4de586f-20f5-4541-8a69-c53392cf183c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:51.479308 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de586f-20f5-4541-8a69-c53392cf183c admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:51.484645 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2436bb5b-4bce-4adb-a347-ac18f660fcbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:51.485554 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2436bb5b-4bce-4adb-a347-ac18f660fcbf service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:51.485885 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2436bb5b-4bce-4adb-a347-ac18f660fcbf service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:51.486162 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2436bb5b-4bce-4adb-a347-ac18f660fcbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:51.496317 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2436bb5b-4bce-4adb-a347-ac18f660fcbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:51.497935 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2436bb5b-4bce-4adb-a347-ac18f660fcbf service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:51.508050 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1116/2219] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:29:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:29:52.003800 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcc4c04-63f2-4ef5-ad0e-16fc2c421abf None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:52.006591 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-9dcc4c04-63f2-4ef5-ad0e-16fc2c421abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:52.021154 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcc4c04-63f2-4ef5-ad0e-16fc2c421abf None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:52.026887 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe051508-0117-4d88-a12f-e7da047c8354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:52.027962 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe051508-0117-4d88-a12f-e7da047c8354 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:52.028463 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe051508-0117-4d88-a12f-e7da047c8354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:52.028945 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe051508-0117-4d88-a12f-e7da047c8354 admin admin] PATH_INFO: `/v3/projects/c75b87ecc76f4b539a1f43f4713481e3` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:52.030837 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe051508-0117-4d88-a12f-e7da047c8354 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c75b87ecc76f4b539a1f43f4713481e3)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:52.039824 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe051508-0117-4d88-a12f-e7da047c8354 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:52.157900 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-fe051508-0117-4d88-a12f-e7da047c8354 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c75b87ecc76f4b539a1f43f4713481e3', 'request_id': 'req-fe051508-0117-4d88-a12f-e7da047c8354'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:52.163933 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-fe051508-0117-4d88-a12f-e7da047c8354 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c75b87ecc76f4b539a1f43f4713481e3', 'request_id': 'req-fe051508-0117-4d88-a12f-e7da047c8354'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:52.252780 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-fe051508-0117-4d88-a12f-e7da047c8354 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c75b87ecc76f4b539a1f43f4713481e3', 'request_id': 'req-fe051508-0117-4d88-a12f-e7da047c8354'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:52.264333 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-fe051508-0117-4d88-a12f-e7da047c8354 admin admin] The token cache is being invalidate because project c75b87ecc76f4b539a1f43f4713481e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:29:52.265102 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-fe051508-0117-4d88-a12f-e7da047c8354 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:52.265726 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-fe051508-0117-4d88-a12f-e7da047c8354 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:52.267244 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1104/2220] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:29:52 2022] DELETE /identity/v3/projects/c75b87ecc76f4b539a1f43f4713481e3 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:29:52.271179 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2436bb5b-4bce-4adb-a347-ac18f660fcbf service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:52.281568 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2436bb5b-4bce-4adb-a347-ac18f660fcbf service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:52.337587 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8735f1-dd79-4f0f-b3d9-52da7a08dbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:52.338468 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8735f1-dd79-4f0f-b3d9-52da7a08dbcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:52.338761 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8735f1-dd79-4f0f-b3d9-52da7a08dbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:52.339041 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8735f1-dd79-4f0f-b3d9-52da7a08dbcd admin admin] PATH_INFO: `/v3/users/d6b3ac0c91bf44b8bda72322f6d1b22d` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:52.340268 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8735f1-dd79-4f0f-b3d9-52da7a08dbcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6b3ac0c91bf44b8bda72322f6d1b22d)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:52.342252 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8735f1-dd79-4f0f-b3d9-52da7a08dbcd admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:52.593989 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-ef8735f1-dd79-4f0f-b3d9-52da7a08dbcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6b3ac0c91bf44b8bda72322f6d1b22d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:52.609198 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-ef8735f1-dd79-4f0f-b3d9-52da7a08dbcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6b3ac0c91bf44b8bda72322f6d1b22d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:52.739418 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-ef8735f1-dd79-4f0f-b3d9-52da7a08dbcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6b3ac0c91bf44b8bda72322f6d1b22d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:52.741144 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-ef8735f1-dd79-4f0f-b3d9-52da7a08dbcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6b3ac0c91bf44b8bda72322f6d1b22d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:52.747869 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-ef8735f1-dd79-4f0f-b3d9-52da7a08dbcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6b3ac0c91bf44b8bda72322f6d1b22d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:52.791343 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1117/2221] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:29:52 2022] DELETE /identity/v3/users/d6b3ac0c91bf44b8bda72322f6d1b22d => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:29:53.431852 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891f496-20c1-4597-b9ed-6777ae2eea8f None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:53.432376 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891f496-20c1-4597-b9ed-6777ae2eea8f None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:53.432457 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891f496-20c1-4597-b9ed-6777ae2eea8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:53.496303 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-b891f496-20c1-4597-b9ed-6777ae2eea8f None None] MFA Rules not processed for user `f4435fb14c3844728531af63993f78c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:29:53.497697 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b891f496-20c1-4597-b9ed-6777ae2eea8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:53.581389 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1105/2222] 10.222.0.24 () {58 vars in 1009 bytes} [Thu Apr 7 06:29:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:29:53.600551 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8735f1-dd79-4f0f-b3d9-52da7a08dbcd admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:53.603142 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-ef8735f1-dd79-4f0f-b3d9-52da7a08dbcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:53.647575 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b891f496-20c1-4597-b9ed-6777ae2eea8f None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:53.652570 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b891f496-20c1-4597-b9ed-6777ae2eea8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:53.706968 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8735f1-dd79-4f0f-b3d9-52da7a08dbcd admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:53.712314 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3713257f-9053-4040-be1b-a139cffae765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:53.713403 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713257f-9053-4040-be1b-a139cffae765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:53.713868 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713257f-9053-4040-be1b-a139cffae765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:53.714323 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713257f-9053-4040-be1b-a139cffae765 admin admin] PATH_INFO: `/v3/projects/c239e8c2b349421a9c01b296a77ba7a2` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:53.716346 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3713257f-9053-4040-be1b-a139cffae765 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c239e8c2b349421a9c01b296a77ba7a2)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:53.718790 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3713257f-9053-4040-be1b-a139cffae765 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:53.771203 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b891f496-20c1-4597-b9ed-6777ae2eea8f None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:53.776569 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd2832a-5267-43bf-acb9-672e677f3efd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4abbb8c5324b7babd69e3b4473b3e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:53.777256 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd2832a-5267-43bf-acb9-672e677f3efd service swift] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:53.777543 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd2832a-5267-43bf-acb9-672e677f3efd service swift] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:53.777820 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd2832a-5267-43bf-acb9-672e677f3efd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:53.786873 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd2832a-5267-43bf-acb9-672e677f3efd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:53.790658 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd2832a-5267-43bf-acb9-672e677f3efd service swift] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:53.797335 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1106/2223] 10.222.0.24 () {60 vars in 1384 bytes} [Thu Apr 7 06:29:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 07 06:29:53.860785 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3713257f-9053-4040-be1b-a139cffae765 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c239e8c2b349421a9c01b296a77ba7a2', 'request_id': 'req-3713257f-9053-4040-be1b-a139cffae765'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:53.869892 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3713257f-9053-4040-be1b-a139cffae765 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c239e8c2b349421a9c01b296a77ba7a2', 'request_id': 'req-3713257f-9053-4040-be1b-a139cffae765'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:53.938912 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3713257f-9053-4040-be1b-a139cffae765 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c239e8c2b349421a9c01b296a77ba7a2', 'request_id': 'req-3713257f-9053-4040-be1b-a139cffae765'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:53.958621 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3713257f-9053-4040-be1b-a139cffae765 admin admin] The token cache is being invalidate because project c239e8c2b349421a9c01b296a77ba7a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:29:53.959208 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3713257f-9053-4040-be1b-a139cffae765 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:53.960416 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3713257f-9053-4040-be1b-a139cffae765 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:29:53.968221 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1118/2224] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:29:53 2022] DELETE /identity/v3/projects/c239e8c2b349421a9c01b296a77ba7a2 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:29:53.968653 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c681cf-f827-4b25-b8b5-518f0d31f3d5 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:53.968949 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c681cf-f827-4b25-b8b5-518f0d31f3d5 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:53.969251 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c681cf-f827-4b25-b8b5-518f0d31f3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:54.005707 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-66c681cf-f827-4b25-b8b5-518f0d31f3d5 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:29:54.007646 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-66c681cf-f827-4b25-b8b5-518f0d31f3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:54.086757 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1107/2225] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:29:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:29:54.095314 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf61c3-8a6d-40fc-88ca-a3c7d802ba81 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:54.095605 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf61c3-8a6d-40fc-88ca-a3c7d802ba81 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:54.095924 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf61c3-8a6d-40fc-88ca-a3c7d802ba81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:54.116991 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-eeaf61c3-8a6d-40fc-88ca-a3c7d802ba81 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:29:54.118227 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-eeaf61c3-8a6d-40fc-88ca-a3c7d802ba81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:54.130329 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1119/2226] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:29:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:29:54.133774 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c681cf-f827-4b25-b8b5-518f0d31f3d5 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:54.143824 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c681cf-f827-4b25-b8b5-518f0d31f3d5 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:54.149080 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597aabbe-f42b-420f-898e-d846419831a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:54.149740 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597aabbe-f42b-420f-898e-d846419831a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:54.150028 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597aabbe-f42b-420f-898e-d846419831a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:54.150305 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597aabbe-f42b-420f-898e-d846419831a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:54.157738 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597aabbe-f42b-420f-898e-d846419831a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:29:54.157738 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597aabbe-f42b-420f-898e-d846419831a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:54.157738 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597aabbe-f42b-420f-898e-d846419831a7 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:54.166410 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1108/2227] 10.222.0.24 () {58 vars in 1152 bytes} [Thu Apr 7 06:29:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:29:54.170848 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf61c3-8a6d-40fc-88ca-a3c7d802ba81 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:54.180541 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf61c3-8a6d-40fc-88ca-a3c7d802ba81 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:54.185432 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa42a203-1e51-43b2-8329-d2eb5a33cfe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:54.186108 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42a203-1e51-43b2-8329-d2eb5a33cfe6 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:54.186412 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42a203-1e51-43b2-8329-d2eb5a33cfe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:54.186683 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42a203-1e51-43b2-8329-d2eb5a33cfe6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:54.187390 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa42a203-1e51-43b2-8329-d2eb5a33cfe6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:54.189514 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa42a203-1e51-43b2-8329-d2eb5a33cfe6 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:54.327806 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1120/2228] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:29:54 2022] POST /identity/v3/projects => generated 375 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:29:54.329691 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597aabbe-f42b-420f-898e-d846419831a7 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:54.339933 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597aabbe-f42b-420f-898e-d846419831a7 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:54.447373 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26fce8c-9d4a-43f0-938b-10d58ec399b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:54.449035 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26fce8c-9d4a-43f0-938b-10d58ec399b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:54.449527 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26fce8c-9d4a-43f0-938b-10d58ec399b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:54.450033 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26fce8c-9d4a-43f0-938b-10d58ec399b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:54.450931 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26fce8c-9d4a-43f0-938b-10d58ec399b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:54.455072 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26fce8c-9d4a-43f0-938b-10d58ec399b1 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:54.619722 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1109/2229] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:29:54 2022] POST /identity/v3/users => generated 288 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:29:54.625520 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa42a203-1e51-43b2-8329-d2eb5a33cfe6 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:54.643112 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa42a203-1e51-43b2-8329-d2eb5a33cfe6 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:54.648408 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb6c3f4-81ad-40c9-a45b-5aa6e87ce04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:54.649311 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6c3f4-81ad-40c9-a45b-5aa6e87ce04d admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:54.649713 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6c3f4-81ad-40c9-a45b-5aa6e87ce04d admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:54.650281 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6c3f4-81ad-40c9-a45b-5aa6e87ce04d admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:54.651179 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb6c3f4-81ad-40c9-a45b-5aa6e87ce04d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:54.654483 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb6c3f4-81ad-40c9-a45b-5aa6e87ce04d admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:54.674886 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1121/2230] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 07 06:29:54.678021 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26fce8c-9d4a-43f0-938b-10d58ec399b1 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:54.704405 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26fce8c-9d4a-43f0-938b-10d58ec399b1 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:54.711530 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c459e67-86f2-4b69-8f47-7e5e6d5bfbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:54.712250 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c459e67-86f2-4b69-8f47-7e5e6d5bfbb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:54.712537 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c459e67-86f2-4b69-8f47-7e5e6d5bfbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:54.712816 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c459e67-86f2-4b69-8f47-7e5e6d5bfbb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:54.713640 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c459e67-86f2-4b69-8f47-7e5e6d5bfbb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:54.715275 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c459e67-86f2-4b69-8f47-7e5e6d5bfbb3 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:54.740902 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1110/2231] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:29:54.746224 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb6c3f4-81ad-40c9-a45b-5aa6e87ce04d admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:54.779509 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb6c3f4-81ad-40c9-a45b-5aa6e87ce04d admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:54.799479 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e65b00-fb9b-44ee-97d9-36f1e5694b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:54.800658 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e65b00-fb9b-44ee-97d9-36f1e5694b14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:54.800944 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e65b00-fb9b-44ee-97d9-36f1e5694b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:54.801222 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e65b00-fb9b-44ee-97d9-36f1e5694b14 admin admin] PATH_INFO: `/v3/projects/7d89cb197d5c47aea205c4f94569a017/users/33e6f0a8c71341e19125ba6ad902c2bf/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:54.829862 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e65b00-fb9b-44ee-97d9-36f1e5694b14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d89cb197d5c47aea205c4f94569a017, user_id=33e6f0a8c71341e19125ba6ad902c2bf, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:54.832702 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e65b00-fb9b-44ee-97d9-36f1e5694b14 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:54.916686 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1122/2232] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:29:54 2022] PUT /identity/v3/projects/7d89cb197d5c47aea205c4f94569a017/users/33e6f0a8c71341e19125ba6ad902c2bf/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:29:54.928448 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713394b-7251-49b2-9334-65912a527cb6 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:54.928824 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713394b-7251-49b2-9334-65912a527cb6 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:54.929001 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713394b-7251-49b2-9334-65912a527cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:54.961549 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-7713394b-7251-49b2-9334-65912a527cb6 None None] MFA Rules not processed for user `33e6f0a8c71341e19125ba6ad902c2bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:29:54.962777 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-7713394b-7251-49b2-9334-65912a527cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:55.049742 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e65b00-fb9b-44ee-97d9-36f1e5694b14 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:55.050720 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1111/2233] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:29:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:29:55.120915 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e65b00-fb9b-44ee-97d9-36f1e5694b14 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:55.127372 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d11e87-2bfe-4e5c-929a-77ea837ea8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:55.128073 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d11e87-2bfe-4e5c-929a-77ea837ea8d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:55.128337 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d11e87-2bfe-4e5c-929a-77ea837ea8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:55.128582 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d11e87-2bfe-4e5c-929a-77ea837ea8d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:55.129279 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d11e87-2bfe-4e5c-929a-77ea837ea8d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:55.131221 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d11e87-2bfe-4e5c-929a-77ea837ea8d0 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:55.345335 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7713394b-7251-49b2-9334-65912a527cb6 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:55.359802 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1123/2234] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:29:55 2022] POST /identity/v3/projects => generated 373 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:29:55.370603 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7713394b-7251-49b2-9334-65912a527cb6 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:55.493827 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e59513b-8deb-4f8a-94c3-d69365d99191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:55.493827 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59513b-8deb-4f8a-94c3-d69365d99191 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:55.493827 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59513b-8deb-4f8a-94c3-d69365d99191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:55.493827 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59513b-8deb-4f8a-94c3-d69365d99191 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:55.494518 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e59513b-8deb-4f8a-94c3-d69365d99191 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:55.494518 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e59513b-8deb-4f8a-94c3-d69365d99191 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:56.001430 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1112/2235] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:29:55 2022] POST /identity/v3/users => generated 293 bytes in 656 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:29:56.003159 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d11e87-2bfe-4e5c-929a-77ea837ea8d0 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:56.016140 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d11e87-2bfe-4e5c-929a-77ea837ea8d0 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:56.027484 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099b2f22-9c74-4948-892a-dbacc6ef0746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:56.028196 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b2f22-9c74-4948-892a-dbacc6ef0746 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:56.028483 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b2f22-9c74-4948-892a-dbacc6ef0746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:56.029721 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b2f22-9c74-4948-892a-dbacc6ef0746 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:56.029721 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099b2f22-9c74-4948-892a-dbacc6ef0746 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:56.031281 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099b2f22-9c74-4948-892a-dbacc6ef0746 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:56.048744 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e59513b-8deb-4f8a-94c3-d69365d99191 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:56.050671 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1124/2236] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:29:56.063358 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e59513b-8deb-4f8a-94c3-d69365d99191 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:56.070646 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e87ba5e-f79c-4960-8e8c-e6786eece447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:56.071670 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87ba5e-f79c-4960-8e8c-e6786eece447 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:56.072157 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87ba5e-f79c-4960-8e8c-e6786eece447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:56.072534 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87ba5e-f79c-4960-8e8c-e6786eece447 admin admin] PATH_INFO: `/v3/projects/70c99afefea84c64b1c7b1622c9e5d57/users/9cd1a7650b2845108abb3186996f0508/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:56.094159 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e87ba5e-f79c-4960-8e8c-e6786eece447 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70c99afefea84c64b1c7b1622c9e5d57, user_id=9cd1a7650b2845108abb3186996f0508, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:56.097029 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e87ba5e-f79c-4960-8e8c-e6786eece447 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:56.171363 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1113/2237] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:29:56 2022] PUT /identity/v3/projects/70c99afefea84c64b1c7b1622c9e5d57/users/9cd1a7650b2845108abb3186996f0508/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:29:56.175094 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099b2f22-9c74-4948-892a-dbacc6ef0746 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:56.186676 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099b2f22-9c74-4948-892a-dbacc6ef0746 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:56.257750 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c496f155-9e87-4bbe-9d12-8eb7b5063dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:56.258600 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496f155-9e87-4bbe-9d12-8eb7b5063dc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:56.258882 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496f155-9e87-4bbe-9d12-8eb7b5063dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:56.259211 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496f155-9e87-4bbe-9d12-8eb7b5063dc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:56.260118 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c496f155-9e87-4bbe-9d12-8eb7b5063dc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:56.264075 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c496f155-9e87-4bbe-9d12-8eb7b5063dc4 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:56.273464 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1125/2238] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:29:56.284484 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e87ba5e-f79c-4960-8e8c-e6786eece447 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:56.296179 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e87ba5e-f79c-4960-8e8c-e6786eece447 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:56.301308 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f56f83c-2fe2-40c2-9b77-e607f53f679b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:56.302216 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f56f83c-2fe2-40c2-9b77-e607f53f679b admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:56.302486 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f56f83c-2fe2-40c2-9b77-e607f53f679b admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:56.302765 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f56f83c-2fe2-40c2-9b77-e607f53f679b admin admin] PATH_INFO: `/v3/projects/70c99afefea84c64b1c7b1622c9e5d57/users/9cd1a7650b2845108abb3186996f0508/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:56.305027 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f56f83c-2fe2-40c2-9b77-e607f53f679b admin admin] RBAC: Authorizing `identity:create_grant(project_id=70c99afefea84c64b1c7b1622c9e5d57, user_id=9cd1a7650b2845108abb3186996f0508, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:56.307828 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f56f83c-2fe2-40c2-9b77-e607f53f679b admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:56.330905 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1114/2239] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:29:56 2022] PUT /identity/v3/projects/70c99afefea84c64b1c7b1622c9e5d57/users/9cd1a7650b2845108abb3186996f0508/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:29:56.332946 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33f42a-45bf-498b-ae4d-3ad4e94b61d1 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:56.333451 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33f42a-45bf-498b-ae4d-3ad4e94b61d1 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:56.333804 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33f42a-45bf-498b-ae4d-3ad4e94b61d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:56.368218 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-6e33f42a-45bf-498b-ae4d-3ad4e94b61d1 None None] MFA Rules not processed for user `9cd1a7650b2845108abb3186996f0508`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:29:56.369708 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-6e33f42a-45bf-498b-ae4d-3ad4e94b61d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:56.444844 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1126/2240] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:29:56 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:29:56.457267 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f56f83c-2fe2-40c2-9b77-e607f53f679b admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:29:56.459056 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-9f56f83c-2fe2-40c2-9b77-e607f53f679b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:29:56.523453 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f56f83c-2fe2-40c2-9b77-e607f53f679b admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:29:56.527000 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ce979-4540-4a5d-9ecc-5fa97a0a58e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:29:56.527729 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ce979-4540-4a5d-9ecc-5fa97a0a58e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:29:56.528091 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ce979-4540-4a5d-9ecc-5fa97a0a58e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:29:56.528280 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ce979-4540-4a5d-9ecc-5fa97a0a58e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:29:56.595380 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ce979-4540-4a5d-9ecc-5fa97a0a58e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:29:56.596869 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ce979-4540-4a5d-9ecc-5fa97a0a58e6 service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:29:56.613320 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1115/2241] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:29:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:30:00.115586 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e33f42a-45bf-498b-ae4d-3ad4e94b61d1 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:30:00.203763 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e33f42a-45bf-498b-ae4d-3ad4e94b61d1 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:30:00.210913 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b3b49a-078c-4834-837d-1e37aa6983ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:30:00.211989 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3b49a-078c-4834-837d-1e37aa6983ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:30:00.212326 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3b49a-078c-4834-837d-1e37aa6983ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:30:00.212595 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3b49a-078c-4834-837d-1e37aa6983ff admin admin] PATH_INFO: `/v3/users/33e6f0a8c71341e19125ba6ad902c2bf` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:30:00.214442 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b3b49a-078c-4834-837d-1e37aa6983ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=33e6f0a8c71341e19125ba6ad902c2bf)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:30:00.216610 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b3b49a-078c-4834-837d-1e37aa6983ff admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:30:00.904066 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-19b3b49a-078c-4834-837d-1e37aa6983ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33e6f0a8c71341e19125ba6ad902c2bf'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:30:00.918806 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-19b3b49a-078c-4834-837d-1e37aa6983ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33e6f0a8c71341e19125ba6ad902c2bf'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:30:01.001402 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-19b3b49a-078c-4834-837d-1e37aa6983ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33e6f0a8c71341e19125ba6ad902c2bf'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:30:01.003600 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-19b3b49a-078c-4834-837d-1e37aa6983ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33e6f0a8c71341e19125ba6ad902c2bf'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:30:01.003600 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-19b3b49a-078c-4834-837d-1e37aa6983ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33e6f0a8c71341e19125ba6ad902c2bf'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:30:01.021646 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1127/2242] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:30:00 2022] DELETE /identity/v3/users/33e6f0a8c71341e19125ba6ad902c2bf => generated 0 bytes in 907 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:30:01.026468 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52dcb0-a300-49eb-a7c8-632505395176 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:30:01.027020 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52dcb0-a300-49eb-a7c8-632505395176 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:30:01.027217 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52dcb0-a300-49eb-a7c8-632505395176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:30:01.054973 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-2b52dcb0-a300-49eb-a7c8-632505395176 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:30:01.056355 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-2b52dcb0-a300-49eb-a7c8-632505395176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:30:01.137158 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1116/2243] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:30:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:30:01.147385 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b3b49a-078c-4834-837d-1e37aa6983ff admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:30:01.149030 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-19b3b49a-078c-4834-837d-1e37aa6983ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:30:01.229235 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b3b49a-078c-4834-837d-1e37aa6983ff admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:30:01.240115 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff9e02-4267-4baf-bb33-64cf8b0252f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:30:01.240928 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff9e02-4267-4baf-bb33-64cf8b0252f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:30:01.241314 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff9e02-4267-4baf-bb33-64cf8b0252f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:30:01.241744 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff9e02-4267-4baf-bb33-64cf8b0252f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:30:01.260141 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ff9e02-4267-4baf-bb33-64cf8b0252f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:30:01.261717 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ff9e02-4267-4baf-bb33-64cf8b0252f7 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:30:01.276383 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1128/2244] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:30:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 07 06:30:01.827892 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b52dcb0-a300-49eb-a7c8-632505395176 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:30:01.829609 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-2b52dcb0-a300-49eb-a7c8-632505395176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:30:01.877855 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b52dcb0-a300-49eb-a7c8-632505395176 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:30:01.885098 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fc5b28-96aa-4439-a751-70d07e14a7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:30:01.887922 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc5b28-96aa-4439-a751-70d07e14a7ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:30:01.888281 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc5b28-96aa-4439-a751-70d07e14a7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:30:01.888646 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc5b28-96aa-4439-a751-70d07e14a7ee admin admin] PATH_INFO: `/v3/projects/7d89cb197d5c47aea205c4f94569a017` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:30:01.890485 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fc5b28-96aa-4439-a751-70d07e14a7ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d89cb197d5c47aea205c4f94569a017)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:30:01.893229 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fc5b28-96aa-4439-a751-70d07e14a7ee admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:30:02.089960 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d4fc5b28-96aa-4439-a751-70d07e14a7ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d89cb197d5c47aea205c4f94569a017', 'request_id': 'req-d4fc5b28-96aa-4439-a751-70d07e14a7ee'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:30:02.100994 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d4fc5b28-96aa-4439-a751-70d07e14a7ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d89cb197d5c47aea205c4f94569a017', 'request_id': 'req-d4fc5b28-96aa-4439-a751-70d07e14a7ee'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:30:02.219678 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d4fc5b28-96aa-4439-a751-70d07e14a7ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d89cb197d5c47aea205c4f94569a017', 'request_id': 'req-d4fc5b28-96aa-4439-a751-70d07e14a7ee'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:30:02.235738 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d4fc5b28-96aa-4439-a751-70d07e14a7ee admin admin] The token cache is being invalidate because project 7d89cb197d5c47aea205c4f94569a017 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:30:02.236418 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d4fc5b28-96aa-4439-a751-70d07e14a7ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:30:02.237354 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d4fc5b28-96aa-4439-a751-70d07e14a7ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:30:02.239445 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1117/2245] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:30:01 2022] DELETE /identity/v3/projects/7d89cb197d5c47aea205c4f94569a017 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:30:02.244159 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff9e02-4267-4baf-bb33-64cf8b0252f7 service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:30:02.257101 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff9e02-4267-4baf-bb33-64cf8b0252f7 service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:30:02.321378 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f3404-d3e1-4ad8-a440-06dd35e557ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:30:02.322486 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f3404-d3e1-4ad8-a440-06dd35e557ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:30:02.322722 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f3404-d3e1-4ad8-a440-06dd35e557ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:30:02.323009 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f3404-d3e1-4ad8-a440-06dd35e557ed admin admin] PATH_INFO: `/v3/users/9cd1a7650b2845108abb3186996f0508` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:30:02.324259 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418f3404-d3e1-4ad8-a440-06dd35e557ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cd1a7650b2845108abb3186996f0508)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:30:02.326490 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418f3404-d3e1-4ad8-a440-06dd35e557ed admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:30:02.481726 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-418f3404-d3e1-4ad8-a440-06dd35e557ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cd1a7650b2845108abb3186996f0508'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:30:02.495980 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-418f3404-d3e1-4ad8-a440-06dd35e557ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cd1a7650b2845108abb3186996f0508'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:30:02.579303 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-418f3404-d3e1-4ad8-a440-06dd35e557ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cd1a7650b2845108abb3186996f0508'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:30:02.580295 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-418f3404-d3e1-4ad8-a440-06dd35e557ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cd1a7650b2845108abb3186996f0508'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:30:02.581156 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-418f3404-d3e1-4ad8-a440-06dd35e557ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cd1a7650b2845108abb3186996f0508'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:30:02.597083 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1129/2246] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:30:02 2022] DELETE /identity/v3/users/9cd1a7650b2845108abb3186996f0508 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:30:03.092297 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fc5b28-96aa-4439-a751-70d07e14a7ee admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:30:03.101365 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d4fc5b28-96aa-4439-a751-70d07e14a7ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:30:03.143798 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fc5b28-96aa-4439-a751-70d07e14a7ee admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:30:03.292574 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6bcf12-57dd-4b5c-a1aa-bf2ab09eb9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:30:03.300966 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6bcf12-57dd-4b5c-a1aa-bf2ab09eb9e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:30:03.300966 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6bcf12-57dd-4b5c-a1aa-bf2ab09eb9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:30:03.300966 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6bcf12-57dd-4b5c-a1aa-bf2ab09eb9e2 admin admin] PATH_INFO: `/v3/projects/70c99afefea84c64b1c7b1622c9e5d57` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:30:03.300966 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6bcf12-57dd-4b5c-a1aa-bf2ab09eb9e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70c99afefea84c64b1c7b1622c9e5d57)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:30:03.300966 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6bcf12-57dd-4b5c-a1aa-bf2ab09eb9e2 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:30:03.465054 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-2d6bcf12-57dd-4b5c-a1aa-bf2ab09eb9e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70c99afefea84c64b1c7b1622c9e5d57', 'request_id': 'req-2d6bcf12-57dd-4b5c-a1aa-bf2ab09eb9e2'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:30:03.478211 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-2d6bcf12-57dd-4b5c-a1aa-bf2ab09eb9e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70c99afefea84c64b1c7b1622c9e5d57', 'request_id': 'req-2d6bcf12-57dd-4b5c-a1aa-bf2ab09eb9e2'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:30:03.606812 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-2d6bcf12-57dd-4b5c-a1aa-bf2ab09eb9e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70c99afefea84c64b1c7b1622c9e5d57', 'request_id': 'req-2d6bcf12-57dd-4b5c-a1aa-bf2ab09eb9e2'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:30:03.627691 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-2d6bcf12-57dd-4b5c-a1aa-bf2ab09eb9e2 admin admin] The token cache is being invalidate because project 70c99afefea84c64b1c7b1622c9e5d57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:30:03.628660 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-2d6bcf12-57dd-4b5c-a1aa-bf2ab09eb9e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:30:03.629530 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-2d6bcf12-57dd-4b5c-a1aa-bf2ab09eb9e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:30:03.632222 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1118/2247] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:30:03 2022] DELETE /identity/v3/projects/70c99afefea84c64b1c7b1622c9e5d57 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:30:03.640323 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e677778-5df7-4b4b-bbc1-935fece2ef94 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:30:03.640323 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e677778-5df7-4b4b-bbc1-935fece2ef94 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:30:03.640323 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e677778-5df7-4b4b-bbc1-935fece2ef94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:30:03.662682 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-7e677778-5df7-4b4b-bbc1-935fece2ef94 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:30:03.664479 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-7e677778-5df7-4b4b-bbc1-935fece2ef94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:30:03.754676 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1130/2248] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:30:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:30:03.762803 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa70be-2714-4d31-8421-59fa23186b3f None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:30:03.763086 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa70be-2714-4d31-8421-59fa23186b3f None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:30:03.763393 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa70be-2714-4d31-8421-59fa23186b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:30:03.817931 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-d9aa70be-2714-4d31-8421-59fa23186b3f None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:30:03.821649 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d9aa70be-2714-4d31-8421-59fa23186b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:30:03.851877 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1119/2249] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:30:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:30:03.853400 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e677778-5df7-4b4b-bbc1-935fece2ef94 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:30:03.884693 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e677778-5df7-4b4b-bbc1-935fece2ef94 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:30:03.906658 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584edb74-4e60-41a2-b427-ad14dbc808ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:30:03.907418 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584edb74-4e60-41a2-b427-ad14dbc808ff admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:30:03.907831 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584edb74-4e60-41a2-b427-ad14dbc808ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:30:03.908143 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584edb74-4e60-41a2-b427-ad14dbc808ff admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:30:03.909729 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584edb74-4e60-41a2-b427-ad14dbc808ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:30:03.911245 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584edb74-4e60-41a2-b427-ad14dbc808ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:30:03.918957 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584edb74-4e60-41a2-b427-ad14dbc808ff admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:30:03.967681 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1131/2250] 10.222.0.24 () {58 vars in 1152 bytes} [Thu Apr 7 06:30:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:30:03.970534 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa70be-2714-4d31-8421-59fa23186b3f None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:30:03.995788 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa70be-2714-4d31-8421-59fa23186b3f None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:30:04.002578 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e538505-a3b9-4036-885a-7b67357b9fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:30:04.003571 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e538505-a3b9-4036-885a-7b67357b9fe5 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:30:04.004040 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e538505-a3b9-4036-885a-7b67357b9fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:30:04.004495 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e538505-a3b9-4036-885a-7b67357b9fe5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:30:04.005517 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e538505-a3b9-4036-885a-7b67357b9fe5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:30:04.007465 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e538505-a3b9-4036-885a-7b67357b9fe5 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:30:04.160474 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1120/2251] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:30:03 2022] POST /identity/v3/projects => generated 373 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:30:04.164477 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584edb74-4e60-41a2-b427-ad14dbc808ff admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:30:04.181179 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584edb74-4e60-41a2-b427-ad14dbc808ff admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:30:04.302965 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f7b00c-ea07-4a15-8be3-f20cfc6403fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:30:04.303931 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f7b00c-ea07-4a15-8be3-f20cfc6403fd admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:30:04.304330 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f7b00c-ea07-4a15-8be3-f20cfc6403fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:30:04.304841 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f7b00c-ea07-4a15-8be3-f20cfc6403fd admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:30:04.306001 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f7b00c-ea07-4a15-8be3-f20cfc6403fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:30:04.308905 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f7b00c-ea07-4a15-8be3-f20cfc6403fd admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:30:04.442157 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1132/2252] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:30:04 2022] POST /identity/v3/users => generated 287 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:30:04.443025 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e538505-a3b9-4036-885a-7b67357b9fe5 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:30:04.471343 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e538505-a3b9-4036-885a-7b67357b9fe5 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:30:04.488519 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e6973-e206-4423-ad4d-37d99bec282e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:30:04.489482 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e6973-e206-4423-ad4d-37d99bec282e admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:30:04.489772 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e6973-e206-4423-ad4d-37d99bec282e admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:30:04.490055 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e6973-e206-4423-ad4d-37d99bec282e admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:30:04.490805 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2e6973-e206-4423-ad4d-37d99bec282e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:30:04.492434 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2e6973-e206-4423-ad4d-37d99bec282e admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:30:04.514065 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1121/2253] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:30:04 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:30:04.526521 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f7b00c-ea07-4a15-8be3-f20cfc6403fd admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:30:04.537543 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f7b00c-ea07-4a15-8be3-f20cfc6403fd admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:30:04.542288 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baeb992-98f3-4952-8675-cbd592f95ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:30:04.542955 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baeb992-98f3-4952-8675-cbd592f95ea2 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:30:04.543245 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baeb992-98f3-4952-8675-cbd592f95ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:30:04.543519 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baeb992-98f3-4952-8675-cbd592f95ea2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:30:04.544284 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baeb992-98f3-4952-8675-cbd592f95ea2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:30:04.546500 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baeb992-98f3-4952-8675-cbd592f95ea2 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:30:04.557907 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1133/2254] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:30:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:30:04.562201 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e6973-e206-4423-ad4d-37d99bec282e admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:30:04.573037 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e6973-e206-4423-ad4d-37d99bec282e admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:30:04.577832 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518bfae0-f928-4101-b068-4b7aca8a617d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:30:04.578804 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518bfae0-f928-4101-b068-4b7aca8a617d admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:30:04.579060 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518bfae0-f928-4101-b068-4b7aca8a617d admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:30:04.579344 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518bfae0-f928-4101-b068-4b7aca8a617d admin admin] PATH_INFO: `/v3/projects/cb2708df559245e88619e75213e654a3/users/713a0139b2c74a6c912c5c9ec00c4dae/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:30:04.599004 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518bfae0-f928-4101-b068-4b7aca8a617d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb2708df559245e88619e75213e654a3, user_id=713a0139b2c74a6c912c5c9ec00c4dae, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:30:04.602703 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518bfae0-f928-4101-b068-4b7aca8a617d admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:30:05.224767 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1122/2255] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:30:04 2022] PUT /identity/v3/projects/cb2708df559245e88619e75213e654a3/users/713a0139b2c74a6c912c5c9ec00c4dae/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:30:05.229784 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e41f57-e2d2-4d0d-a833-92865e110857 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:30:05.230227 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e41f57-e2d2-4d0d-a833-92865e110857 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:30:05.230368 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e41f57-e2d2-4d0d-a833-92865e110857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:30:05.249694 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-58e41f57-e2d2-4d0d-a833-92865e110857 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:30:05.251012 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-58e41f57-e2d2-4d0d-a833-92865e110857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:30:05.312916 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1134/2256] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:30:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:30:05.323261 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518bfae0-f928-4101-b068-4b7aca8a617d admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:30:05.325007 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-518bfae0-f928-4101-b068-4b7aca8a617d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:30:05.404714 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518bfae0-f928-4101-b068-4b7aca8a617d admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:30:05.409140 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d77349-0517-4a83-89e4-7b5232eacd86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:30:05.409799 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d77349-0517-4a83-89e4-7b5232eacd86 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:30:05.410084 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d77349-0517-4a83-89e4-7b5232eacd86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:30:05.410359 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d77349-0517-4a83-89e4-7b5232eacd86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:30:05.423473 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d77349-0517-4a83-89e4-7b5232eacd86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:30:05.424969 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d77349-0517-4a83-89e4-7b5232eacd86 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:30:05.448466 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1123/2257] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:30:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:30:06.968242 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36b9c7-59c4-4221-82a0-c497aa86f60b None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:30:06.968801 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36b9c7-59c4-4221-82a0-c497aa86f60b None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:30:06.968801 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36b9c7-59c4-4221-82a0-c497aa86f60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:30:07.002535 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-9b36b9c7-59c4-4221-82a0-c497aa86f60b None None] MFA Rules not processed for user `713a0139b2c74a6c912c5c9ec00c4dae`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:30:07.003921 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-9b36b9c7-59c4-4221-82a0-c497aa86f60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:30:07.097865 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1135/2258] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:30:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:30:07.110911 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d77349-0517-4a83-89e4-7b5232eacd86 service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:30:07.113414 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-e1d77349-0517-4a83-89e4-7b5232eacd86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:30:07.182103 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d77349-0517-4a83-89e4-7b5232eacd86 service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:30:07.185711 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5924f152-f832-4f5b-8632-2636ecddcafb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:30:07.186428 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5924f152-f832-4f5b-8632-2636ecddcafb service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:30:07.186710 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5924f152-f832-4f5b-8632-2636ecddcafb service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:30:07.186982 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5924f152-f832-4f5b-8632-2636ecddcafb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:30:07.197856 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5924f152-f832-4f5b-8632-2636ecddcafb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:30:07.199365 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5924f152-f832-4f5b-8632-2636ecddcafb service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:30:07.209053 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1124/2259] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:30:07 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:30:08.979561 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eeae69-cebe-4dbe-8087-82110f67192d None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:30:08.979959 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eeae69-cebe-4dbe-8087-82110f67192d None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:30:08.980184 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eeae69-cebe-4dbe-8087-82110f67192d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:30:08.997532 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-d0eeae69-cebe-4dbe-8087-82110f67192d None None] MFA Rules not processed for user `713a0139b2c74a6c912c5c9ec00c4dae`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:30:08.999226 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d0eeae69-cebe-4dbe-8087-82110f67192d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:30:09.006248 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1136/2260] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:30:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:30:15.339467 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55dc0b5-dba3-49e8-aee6-387105d98a53 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:30:15.340032 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55dc0b5-dba3-49e8-aee6-387105d98a53 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:30:15.340233 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55dc0b5-dba3-49e8-aee6-387105d98a53 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:30:15.341771 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1125/2261] 10.222.0.24 () {54 vars in 921 bytes} [Thu Apr 7 06:30:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:30:15.349207 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930a3b8-8589-4f70-ba94-3788288e5e7c None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:30:15.349699 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930a3b8-8589-4f70-ba94-3788288e5e7c None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:30:15.349793 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930a3b8-8589-4f70-ba94-3788288e5e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:30:15.409594 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-9930a3b8-8589-4f70-ba94-3788288e5e7c None None] MFA Rules not processed for user `02cd81f6620f410db450871fb29961f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:30:15.411472 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-9930a3b8-8589-4f70-ba94-3788288e5e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:30:15.523837 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1137/2262] 10.222.0.24 () {58 vars in 1018 bytes} [Thu Apr 7 06:30:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:30:15.535796 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55dc0b5-dba3-49e8-aee6-387105d98a53 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:30:15.538588 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-f55dc0b5-dba3-49e8-aee6-387105d98a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:30:15.643254 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55dc0b5-dba3-49e8-aee6-387105d98a53 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:30:15.647305 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef86dc7-9f30-4c3b-a7c7-18e82e720d46 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca88debdfcc4a9d918e3b0138a9add1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:30:15.647996 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef86dc7-9f30-4c3b-a7c7-18e82e720d46 service glance] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:30:15.648339 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef86dc7-9f30-4c3b-a7c7-18e82e720d46 service glance] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:30:15.648623 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef86dc7-9f30-4c3b-a7c7-18e82e720d46 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:30:15.660045 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef86dc7-9f30-4c3b-a7c7-18e82e720d46 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:30:15.661482 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef86dc7-9f30-4c3b-a7c7-18e82e720d46 service glance] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:30:15.673321 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1126/2263] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:30:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:30:15.899558 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf06694-5306-4b91-8ee4-f33f3fb0d7d2 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:30:15.900133 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf06694-5306-4b91-8ee4-f33f3fb0d7d2 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:30:15.900415 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf06694-5306-4b91-8ee4-f33f3fb0d7d2 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:30:15.901804 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1138/2264] 10.222.0.24 () {54 vars in 921 bytes} [Thu Apr 7 06:30:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:30:15.907227 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169615e4-1a7a-494a-bbc0-8183a0f0cfa2 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:30:15.907519 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169615e4-1a7a-494a-bbc0-8183a0f0cfa2 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:30:15.911090 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169615e4-1a7a-494a-bbc0-8183a0f0cfa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:30:15.925375 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-169615e4-1a7a-494a-bbc0-8183a0f0cfa2 None None] MFA Rules not processed for user `bb7f549fd26e4642828d4f476aef0239`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:30:15.926608 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-169615e4-1a7a-494a-bbc0-8183a0f0cfa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:30:15.933149 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1127/2265] 10.222.0.24 () {58 vars in 1018 bytes} [Thu Apr 7 06:30:15 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:30:15.944663 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf06694-5306-4b91-8ee4-f33f3fb0d7d2 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:30:15.946406 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-1cf06694-5306-4b91-8ee4-f33f3fb0d7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:30:15.959994 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf06694-5306-4b91-8ee4-f33f3fb0d7d2 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:30:15.963498 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b731b-32d6-46ea-95c7-ebee915c2f07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:30:15.964164 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b731b-32d6-46ea-95c7-ebee915c2f07 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:30:15.964454 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b731b-32d6-46ea-95c7-ebee915c2f07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:30:15.964729 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b731b-32d6-46ea-95c7-ebee915c2f07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:30:15.972155 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27b731b-32d6-46ea-95c7-ebee915c2f07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:30:15.973583 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27b731b-32d6-46ea-95c7-ebee915c2f07 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:30:15.981499 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1139/2266] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:30:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:30:16.072353 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf6f5a-a8f4-4c16-9e53-e8ab4148d6aa None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:30:16.072652 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf6f5a-a8f4-4c16-9e53-e8ab4148d6aa None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:30:16.072933 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf6f5a-a8f4-4c16-9e53-e8ab4148d6aa None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:30:16.074326 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1128/2267] 10.222.0.24 () {54 vars in 921 bytes} [Thu Apr 7 06:30:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 07 06:30:16.079696 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c8789-1480-4a74-84be-f6f3ffa38f7a None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:30:16.080156 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c8789-1480-4a74-84be-f6f3ffa38f7a None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:30:16.080508 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c8789-1480-4a74-84be-f6f3ffa38f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:30:16.099248 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-bd3c8789-1480-4a74-84be-f6f3ffa38f7a None None] MFA Rules not processed for user `02cd81f6620f410db450871fb29961f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:30:16.100469 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-bd3c8789-1480-4a74-84be-f6f3ffa38f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:30:16.110768 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1140/2268] 10.222.0.24 () {58 vars in 1018 bytes} [Thu Apr 7 06:30:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:30:16.121220 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bf6f5a-a8f4-4c16-9e53-e8ab4148d6aa None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:30:16.137315 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bf6f5a-a8f4-4c16-9e53-e8ab4148d6aa None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:30:16.140861 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad973da-7e7e-4507-a001-2cd520702f71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:30:16.141502 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad973da-7e7e-4507-a001-2cd520702f71 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:30:16.141782 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad973da-7e7e-4507-a001-2cd520702f71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:30:16.142053 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad973da-7e7e-4507-a001-2cd520702f71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:30:16.152091 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad973da-7e7e-4507-a001-2cd520702f71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:30:16.153581 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad973da-7e7e-4507-a001-2cd520702f71 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:30:16.167348 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1129/2269] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:30:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:30:24.173627 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91cc08-6ed6-40e7-b0e6-ce44daee65de None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:30:24.174159 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91cc08-6ed6-40e7-b0e6-ce44daee65de None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:30:24.174273 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91cc08-6ed6-40e7-b0e6-ce44daee65de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:30:24.191368 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-7a91cc08-6ed6-40e7-b0e6-ce44daee65de None None] MFA Rules not processed for user `f4435fb14c3844728531af63993f78c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:30:24.192650 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-7a91cc08-6ed6-40e7-b0e6-ce44daee65de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:30:24.247237 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1141/2270] 10.222.0.24 () {58 vars in 1009 bytes} [Thu Apr 7 06:30:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:30:24.260475 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad973da-7e7e-4507-a001-2cd520702f71 service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:30:24.269599 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-9ad973da-7e7e-4507-a001-2cd520702f71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:30:24.340403 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad973da-7e7e-4507-a001-2cd520702f71 service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:30:24.346782 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e7737-6e83-4b78-92cf-0117791ab2ac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4abbb8c5324b7babd69e3b4473b3e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:30:24.347434 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e7737-6e83-4b78-92cf-0117791ab2ac service swift] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:30:24.347792 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e7737-6e83-4b78-92cf-0117791ab2ac service swift] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:30:24.348066 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e7737-6e83-4b78-92cf-0117791ab2ac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:30:24.356587 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8e7737-6e83-4b78-92cf-0117791ab2ac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:30:24.358527 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8e7737-6e83-4b78-92cf-0117791ab2ac service swift] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:30:24.370811 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1130/2271] 10.222.0.24 () {60 vars in 1384 bytes} [Thu Apr 7 06:30:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 07 06:30:41.566158 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a91cc08-6ed6-40e7-b0e6-ce44daee65de None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:30:41.568131 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-7a91cc08-6ed6-40e7-b0e6-ce44daee65de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:30:41.661868 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a91cc08-6ed6-40e7-b0e6-ce44daee65de None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:30:41.666950 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf7d99-992d-49a1-92a0-bad5c2593821 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff35b68665724754a6413bca0030016f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:30:41.667604 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf7d99-992d-49a1-92a0-bad5c2593821 service placement] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:30:41.667956 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf7d99-992d-49a1-92a0-bad5c2593821 service placement] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:30:41.668236 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf7d99-992d-49a1-92a0-bad5c2593821 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:30:41.670529 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-36bf7d99-992d-49a1-92a0-bad5c2593821 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:30:41.682641 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf7d99-992d-49a1-92a0-bad5c2593821 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:30:41.684304 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf7d99-992d-49a1-92a0-bad5c2593821 service placement] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:30:41.694561 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1142/2272] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:30:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:30:46.960277 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4754f-185c-4e68-99e4-1927b1fdb9aa None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:30:46.960891 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4754f-185c-4e68-99e4-1927b1fdb9aa None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:30:46.960891 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4754f-185c-4e68-99e4-1927b1fdb9aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:30:46.978731 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-f0d4754f-185c-4e68-99e4-1927b1fdb9aa None None] MFA Rules not processed for user `0d928dfb5b354509a543229ea0836e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:30:46.979972 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-f0d4754f-185c-4e68-99e4-1927b1fdb9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:30:47.032286 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1131/2273] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:30:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:30:49.460770 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea8560-f712-4cde-8237-aa4cede3ba0b None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:30:49.461264 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea8560-f712-4cde-8237-aa4cede3ba0b None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:30:49.461383 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea8560-f712-4cde-8237-aa4cede3ba0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:30:49.479677 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-11ea8560-f712-4cde-8237-aa4cede3ba0b None None] MFA Rules not processed for user `713a0139b2c74a6c912c5c9ec00c4dae`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:30:49.480902 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-11ea8560-f712-4cde-8237-aa4cede3ba0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:30:49.488096 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1143/2274] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:30:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:30:56.214172 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2f37b-7f89-4035-a9f9-a2107ec624b8 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:30:56.214696 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2f37b-7f89-4035-a9f9-a2107ec624b8 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:30:56.214813 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2f37b-7f89-4035-a9f9-a2107ec624b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:30:56.232572 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-a2f2f37b-7f89-4035-a9f9-a2107ec624b8 None None] MFA Rules not processed for user `e2449dbeca2c40339236837cd1e0e6f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:30:56.233805 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a2f2f37b-7f89-4035-a9f9-a2107ec624b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:30:56.287427 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1132/2275] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:30:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:30:57.360879 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64106b-28ed-412e-b497-14de37b7d815 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:30:57.361342 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64106b-28ed-412e-b497-14de37b7d815 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:30:57.361342 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64106b-28ed-412e-b497-14de37b7d815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:30:57.381764 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-ee64106b-28ed-412e-b497-14de37b7d815 None None] MFA Rules not processed for user `f4435fb14c3844728531af63993f78c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:30:57.394114 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-ee64106b-28ed-412e-b497-14de37b7d815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:30:57.407007 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1144/2276] 10.222.0.24 () {58 vars in 967 bytes} [Thu Apr 7 06:30:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:30:57.433762 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2f37b-7f89-4035-a9f9-a2107ec624b8 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:30:57.449043 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2f37b-7f89-4035-a9f9-a2107ec624b8 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:30:57.455853 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebda47c5-67a8-4390-b162-9b0a0e287551 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4abbb8c5324b7babd69e3b4473b3e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:30:57.456711 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda47c5-67a8-4390-b162-9b0a0e287551 service swift] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:30:57.456982 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda47c5-67a8-4390-b162-9b0a0e287551 service swift] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:30:57.457261 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda47c5-67a8-4390-b162-9b0a0e287551 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:30:57.469114 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebda47c5-67a8-4390-b162-9b0a0e287551 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:30:57.471202 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebda47c5-67a8-4390-b162-9b0a0e287551 service swift] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:30:57.480588 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1133/2277] 10.222.0.24 () {60 vars in 1384 bytes} [Thu Apr 7 06:30:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 07 06:31:17.844050 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f8ca59-c387-41cd-b305-96034d8c214b None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:31:17.844659 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f8ca59-c387-41cd-b305-96034d8c214b None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:31:17.844659 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f8ca59-c387-41cd-b305-96034d8c214b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:31:17.861988 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-47f8ca59-c387-41cd-b305-96034d8c214b None None] MFA Rules not processed for user `c9ac85053def476489ee1843bbd02316`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:31:17.863180 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-47f8ca59-c387-41cd-b305-96034d8c214b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:31:17.916696 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1145/2278] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:31:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:31:25.653963 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca3935-54f1-46b6-9fd3-7322d93cb793 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:31:25.654651 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca3935-54f1-46b6-9fd3-7322d93cb793 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:31:25.654651 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca3935-54f1-46b6-9fd3-7322d93cb793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:31:25.672749 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-2dca3935-54f1-46b6-9fd3-7322d93cb793 None None] MFA Rules not processed for user `f4435fb14c3844728531af63993f78c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:31:25.677244 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-2dca3935-54f1-46b6-9fd3-7322d93cb793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:31:25.681450 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1134/2279] 10.222.0.24 () {58 vars in 1009 bytes} [Thu Apr 7 06:31:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:31:25.694362 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f8ca59-c387-41cd-b305-96034d8c214b None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:31:25.708359 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f8ca59-c387-41cd-b305-96034d8c214b None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:31:25.713543 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc53f4-a3a3-4fac-bd68-682251aa2b37 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4abbb8c5324b7babd69e3b4473b3e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:31:25.714375 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc53f4-a3a3-4fac-bd68-682251aa2b37 service swift] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:31:25.714709 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc53f4-a3a3-4fac-bd68-682251aa2b37 service swift] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:31:25.714989 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc53f4-a3a3-4fac-bd68-682251aa2b37 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:31:25.724017 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafc53f4-a3a3-4fac-bd68-682251aa2b37 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:31:25.725804 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafc53f4-a3a3-4fac-bd68-682251aa2b37 service swift] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:31:25.738154 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1146/2280] 10.222.0.24 () {60 vars in 1384 bytes} [Thu Apr 7 06:31:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 07 06:31:43.819854 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8cebc-ec38-49f4-acbc-749de6be1030 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:31:43.820553 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8cebc-ec38-49f4-acbc-749de6be1030 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:31:43.820647 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8cebc-ec38-49f4-acbc-749de6be1030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:31:43.838630 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-60c8cebc-ec38-49f4-acbc-749de6be1030 None None] MFA Rules not processed for user `f4435fb14c3844728531af63993f78c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:31:43.839848 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-60c8cebc-ec38-49f4-acbc-749de6be1030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:31:43.846923 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1135/2281] 10.222.0.24 () {58 vars in 967 bytes} [Thu Apr 7 06:31:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:31:43.859836 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc53f4-a3a3-4fac-bd68-682251aa2b37 service swift] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:31:43.871143 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc53f4-a3a3-4fac-bd68-682251aa2b37 service swift] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:31:43.876326 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba65bd42-c7e3-4673-8b1c-e2b5296cf9e0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4abbb8c5324b7babd69e3b4473b3e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:31:43.877042 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65bd42-c7e3-4673-8b1c-e2b5296cf9e0 service swift] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:31:43.877396 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65bd42-c7e3-4673-8b1c-e2b5296cf9e0 service swift] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:31:43.877761 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65bd42-c7e3-4673-8b1c-e2b5296cf9e0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:31:43.885875 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba65bd42-c7e3-4673-8b1c-e2b5296cf9e0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:31:43.887517 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba65bd42-c7e3-4673-8b1c-e2b5296cf9e0 service swift] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:31:43.895528 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1147/2282] 10.222.0.24 () {60 vars in 1384 bytes} [Thu Apr 7 06:31:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 07 06:31:46.995146 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c8cebc-ec38-49f4-acbc-749de6be1030 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:31:47.015761 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c8cebc-ec38-49f4-acbc-749de6be1030 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:31:47.020478 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c5be8-1e07-4f44-9edc-f705e106c4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:31:47.021464 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c5be8-1e07-4f44-9edc-f705e106c4d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:31:47.021752 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c5be8-1e07-4f44-9edc-f705e106c4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:31:47.022031 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c5be8-1e07-4f44-9edc-f705e106c4d3 admin admin] PATH_INFO: `/v3/users/713a0139b2c74a6c912c5c9ec00c4dae` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:31:47.023244 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7c5be8-1e07-4f44-9edc-f705e106c4d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=713a0139b2c74a6c912c5c9ec00c4dae)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:31:47.025309 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7c5be8-1e07-4f44-9edc-f705e106c4d3 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:31:47.258832 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-bb7c5be8-1e07-4f44-9edc-f705e106c4d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '713a0139b2c74a6c912c5c9ec00c4dae'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:31:47.259489 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-bb7c5be8-1e07-4f44-9edc-f705e106c4d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '713a0139b2c74a6c912c5c9ec00c4dae'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:31:47.325297 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-bb7c5be8-1e07-4f44-9edc-f705e106c4d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '713a0139b2c74a6c912c5c9ec00c4dae'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:31:47.326000 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-bb7c5be8-1e07-4f44-9edc-f705e106c4d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '713a0139b2c74a6c912c5c9ec00c4dae'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:31:47.337742 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-bb7c5be8-1e07-4f44-9edc-f705e106c4d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '713a0139b2c74a6c912c5c9ec00c4dae'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:31:47.349592 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1136/2283] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:31:46 2022] DELETE /identity/v3/users/713a0139b2c74a6c912c5c9ec00c4dae => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:31:47.584013 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba65bd42-c7e3-4673-8b1c-e2b5296cf9e0 service swift] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:31:47.594831 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba65bd42-c7e3-4673-8b1c-e2b5296cf9e0 service swift] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:31:47.650085 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12276652-7012-4d53-85f7-b15ea978e43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:31:47.650933 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12276652-7012-4d53-85f7-b15ea978e43a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:31:47.651217 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12276652-7012-4d53-85f7-b15ea978e43a admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:31:47.651515 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12276652-7012-4d53-85f7-b15ea978e43a admin admin] PATH_INFO: `/v3/projects/cb2708df559245e88619e75213e654a3` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:31:47.652706 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12276652-7012-4d53-85f7-b15ea978e43a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb2708df559245e88619e75213e654a3)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:31:47.654589 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12276652-7012-4d53-85f7-b15ea978e43a admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:31:47.753218 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-12276652-7012-4d53-85f7-b15ea978e43a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb2708df559245e88619e75213e654a3', 'request_id': 'req-12276652-7012-4d53-85f7-b15ea978e43a'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:31:47.759887 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-12276652-7012-4d53-85f7-b15ea978e43a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb2708df559245e88619e75213e654a3', 'request_id': 'req-12276652-7012-4d53-85f7-b15ea978e43a'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:31:47.839274 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-12276652-7012-4d53-85f7-b15ea978e43a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb2708df559245e88619e75213e654a3', 'request_id': 'req-12276652-7012-4d53-85f7-b15ea978e43a'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:31:47.849944 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-12276652-7012-4d53-85f7-b15ea978e43a admin admin] The token cache is being invalidate because project cb2708df559245e88619e75213e654a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:31:47.850232 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-12276652-7012-4d53-85f7-b15ea978e43a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:31:47.850846 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-12276652-7012-4d53-85f7-b15ea978e43a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:31:47.852533 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1148/2284] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:31:47 2022] DELETE /identity/v3/projects/cb2708df559245e88619e75213e654a3 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:32:05.166883 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce9d9e-099c-4b47-b1d6-82c4268a6e4d None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:32:05.167430 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce9d9e-099c-4b47-b1d6-82c4268a6e4d None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:32:05.167430 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce9d9e-099c-4b47-b1d6-82c4268a6e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:32:05.184883 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-94ce9d9e-099c-4b47-b1d6-82c4268a6e4d None None] MFA Rules not processed for user `eb071251b5b74ab8b03e312de3bc945e`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:32:05.186059 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-94ce9d9e-099c-4b47-b1d6-82c4268a6e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:32:05.239165 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1137/2285] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:32:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:32:12.817541 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12276652-7012-4d53-85f7-b15ea978e43a admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:32:12.818979 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-12276652-7012-4d53-85f7-b15ea978e43a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:32:12.883089 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12276652-7012-4d53-85f7-b15ea978e43a admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:32:12.888199 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c3a0a6-af11-467f-acb6-423e53fdb379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:32:12.889074 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c3a0a6-af11-467f-acb6-423e53fdb379 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:32:12.889357 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c3a0a6-af11-467f-acb6-423e53fdb379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:32:12.889629 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c3a0a6-af11-467f-acb6-423e53fdb379 admin admin] PATH_INFO: `/v3/users/e2449dbeca2c40339236837cd1e0e6f5` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:32:12.890813 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c3a0a6-af11-467f-acb6-423e53fdb379 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2449dbeca2c40339236837cd1e0e6f5)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:32:12.895339 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c3a0a6-af11-467f-acb6-423e53fdb379 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:32:13.074577 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-79c3a0a6-af11-467f-acb6-423e53fdb379 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2449dbeca2c40339236837cd1e0e6f5'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:32:13.086647 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-79c3a0a6-af11-467f-acb6-423e53fdb379 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2449dbeca2c40339236837cd1e0e6f5'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:32:13.159011 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-79c3a0a6-af11-467f-acb6-423e53fdb379 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2449dbeca2c40339236837cd1e0e6f5'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:32:13.159666 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-79c3a0a6-af11-467f-acb6-423e53fdb379 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2449dbeca2c40339236837cd1e0e6f5'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:32:13.160362 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-79c3a0a6-af11-467f-acb6-423e53fdb379 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2449dbeca2c40339236837cd1e0e6f5'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:32:13.181619 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1149/2286] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:32:12 2022] DELETE /identity/v3/users/e2449dbeca2c40339236837cd1e0e6f5 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:32:13.402325 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce9d9e-099c-4b47-b1d6-82c4268a6e4d None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:32:13.433712 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce9d9e-099c-4b47-b1d6-82c4268a6e4d None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:32:13.488712 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee762a13-2979-49cb-998b-0d840881447b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:32:13.489840 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee762a13-2979-49cb-998b-0d840881447b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:32:13.490123 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee762a13-2979-49cb-998b-0d840881447b admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:32:13.490395 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee762a13-2979-49cb-998b-0d840881447b admin admin] PATH_INFO: `/v3/projects/e3434366e8944e198a26127bcfec8e65` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:32:13.491570 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee762a13-2979-49cb-998b-0d840881447b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3434366e8944e198a26127bcfec8e65)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:32:13.493529 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee762a13-2979-49cb-998b-0d840881447b admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:32:13.604169 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ee762a13-2979-49cb-998b-0d840881447b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3434366e8944e198a26127bcfec8e65', 'request_id': 'req-ee762a13-2979-49cb-998b-0d840881447b'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:32:13.609988 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ee762a13-2979-49cb-998b-0d840881447b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3434366e8944e198a26127bcfec8e65', 'request_id': 'req-ee762a13-2979-49cb-998b-0d840881447b'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:32:13.685524 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ee762a13-2979-49cb-998b-0d840881447b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3434366e8944e198a26127bcfec8e65', 'request_id': 'req-ee762a13-2979-49cb-998b-0d840881447b'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:32:13.696674 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ee762a13-2979-49cb-998b-0d840881447b admin admin] The token cache is being invalidate because project e3434366e8944e198a26127bcfec8e65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:32:13.696961 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ee762a13-2979-49cb-998b-0d840881447b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:32:13.697653 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ee762a13-2979-49cb-998b-0d840881447b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:32:13.699210 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1138/2287] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:32:13 2022] DELETE /identity/v3/projects/e3434366e8944e198a26127bcfec8e65 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:32:36.501591 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c3a0a6-af11-467f-acb6-423e53fdb379 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:32:36.502979 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-79c3a0a6-af11-467f-acb6-423e53fdb379 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:32:36.557375 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c3a0a6-af11-467f-acb6-423e53fdb379 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:32:36.604005 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56593c7b-f499-4feb-a63f-4c8232030cc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:32:36.604582 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56593c7b-f499-4feb-a63f-4c8232030cc5 service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:32:36.604868 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56593c7b-f499-4feb-a63f-4c8232030cc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:32:36.605146 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56593c7b-f499-4feb-a63f-4c8232030cc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:32:36.606912 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-56593c7b-f499-4feb-a63f-4c8232030cc5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:32:36.674202 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56593c7b-f499-4feb-a63f-4c8232030cc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:32:36.675636 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56593c7b-f499-4feb-a63f-4c8232030cc5 service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:32:36.688450 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1150/2288] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:32:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:32:37.140023 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770cb1d-374e-4e40-8fbe-934f7bc462a3 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:32:37.140814 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770cb1d-374e-4e40-8fbe-934f7bc462a3 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:32:37.140814 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770cb1d-374e-4e40-8fbe-934f7bc462a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:32:37.159070 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-4770cb1d-374e-4e40-8fbe-934f7bc462a3 None None] MFA Rules not processed for user `0d928dfb5b354509a543229ea0836e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:32:37.160314 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-4770cb1d-374e-4e40-8fbe-934f7bc462a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:32:37.215232 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1139/2289] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:32:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:32:38.761710 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56593c7b-f499-4feb-a63f-4c8232030cc5 service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:32:38.763798 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-56593c7b-f499-4feb-a63f-4c8232030cc5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:32:38.820377 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56593c7b-f499-4feb-a63f-4c8232030cc5 service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:32:38.824273 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e692ab-f531-4c71-a4ed-d59af0c3e378 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:32:38.824979 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e692ab-f531-4c71-a4ed-d59af0c3e378 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:32:38.825228 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e692ab-f531-4c71-a4ed-d59af0c3e378 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:32:38.825504 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e692ab-f531-4c71-a4ed-d59af0c3e378 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:32:38.827350 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d5e692ab-f531-4c71-a4ed-d59af0c3e378 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:32:38.841460 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e692ab-f531-4c71-a4ed-d59af0c3e378 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:32:38.842927 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e692ab-f531-4c71-a4ed-d59af0c3e378 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:32:38.854243 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1151/2290] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:32:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:32:51.686783 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179553e-5744-480a-ba02-2afdc325532b None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:32:51.687301 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179553e-5744-480a-ba02-2afdc325532b None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:32:51.687396 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179553e-5744-480a-ba02-2afdc325532b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:32:51.704922 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-4179553e-5744-480a-ba02-2afdc325532b None None] MFA Rules not processed for user `9dfc8205c02f4f83bafdac7217b3e685`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:32:51.706132 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-4179553e-5744-480a-ba02-2afdc325532b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:32:51.761708 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1140/2291] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:32:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:32:52.154103 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd67f073-063b-4cbf-ab82-2d4d29c70218 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:32:52.154674 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd67f073-063b-4cbf-ab82-2d4d29c70218 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:32:52.154674 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd67f073-063b-4cbf-ab82-2d4d29c70218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:32:52.156688 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179553e-5744-480a-ba02-2afdc325532b None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:32:52.165999 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179553e-5744-480a-ba02-2afdc325532b None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:32:52.169988 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98977fd-d872-4c7b-8349-744ac5c97690 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:32:52.170641 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98977fd-d872-4c7b-8349-744ac5c97690 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:32:52.170931 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98977fd-d872-4c7b-8349-744ac5c97690 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:32:52.171211 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98977fd-d872-4c7b-8349-744ac5c97690 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:32:52.172723 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-dd67f073-063b-4cbf-ab82-2d4d29c70218 None None] MFA Rules not processed for user `c9ac85053def476489ee1843bbd02316`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:32:52.173086 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-e98977fd-d872-4c7b-8349-744ac5c97690 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:32:52.174172 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-dd67f073-063b-4cbf-ab82-2d4d29c70218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:32:52.186550 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98977fd-d872-4c7b-8349-744ac5c97690 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:32:52.188458 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98977fd-d872-4c7b-8349-744ac5c97690 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:32:52.197638 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1141/2292] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:32:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 07 06:32:52.230435 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1152/2293] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:32:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:32:52.633272 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98977fd-d872-4c7b-8349-744ac5c97690 service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:32:52.635607 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-e98977fd-d872-4c7b-8349-744ac5c97690 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:32:52.709505 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98977fd-d872-4c7b-8349-744ac5c97690 service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:32:52.714611 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c9174-8e42-49e1-ab31-e03251226db1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff35b68665724754a6413bca0030016f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:32:52.715267 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c9174-8e42-49e1-ab31-e03251226db1 service placement] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:32:52.715563 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c9174-8e42-49e1-ab31-e03251226db1 service placement] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:32:52.715880 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c9174-8e42-49e1-ab31-e03251226db1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:32:52.718176 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-189c9174-8e42-49e1-ab31-e03251226db1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:32:52.729796 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189c9174-8e42-49e1-ab31-e03251226db1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:32:52.731415 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189c9174-8e42-49e1-ab31-e03251226db1 service placement] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:32:52.741983 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1142/2294] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:32:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:32:53.701684 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd67f073-063b-4cbf-ab82-2d4d29c70218 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:32:53.703724 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-dd67f073-063b-4cbf-ab82-2d4d29c70218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:32:53.720128 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd67f073-063b-4cbf-ab82-2d4d29c70218 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:32:53.725672 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09bb913-0358-497f-a822-9d5fec4434c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cd81f6620f410db450871fb29961f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:32:53.726274 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09bb913-0358-497f-a822-9d5fec4434c1 service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:32:53.726559 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09bb913-0358-497f-a822-9d5fec4434c1 service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:32:53.726833 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09bb913-0358-497f-a822-9d5fec4434c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:32:53.728746 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f09bb913-0358-497f-a822-9d5fec4434c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:32:53.739427 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09bb913-0358-497f-a822-9d5fec4434c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:32:53.741332 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09bb913-0358-497f-a822-9d5fec4434c1 service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:32:53.750133 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1153/2295] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:32:53 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:32:55.580617 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c9174-8e42-49e1-ab31-e03251226db1 service placement] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:32:55.594020 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c9174-8e42-49e1-ab31-e03251226db1 service placement] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:32:55.599629 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d333d2-e0bd-40d1-937a-e288577c6aea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cd81f6620f410db450871fb29961f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:32:55.600312 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d333d2-e0bd-40d1-937a-e288577c6aea service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:32:55.600600 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d333d2-e0bd-40d1-937a-e288577c6aea service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:32:55.600877 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d333d2-e0bd-40d1-937a-e288577c6aea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:32:55.603141 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-93d333d2-e0bd-40d1-937a-e288577c6aea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:32:55.689410 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d333d2-e0bd-40d1-937a-e288577c6aea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:32:55.691052 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d333d2-e0bd-40d1-937a-e288577c6aea service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:32:55.700843 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1143/2296] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:32:55 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:32:56.008568 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09bb913-0358-497f-a822-9d5fec4434c1 service nova] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:32:56.010098 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f09bb913-0358-497f-a822-9d5fec4434c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:32:56.025570 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09bb913-0358-497f-a822-9d5fec4434c1 service nova] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:32:56.030115 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4ef66-716a-45d6-8a84-31ddbdf2ba13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:32:56.031906 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4ef66-716a-45d6-8a84-31ddbdf2ba13 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:32:56.031906 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4ef66-716a-45d6-8a84-31ddbdf2ba13 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:32:56.031906 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4ef66-716a-45d6-8a84-31ddbdf2ba13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:32:56.034423 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-acd4ef66-716a-45d6-8a84-31ddbdf2ba13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:32:56.044510 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd4ef66-716a-45d6-8a84-31ddbdf2ba13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:32:56.046099 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd4ef66-716a-45d6-8a84-31ddbdf2ba13 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:32:56.054282 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1154/2297] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:32:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:32:56.888870 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d333d2-e0bd-40d1-937a-e288577c6aea service nova] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:32:56.891861 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-93d333d2-e0bd-40d1-937a-e288577c6aea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:32:56.908535 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d333d2-e0bd-40d1-937a-e288577c6aea service nova] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:32:56.918804 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9708af0-7035-454f-be29-2cb9d4e7e30c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cd81f6620f410db450871fb29961f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:32:56.918804 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9708af0-7035-454f-be29-2cb9d4e7e30c service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:32:56.918804 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9708af0-7035-454f-be29-2cb9d4e7e30c service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:32:56.918804 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9708af0-7035-454f-be29-2cb9d4e7e30c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:32:56.919205 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a9708af0-7035-454f-be29-2cb9d4e7e30c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:32:56.932067 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9708af0-7035-454f-be29-2cb9d4e7e30c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:32:56.933837 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9708af0-7035-454f-be29-2cb9d4e7e30c service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:32:56.945793 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1144/2298] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:32:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:32:57.829622 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4ef66-716a-45d6-8a84-31ddbdf2ba13 service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:32:57.842916 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4ef66-716a-45d6-8a84-31ddbdf2ba13 service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:32:57.848323 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e73bb9-7db6-48a3-b644-5fb72a9bd0c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cd81f6620f410db450871fb29961f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:32:57.848959 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e73bb9-7db6-48a3-b644-5fb72a9bd0c0 service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:32:57.849238 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e73bb9-7db6-48a3-b644-5fb72a9bd0c0 service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:32:57.849507 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e73bb9-7db6-48a3-b644-5fb72a9bd0c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:32:57.851268 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-99e73bb9-7db6-48a3-b644-5fb72a9bd0c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:32:57.861906 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e73bb9-7db6-48a3-b644-5fb72a9bd0c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:32:57.863453 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e73bb9-7db6-48a3-b644-5fb72a9bd0c0 service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:32:57.872291 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1155/2299] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:32:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:33:13.154751 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e1a4f-bf74-40c2-9232-806d13139e7f None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:33:13.155279 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e1a4f-bf74-40c2-9232-806d13139e7f None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:33:13.155279 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e1a4f-bf74-40c2-9232-806d13139e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:33:13.176570 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-bc3e1a4f-bf74-40c2-9232-806d13139e7f None None] MFA Rules not processed for user `f4435fb14c3844728531af63993f78c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:33:13.177801 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-bc3e1a4f-bf74-40c2-9232-806d13139e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:33:13.229387 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e73bb9-7db6-48a3-b644-5fb72a9bd0c0 service nova] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:33:13.237676 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1145/2300] 10.222.0.24 () {58 vars in 1009 bytes} [Thu Apr 7 06:33:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:33:13.240756 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e73bb9-7db6-48a3-b644-5fb72a9bd0c0 service nova] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:33:13.246615 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669eff02-be8e-481c-9a89-b46b0502b010 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cd81f6620f410db450871fb29961f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:33:13.247700 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669eff02-be8e-481c-9a89-b46b0502b010 service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:33:13.248319 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669eff02-be8e-481c-9a89-b46b0502b010 service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:33:13.248800 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669eff02-be8e-481c-9a89-b46b0502b010 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:33:13.254162 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-669eff02-be8e-481c-9a89-b46b0502b010 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:33:13.269270 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669eff02-be8e-481c-9a89-b46b0502b010 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:33:13.270968 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669eff02-be8e-481c-9a89-b46b0502b010 service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:33:13.282601 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1156/2301] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:33:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:33:13.397179 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e1a4f-bf74-40c2-9232-806d13139e7f None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:33:13.398589 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-bc3e1a4f-bf74-40c2-9232-806d13139e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:33:13.467016 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e1a4f-bf74-40c2-9232-806d13139e7f None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:33:13.472114 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eddd01-8cab-4488-90d4-b254d70733ce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4abbb8c5324b7babd69e3b4473b3e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:33:13.472763 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eddd01-8cab-4488-90d4-b254d70733ce service swift] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:33:13.473049 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eddd01-8cab-4488-90d4-b254d70733ce service swift] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:33:13.473322 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eddd01-8cab-4488-90d4-b254d70733ce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:33:13.481572 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eddd01-8cab-4488-90d4-b254d70733ce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:33:13.483179 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eddd01-8cab-4488-90d4-b254d70733ce service swift] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:33:13.491250 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1146/2302] 10.222.0.24 () {60 vars in 1384 bytes} [Thu Apr 7 06:33:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 07 06:33:31.068498 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669eff02-be8e-481c-9a89-b46b0502b010 service nova] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:33:31.079614 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669eff02-be8e-481c-9a89-b46b0502b010 service nova] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:33:31.086537 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f609f0b1-4e42-49bf-85da-ba4d3f8df877 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cd81f6620f410db450871fb29961f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:33:31.087534 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f609f0b1-4e42-49bf-85da-ba4d3f8df877 service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:33:31.087857 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f609f0b1-4e42-49bf-85da-ba4d3f8df877 service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:33:31.088289 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f609f0b1-4e42-49bf-85da-ba4d3f8df877 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:33:31.090271 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f609f0b1-4e42-49bf-85da-ba4d3f8df877 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:33:31.107316 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f609f0b1-4e42-49bf-85da-ba4d3f8df877 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:33:31.109281 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f609f0b1-4e42-49bf-85da-ba4d3f8df877 service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:33:31.121257 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1157/2303] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:33:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:33:35.478068 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8688b9-13a5-447f-9ec6-767344ad398a None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:33:35.478541 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8688b9-13a5-447f-9ec6-767344ad398a None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:33:35.478663 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8688b9-13a5-447f-9ec6-767344ad398a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:33:35.495850 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-1c8688b9-13a5-447f-9ec6-767344ad398a None None] MFA Rules not processed for user `f4435fb14c3844728531af63993f78c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:33:35.497028 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-1c8688b9-13a5-447f-9ec6-767344ad398a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:33:35.503960 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1147/2304] 10.222.0.24 () {58 vars in 1009 bytes} [Thu Apr 7 06:33:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:33:35.515680 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f609f0b1-4e42-49bf-85da-ba4d3f8df877 service nova] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:33:35.526462 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f609f0b1-4e42-49bf-85da-ba4d3f8df877 service nova] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:33:35.532069 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379373f1-9a2a-41da-bc96-3dea6f33f61c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4abbb8c5324b7babd69e3b4473b3e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:33:35.532704 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379373f1-9a2a-41da-bc96-3dea6f33f61c service swift] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:33:35.532990 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379373f1-9a2a-41da-bc96-3dea6f33f61c service swift] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:33:35.533267 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379373f1-9a2a-41da-bc96-3dea6f33f61c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:33:35.541067 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379373f1-9a2a-41da-bc96-3dea6f33f61c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:33:35.542642 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379373f1-9a2a-41da-bc96-3dea6f33f61c service swift] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:33:35.551076 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1158/2305] 10.222.0.24 () {60 vars in 1384 bytes} [Thu Apr 7 06:33:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 07 06:33:57.228601 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10d880-3b0f-4258-8b8f-038d0e530c66 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:33:57.229087 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10d880-3b0f-4258-8b8f-038d0e530c66 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:33:57.229190 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10d880-3b0f-4258-8b8f-038d0e530c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:33:57.246764 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-ad10d880-3b0f-4258-8b8f-038d0e530c66 None None] MFA Rules not processed for user `f4435fb14c3844728531af63993f78c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:33:57.251356 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-ad10d880-3b0f-4258-8b8f-038d0e530c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:33:57.255761 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1148/2306] 10.222.0.24 () {58 vars in 967 bytes} [Thu Apr 7 06:33:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:33:57.268924 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379373f1-9a2a-41da-bc96-3dea6f33f61c service swift] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:33:57.279109 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379373f1-9a2a-41da-bc96-3dea6f33f61c service swift] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:33:57.284173 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e2bc4-02d2-4db7-a998-02f7a141624a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4abbb8c5324b7babd69e3b4473b3e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:33:57.285206 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e2bc4-02d2-4db7-a998-02f7a141624a service swift] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:33:57.285206 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e2bc4-02d2-4db7-a998-02f7a141624a service swift] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:33:57.285421 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e2bc4-02d2-4db7-a998-02f7a141624a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:33:57.293358 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60e2bc4-02d2-4db7-a998-02f7a141624a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:33:57.294928 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60e2bc4-02d2-4db7-a998-02f7a141624a service swift] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:33:57.304934 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1159/2307] 10.222.0.24 () {60 vars in 1384 bytes} [Thu Apr 7 06:33:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 07 06:33:57.638064 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10d880-3b0f-4258-8b8f-038d0e530c66 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:33:57.647583 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10d880-3b0f-4258-8b8f-038d0e530c66 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:33:57.651320 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a32ccd-7f4f-4533-ac9a-6bde778d9d88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:33:57.652039 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a32ccd-7f4f-4533-ac9a-6bde778d9d88 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:33:57.652320 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a32ccd-7f4f-4533-ac9a-6bde778d9d88 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:33:57.652592 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a32ccd-7f4f-4533-ac9a-6bde778d9d88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:33:57.654978 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-36a32ccd-7f4f-4533-ac9a-6bde778d9d88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:33:57.717489 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a32ccd-7f4f-4533-ac9a-6bde778d9d88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:33:57.719063 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a32ccd-7f4f-4533-ac9a-6bde778d9d88 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:33:57.728989 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1149/2308] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:33:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:34:01.628779 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e2bc4-02d2-4db7-a998-02f7a141624a service swift] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:01.630213 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e60e2bc4-02d2-4db7-a998-02f7a141624a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:01.646354 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e2bc4-02d2-4db7-a998-02f7a141624a service swift] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:01.651619 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e83e0d-87ca-4e29-8edb-616958557973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:01.652536 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e83e0d-87ca-4e29-8edb-616958557973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:01.652818 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e83e0d-87ca-4e29-8edb-616958557973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:01.653105 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e83e0d-87ca-4e29-8edb-616958557973 admin admin] PATH_INFO: `/v3/users/0d928dfb5b354509a543229ea0836e82` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:01.654321 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e83e0d-87ca-4e29-8edb-616958557973 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d928dfb5b354509a543229ea0836e82)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:01.656296 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e83e0d-87ca-4e29-8edb-616958557973 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:01.827885 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-e2e83e0d-87ca-4e29-8edb-616958557973 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d928dfb5b354509a543229ea0836e82'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:01.838951 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-e2e83e0d-87ca-4e29-8edb-616958557973 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d928dfb5b354509a543229ea0836e82'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:01.934594 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-e2e83e0d-87ca-4e29-8edb-616958557973 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d928dfb5b354509a543229ea0836e82'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:01.935383 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-e2e83e0d-87ca-4e29-8edb-616958557973 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d928dfb5b354509a543229ea0836e82'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:01.936017 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-e2e83e0d-87ca-4e29-8edb-616958557973 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d928dfb5b354509a543229ea0836e82'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:01.949145 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1160/2309] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:34:01 2022] DELETE /identity/v3/users/0d928dfb5b354509a543229ea0836e82 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:34:02.199353 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a32ccd-7f4f-4533-ac9a-6bde778d9d88 service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:02.209946 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a32ccd-7f4f-4533-ac9a-6bde778d9d88 service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:02.273240 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae581ae-b6ad-4ad7-adc6-0203e5d5ec46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:02.274099 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae581ae-b6ad-4ad7-adc6-0203e5d5ec46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:02.274380 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae581ae-b6ad-4ad7-adc6-0203e5d5ec46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:02.274655 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae581ae-b6ad-4ad7-adc6-0203e5d5ec46 admin admin] PATH_INFO: `/v3/projects/7e40ad60e8e7486082b6638b218a786b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:02.275879 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae581ae-b6ad-4ad7-adc6-0203e5d5ec46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e40ad60e8e7486082b6638b218a786b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:02.277775 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae581ae-b6ad-4ad7-adc6-0203e5d5ec46 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:02.384268 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-2ae581ae-b6ad-4ad7-adc6-0203e5d5ec46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e40ad60e8e7486082b6638b218a786b', 'request_id': 'req-2ae581ae-b6ad-4ad7-adc6-0203e5d5ec46'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:02.390123 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-2ae581ae-b6ad-4ad7-adc6-0203e5d5ec46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e40ad60e8e7486082b6638b218a786b', 'request_id': 'req-2ae581ae-b6ad-4ad7-adc6-0203e5d5ec46'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:02.489332 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-2ae581ae-b6ad-4ad7-adc6-0203e5d5ec46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e40ad60e8e7486082b6638b218a786b', 'request_id': 'req-2ae581ae-b6ad-4ad7-adc6-0203e5d5ec46'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:02.505120 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-2ae581ae-b6ad-4ad7-adc6-0203e5d5ec46 admin admin] The token cache is being invalidate because project 7e40ad60e8e7486082b6638b218a786b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:34:02.505120 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-2ae581ae-b6ad-4ad7-adc6-0203e5d5ec46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:02.505120 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-2ae581ae-b6ad-4ad7-adc6-0203e5d5ec46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:02.507543 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1150/2310] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:34:02 2022] DELETE /identity/v3/projects/7e40ad60e8e7486082b6638b218a786b => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:34:02.511559 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd1131-0b09-4179-b2f2-dba810d289a5 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:02.511900 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd1131-0b09-4179-b2f2-dba810d289a5 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:02.512181 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd1131-0b09-4179-b2f2-dba810d289a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:02.530393 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-70bd1131-0b09-4179-b2f2-dba810d289a5 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:34:02.531575 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-70bd1131-0b09-4179-b2f2-dba810d289a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:02.588086 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1161/2311] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:34:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:34:02.596662 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82338b99-c5d7-4f7b-9b6f-c7db04bab5a1 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:02.596957 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82338b99-c5d7-4f7b-9b6f-c7db04bab5a1 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:02.597239 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82338b99-c5d7-4f7b-9b6f-c7db04bab5a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:02.615985 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-82338b99-c5d7-4f7b-9b6f-c7db04bab5a1 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:34:02.617180 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-82338b99-c5d7-4f7b-9b6f-c7db04bab5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:02.625240 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1151/2312] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:34:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:34:02.629463 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd1131-0b09-4179-b2f2-dba810d289a5 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:02.639665 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd1131-0b09-4179-b2f2-dba810d289a5 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:02.644369 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f058759-940a-4960-a326-95b8b165acf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:02.645025 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f058759-940a-4960-a326-95b8b165acf2 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:02.645345 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f058759-940a-4960-a326-95b8b165acf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:02.645618 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f058759-940a-4960-a326-95b8b165acf2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:02.646343 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f058759-940a-4960-a326-95b8b165acf2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:34:02.646649 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f058759-940a-4960-a326-95b8b165acf2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:02.648334 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f058759-940a-4960-a326-95b8b165acf2 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:02.660267 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1162/2313] 10.222.0.24 () {58 vars in 1152 bytes} [Thu Apr 7 06:34:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:34:02.664461 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82338b99-c5d7-4f7b-9b6f-c7db04bab5a1 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:02.673834 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82338b99-c5d7-4f7b-9b6f-c7db04bab5a1 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:02.678680 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68c958b-cf17-4cce-8cec-72ba972ce22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:02.679357 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c958b-cf17-4cce-8cec-72ba972ce22c admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:02.679644 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c958b-cf17-4cce-8cec-72ba972ce22c admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:02.679948 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c958b-cf17-4cce-8cec-72ba972ce22c admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:02.680648 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68c958b-cf17-4cce-8cec-72ba972ce22c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:02.682604 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68c958b-cf17-4cce-8cec-72ba972ce22c admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:02.782436 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1152/2314] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:34:02 2022] POST /identity/v3/projects => generated 387 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:34:02.786695 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f058759-940a-4960-a326-95b8b165acf2 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:02.796772 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f058759-940a-4960-a326-95b8b165acf2 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:02.851073 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59195009-f5e2-40fd-9a7c-681042ad39b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:02.851734 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59195009-f5e2-40fd-9a7c-681042ad39b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:02.852046 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59195009-f5e2-40fd-9a7c-681042ad39b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:02.852322 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59195009-f5e2-40fd-9a7c-681042ad39b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:02.853079 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59195009-f5e2-40fd-9a7c-681042ad39b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:02.854979 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59195009-f5e2-40fd-9a7c-681042ad39b5 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:02.917427 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1163/2315] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:34:02 2022] POST /identity/v3/users => generated 294 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:34:02.921619 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68c958b-cf17-4cce-8cec-72ba972ce22c admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:02.931637 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68c958b-cf17-4cce-8cec-72ba972ce22c admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:02.936275 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a61f44-f444-44c8-b2ac-3cda188ff77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:02.936950 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a61f44-f444-44c8-b2ac-3cda188ff77e admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:02.937234 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a61f44-f444-44c8-b2ac-3cda188ff77e admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:02.937507 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a61f44-f444-44c8-b2ac-3cda188ff77e admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:02.938232 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a61f44-f444-44c8-b2ac-3cda188ff77e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:02.939903 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a61f44-f444-44c8-b2ac-3cda188ff77e admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:02.949597 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1153/2316] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:34:02 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:34:02.953985 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59195009-f5e2-40fd-9a7c-681042ad39b5 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:02.964052 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59195009-f5e2-40fd-9a7c-681042ad39b5 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:02.969938 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5c8a8-eaa3-4461-af75-5044598b6b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:02.970621 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5c8a8-eaa3-4461-af75-5044598b6b09 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:02.970901 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5c8a8-eaa3-4461-af75-5044598b6b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:02.971174 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5c8a8-eaa3-4461-af75-5044598b6b09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:02.971932 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f5c8a8-eaa3-4461-af75-5044598b6b09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:02.973587 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f5c8a8-eaa3-4461-af75-5044598b6b09 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:02.983699 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1164/2317] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:34:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:34:02.987896 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a61f44-f444-44c8-b2ac-3cda188ff77e admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:02.998564 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a61f44-f444-44c8-b2ac-3cda188ff77e admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:03.003163 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328417d-a424-4a7b-9960-43d89869a7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:03.004068 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328417d-a424-4a7b-9960-43d89869a7c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:03.004349 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328417d-a424-4a7b-9960-43d89869a7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:03.004623 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328417d-a424-4a7b-9960-43d89869a7c1 admin admin] PATH_INFO: `/v3/projects/6a1a8e01c71c4566966d8fac4381f8e9/users/b272f3574dd242979692e53b3e946e52/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:03.019556 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e328417d-a424-4a7b-9960-43d89869a7c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a1a8e01c71c4566966d8fac4381f8e9, user_id=b272f3574dd242979692e53b3e946e52, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:03.022297 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e328417d-a424-4a7b-9960-43d89869a7c1 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:03.106205 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1154/2318] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:34:02 2022] PUT /identity/v3/projects/6a1a8e01c71c4566966d8fac4381f8e9/users/b272f3574dd242979692e53b3e946e52/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:34:03.117472 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3857d-57ca-45f4-ba5a-d516a01e0078 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:03.117472 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3857d-57ca-45f4-ba5a-d516a01e0078 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:03.117689 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3857d-57ca-45f4-ba5a-d516a01e0078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:03.144449 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-37e3857d-57ca-45f4-ba5a-d516a01e0078 None None] MFA Rules not processed for user `b272f3574dd242979692e53b3e946e52`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:34:03.145786 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-37e3857d-57ca-45f4-ba5a-d516a01e0078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:03.236465 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1165/2319] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:34:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:34:03.240258 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328417d-a424-4a7b-9960-43d89869a7c1 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:03.303184 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328417d-a424-4a7b-9960-43d89869a7c1 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:03.308133 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2956b26-af41-46fd-a881-0d88df24dd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:03.308794 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2956b26-af41-46fd-a881-0d88df24dd82 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:03.309085 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2956b26-af41-46fd-a881-0d88df24dd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:03.309367 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2956b26-af41-46fd-a881-0d88df24dd82 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:03.310100 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2956b26-af41-46fd-a881-0d88df24dd82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:03.312568 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2956b26-af41-46fd-a881-0d88df24dd82 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:03.444836 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1155/2320] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:34:03 2022] POST /identity/v3/projects => generated 387 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:34:03.448884 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e3857d-57ca-45f4-ba5a-d516a01e0078 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:03.459363 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e3857d-57ca-45f4-ba5a-d516a01e0078 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:03.514304 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec91f7-8ca0-4cca-bc79-0104b010922b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:03.515005 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec91f7-8ca0-4cca-bc79-0104b010922b admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:03.515290 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec91f7-8ca0-4cca-bc79-0104b010922b admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:03.515567 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec91f7-8ca0-4cca-bc79-0104b010922b admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:03.516317 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aec91f7-8ca0-4cca-bc79-0104b010922b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:03.518217 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aec91f7-8ca0-4cca-bc79-0104b010922b admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:03.592276 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1166/2321] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:34:03 2022] POST /identity/v3/users => generated 294 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:34:03.596477 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2956b26-af41-46fd-a881-0d88df24dd82 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:03.606638 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2956b26-af41-46fd-a881-0d88df24dd82 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:03.611358 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ddbba4-0b92-4290-b45d-210ac32b91f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:03.612045 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ddbba4-0b92-4290-b45d-210ac32b91f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:03.612337 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ddbba4-0b92-4290-b45d-210ac32b91f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:03.612618 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ddbba4-0b92-4290-b45d-210ac32b91f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:03.613354 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ddbba4-0b92-4290-b45d-210ac32b91f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:03.615226 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ddbba4-0b92-4290-b45d-210ac32b91f7 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:03.625678 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1156/2322] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:34:03.629727 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec91f7-8ca0-4cca-bc79-0104b010922b admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:03.640060 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec91f7-8ca0-4cca-bc79-0104b010922b admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:03.644643 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9386ea4-3a14-4a56-8d1a-748ec24c1759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:03.645289 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9386ea4-3a14-4a56-8d1a-748ec24c1759 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:03.645576 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9386ea4-3a14-4a56-8d1a-748ec24c1759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:03.645849 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9386ea4-3a14-4a56-8d1a-748ec24c1759 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:03.646573 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9386ea4-3a14-4a56-8d1a-748ec24c1759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:03.648215 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9386ea4-3a14-4a56-8d1a-748ec24c1759 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:03.658445 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1167/2323] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:34:03.662408 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ddbba4-0b92-4290-b45d-210ac32b91f7 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:03.672350 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ddbba4-0b92-4290-b45d-210ac32b91f7 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:03.677210 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410de253-6ccd-409a-93dd-23b3535cbedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:03.678084 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410de253-6ccd-409a-93dd-23b3535cbedd admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:03.678372 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410de253-6ccd-409a-93dd-23b3535cbedd admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:03.678650 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410de253-6ccd-409a-93dd-23b3535cbedd admin admin] PATH_INFO: `/v3/projects/74fa8f1187bd493fb0e28b4923eb44eb/users/11ece0f3021d4ed7ba0949db9209a3ba/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:03.692853 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410de253-6ccd-409a-93dd-23b3535cbedd admin admin] RBAC: Authorizing `identity:create_grant(project_id=74fa8f1187bd493fb0e28b4923eb44eb, user_id=11ece0f3021d4ed7ba0949db9209a3ba, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:03.695494 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410de253-6ccd-409a-93dd-23b3535cbedd admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:03.782830 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1157/2324] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:34:03 2022] PUT /identity/v3/projects/74fa8f1187bd493fb0e28b4923eb44eb/users/11ece0f3021d4ed7ba0949db9209a3ba/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:34:03.792988 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a0027-289c-431b-a56f-190dfa8f5ed6 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:03.793304 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a0027-289c-431b-a56f-190dfa8f5ed6 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:03.793633 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a0027-289c-431b-a56f-190dfa8f5ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:03.820419 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-9c7a0027-289c-431b-a56f-190dfa8f5ed6 None None] MFA Rules not processed for user `11ece0f3021d4ed7ba0949db9209a3ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:34:03.821642 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-9c7a0027-289c-431b-a56f-190dfa8f5ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:03.887336 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1168/2325] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:34:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:34:03.892192 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410de253-6ccd-409a-93dd-23b3535cbedd admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:03.951682 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410de253-6ccd-409a-93dd-23b3535cbedd admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:03.956415 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f517819f-bba0-4ebd-9700-ac3580abfb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:03.957076 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f517819f-bba0-4ebd-9700-ac3580abfb59 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:03.961353 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f517819f-bba0-4ebd-9700-ac3580abfb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:03.961353 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f517819f-bba0-4ebd-9700-ac3580abfb59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:03.961353 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f517819f-bba0-4ebd-9700-ac3580abfb59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:03.961353 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f517819f-bba0-4ebd-9700-ac3580abfb59 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:04.090537 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1158/2326] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:34:03 2022] POST /identity/v3/projects => generated 387 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:34:04.094623 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7a0027-289c-431b-a56f-190dfa8f5ed6 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:04.105045 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7a0027-289c-431b-a56f-190dfa8f5ed6 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:04.160171 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9486af-0385-473a-9543-9dbeb171cf6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:04.160830 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9486af-0385-473a-9543-9dbeb171cf6a admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:04.161111 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9486af-0385-473a-9543-9dbeb171cf6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:04.161405 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9486af-0385-473a-9543-9dbeb171cf6a admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:04.162089 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9486af-0385-473a-9543-9dbeb171cf6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:04.164017 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9486af-0385-473a-9543-9dbeb171cf6a admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:04.249356 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1169/2327] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:34:04 2022] POST /identity/v3/users => generated 300 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:34:04.253501 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f517819f-bba0-4ebd-9700-ac3580abfb59 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:04.263828 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f517819f-bba0-4ebd-9700-ac3580abfb59 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:04.268462 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b0367-8943-4c2c-83c2-bf205fed24b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:04.269115 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b0367-8943-4c2c-83c2-bf205fed24b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:04.269398 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b0367-8943-4c2c-83c2-bf205fed24b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:04.269675 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b0367-8943-4c2c-83c2-bf205fed24b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:04.270452 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741b0367-8943-4c2c-83c2-bf205fed24b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:04.272102 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741b0367-8943-4c2c-83c2-bf205fed24b0 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:04.284088 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1159/2328] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:34:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:34:04.288342 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9486af-0385-473a-9543-9dbeb171cf6a admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:04.299079 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9486af-0385-473a-9543-9dbeb171cf6a admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:04.304889 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc92b2-82d4-4bd9-9a67-345e8899039f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:04.304889 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc92b2-82d4-4bd9-9a67-345e8899039f admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:04.305255 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc92b2-82d4-4bd9-9a67-345e8899039f admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:04.305443 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc92b2-82d4-4bd9-9a67-345e8899039f admin admin] PATH_INFO: `/v3/projects/26e1364c5c4c470785b9d2de78fd2086/users/eecc17895c7a46fd835e267342919e50/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:04.321408 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cc92b2-82d4-4bd9-9a67-345e8899039f admin admin] RBAC: Authorizing `identity:create_grant(project_id=26e1364c5c4c470785b9d2de78fd2086, user_id=eecc17895c7a46fd835e267342919e50, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:04.324231 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cc92b2-82d4-4bd9-9a67-345e8899039f admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:04.460373 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1170/2329] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:34:04 2022] PUT /identity/v3/projects/26e1364c5c4c470785b9d2de78fd2086/users/eecc17895c7a46fd835e267342919e50/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:34:04.464269 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b0367-8943-4c2c-83c2-bf205fed24b0 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:04.474795 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b0367-8943-4c2c-83c2-bf205fed24b0 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:04.528988 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62702ad8-3e47-4537-8cbb-069522dce69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:04.529665 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62702ad8-3e47-4537-8cbb-069522dce69e admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:04.529955 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62702ad8-3e47-4537-8cbb-069522dce69e admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:04.530260 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62702ad8-3e47-4537-8cbb-069522dce69e admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:04.530994 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62702ad8-3e47-4537-8cbb-069522dce69e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:04.532627 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62702ad8-3e47-4537-8cbb-069522dce69e admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:04.542312 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1160/2330] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:34:04 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:34:04.546490 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc92b2-82d4-4bd9-9a67-345e8899039f admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:04.556514 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc92b2-82d4-4bd9-9a67-345e8899039f admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:04.561606 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db310a-c5d6-4ee2-8301-5068aea1735c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:04.562476 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db310a-c5d6-4ee2-8301-5068aea1735c admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:04.562762 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db310a-c5d6-4ee2-8301-5068aea1735c admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:04.563039 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db310a-c5d6-4ee2-8301-5068aea1735c admin admin] PATH_INFO: `/v3/projects/26e1364c5c4c470785b9d2de78fd2086/users/eecc17895c7a46fd835e267342919e50/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:04.565021 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db310a-c5d6-4ee2-8301-5068aea1735c admin admin] RBAC: Authorizing `identity:create_grant(project_id=26e1364c5c4c470785b9d2de78fd2086, user_id=eecc17895c7a46fd835e267342919e50, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:04.567642 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db310a-c5d6-4ee2-8301-5068aea1735c admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:04.578028 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1171/2331] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:34:04 2022] PUT /identity/v3/projects/26e1364c5c4c470785b9d2de78fd2086/users/eecc17895c7a46fd835e267342919e50/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:34:04.587663 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cfab3f-9cba-4564-882b-3febc365c1b6 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:04.587998 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cfab3f-9cba-4564-882b-3febc365c1b6 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:04.588281 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cfab3f-9cba-4564-882b-3febc365c1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:04.614325 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-17cfab3f-9cba-4564-882b-3febc365c1b6 None None] MFA Rules not processed for user `eecc17895c7a46fd835e267342919e50`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:34:04.615828 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-17cfab3f-9cba-4564-882b-3febc365c1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:04.679319 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1161/2332] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:34:04 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:34:04.689838 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db310a-c5d6-4ee2-8301-5068aea1735c admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:04.691502 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-70db310a-c5d6-4ee2-8301-5068aea1735c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:04.745794 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db310a-c5d6-4ee2-8301-5068aea1735c admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:04.749260 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea3490-21dc-4bf9-9a09-46a5c1b251ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:04.749893 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea3490-21dc-4bf9-9a09-46a5c1b251ca service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:04.750521 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea3490-21dc-4bf9-9a09-46a5c1b251ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:04.750796 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea3490-21dc-4bf9-9a09-46a5c1b251ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:04.759425 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ea3490-21dc-4bf9-9a09-46a5c1b251ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:04.760874 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ea3490-21dc-4bf9-9a09-46a5c1b251ca service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:04.770274 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1172/2333] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:34:04 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:34:05.934831 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cfab3f-9cba-4564-882b-3febc365c1b6 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:05.936903 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-17cfab3f-9cba-4564-882b-3febc365c1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:05.948610 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cfab3f-9cba-4564-882b-3febc365c1b6 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:05.952247 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b71b1c-0e3a-4500-a666-0ce9b57a2cc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:05.952922 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b71b1c-0e3a-4500-a666-0ce9b57a2cc6 service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:05.953207 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b71b1c-0e3a-4500-a666-0ce9b57a2cc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:05.953482 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b71b1c-0e3a-4500-a666-0ce9b57a2cc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:06.009369 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b71b1c-0e3a-4500-a666-0ce9b57a2cc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:06.010735 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b71b1c-0e3a-4500-a666-0ce9b57a2cc6 service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:06.019700 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1162/2334] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:34:05 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:34:10.891693 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea3490-21dc-4bf9-9a09-46a5c1b251ca service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:10.900146 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea3490-21dc-4bf9-9a09-46a5c1b251ca service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:10.903622 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ed00a-90f4-4c18-a3b9-c3f4583a4f1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:10.904964 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ed00a-90f4-4c18-a3b9-c3f4583a4f1c service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:10.905247 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ed00a-90f4-4c18-a3b9-c3f4583a4f1c service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:10.905520 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ed00a-90f4-4c18-a3b9-c3f4583a4f1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:10.958219 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019ed00a-90f4-4c18-a3b9-c3f4583a4f1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:10.959624 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019ed00a-90f4-4c18-a3b9-c3f4583a4f1c service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:10.968730 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1173/2335] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:34:10 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:34:15.154640 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b71b1c-0e3a-4500-a666-0ce9b57a2cc6 service cinder] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:15.213872 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b71b1c-0e3a-4500-a666-0ce9b57a2cc6 service cinder] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:15.219133 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0fc61b-f488-4bbd-9654-94c788adc57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:15.220035 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0fc61b-f488-4bbd-9654-94c788adc57f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:15.220319 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0fc61b-f488-4bbd-9654-94c788adc57f admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:15.220595 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0fc61b-f488-4bbd-9654-94c788adc57f admin admin] PATH_INFO: `/v3/users/b272f3574dd242979692e53b3e946e52` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:15.221806 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0fc61b-f488-4bbd-9654-94c788adc57f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b272f3574dd242979692e53b3e946e52)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:15.223785 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0fc61b-f488-4bbd-9654-94c788adc57f admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:15.410547 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-2b0fc61b-f488-4bbd-9654-94c788adc57f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b272f3574dd242979692e53b3e946e52'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:15.411169 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-2b0fc61b-f488-4bbd-9654-94c788adc57f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b272f3574dd242979692e53b3e946e52'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:15.495436 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-2b0fc61b-f488-4bbd-9654-94c788adc57f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b272f3574dd242979692e53b3e946e52'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:15.496240 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-2b0fc61b-f488-4bbd-9654-94c788adc57f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b272f3574dd242979692e53b3e946e52'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:15.512251 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-2b0fc61b-f488-4bbd-9654-94c788adc57f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b272f3574dd242979692e53b3e946e52'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:15.531417 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1163/2336] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:34:15 2022] DELETE /identity/v3/users/b272f3574dd242979692e53b3e946e52 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:34:15.532813 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b77b32-f142-42a3-8929-367d73a19bec None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:15.536940 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b77b32-f142-42a3-8929-367d73a19bec None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:15.536940 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b77b32-f142-42a3-8929-367d73a19bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:15.555941 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-27b77b32-f142-42a3-8929-367d73a19bec None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:34:15.557159 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-27b77b32-f142-42a3-8929-367d73a19bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:15.616956 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1174/2337] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:34:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:34:15.626904 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0fc61b-f488-4bbd-9654-94c788adc57f admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:15.628346 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-2b0fc61b-f488-4bbd-9654-94c788adc57f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:15.689343 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0fc61b-f488-4bbd-9654-94c788adc57f admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:15.692934 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac45c000-6f29-45b6-957e-4095bc7288dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:15.693577 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45c000-6f29-45b6-957e-4095bc7288dc service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:15.693859 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45c000-6f29-45b6-957e-4095bc7288dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:15.694129 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45c000-6f29-45b6-957e-4095bc7288dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:15.703310 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac45c000-6f29-45b6-957e-4095bc7288dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:15.704933 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac45c000-6f29-45b6-957e-4095bc7288dc service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:15.714189 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1164/2338] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:34:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:34:16.113702 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b77b32-f142-42a3-8929-367d73a19bec None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:16.115038 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-27b77b32-f142-42a3-8929-367d73a19bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:16.133527 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b77b32-f142-42a3-8929-367d73a19bec None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:16.139440 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdb67a2-8aa8-4ca4-a34d-9a53d75d5243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:16.140592 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb67a2-8aa8-4ca4-a34d-9a53d75d5243 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:16.140879 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb67a2-8aa8-4ca4-a34d-9a53d75d5243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:16.141158 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb67a2-8aa8-4ca4-a34d-9a53d75d5243 admin admin] PATH_INFO: `/v3/projects/6a1a8e01c71c4566966d8fac4381f8e9` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:16.142833 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdb67a2-8aa8-4ca4-a34d-9a53d75d5243 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a1a8e01c71c4566966d8fac4381f8e9)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:16.144782 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdb67a2-8aa8-4ca4-a34d-9a53d75d5243 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:16.295008 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-bbdb67a2-8aa8-4ca4-a34d-9a53d75d5243 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a1a8e01c71c4566966d8fac4381f8e9', 'request_id': 'req-bbdb67a2-8aa8-4ca4-a34d-9a53d75d5243'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:16.301241 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-bbdb67a2-8aa8-4ca4-a34d-9a53d75d5243 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a1a8e01c71c4566966d8fac4381f8e9', 'request_id': 'req-bbdb67a2-8aa8-4ca4-a34d-9a53d75d5243'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:16.374561 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-bbdb67a2-8aa8-4ca4-a34d-9a53d75d5243 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a1a8e01c71c4566966d8fac4381f8e9', 'request_id': 'req-bbdb67a2-8aa8-4ca4-a34d-9a53d75d5243'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:16.385504 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-bbdb67a2-8aa8-4ca4-a34d-9a53d75d5243 admin admin] The token cache is being invalidate because project 6a1a8e01c71c4566966d8fac4381f8e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:34:16.386157 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-bbdb67a2-8aa8-4ca4-a34d-9a53d75d5243 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:16.386465 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-bbdb67a2-8aa8-4ca4-a34d-9a53d75d5243 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:16.388053 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1175/2339] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:34:16 2022] DELETE /identity/v3/projects/6a1a8e01c71c4566966d8fac4381f8e9 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:34:16.392241 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac45c000-6f29-45b6-957e-4095bc7288dc service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:16.402029 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac45c000-6f29-45b6-957e-4095bc7288dc service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:16.458185 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7fb0f2-572f-48cc-9079-ef56189bc569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:16.459246 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7fb0f2-572f-48cc-9079-ef56189bc569 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:16.459355 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7fb0f2-572f-48cc-9079-ef56189bc569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:16.459600 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7fb0f2-572f-48cc-9079-ef56189bc569 admin admin] PATH_INFO: `/v3/users/11ece0f3021d4ed7ba0949db9209a3ba` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:16.460851 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7fb0f2-572f-48cc-9079-ef56189bc569 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11ece0f3021d4ed7ba0949db9209a3ba)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:16.462825 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7fb0f2-572f-48cc-9079-ef56189bc569 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:16.670142 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-6a7fb0f2-572f-48cc-9079-ef56189bc569 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11ece0f3021d4ed7ba0949db9209a3ba'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:16.670787 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-6a7fb0f2-572f-48cc-9079-ef56189bc569 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11ece0f3021d4ed7ba0949db9209a3ba'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:16.745898 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-6a7fb0f2-572f-48cc-9079-ef56189bc569 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11ece0f3021d4ed7ba0949db9209a3ba'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:16.746508 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-6a7fb0f2-572f-48cc-9079-ef56189bc569 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11ece0f3021d4ed7ba0949db9209a3ba'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:16.758450 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-6a7fb0f2-572f-48cc-9079-ef56189bc569 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11ece0f3021d4ed7ba0949db9209a3ba'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:16.770623 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1165/2340] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:34:16 2022] DELETE /identity/v3/users/11ece0f3021d4ed7ba0949db9209a3ba => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:34:17.436333 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdb67a2-8aa8-4ca4-a34d-9a53d75d5243 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:17.436333 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-bbdb67a2-8aa8-4ca4-a34d-9a53d75d5243 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:17.447627 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdb67a2-8aa8-4ca4-a34d-9a53d75d5243 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:17.507298 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b301a3c-1237-48d9-af2f-7314fb532e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:17.508271 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b301a3c-1237-48d9-af2f-7314fb532e3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:17.508563 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b301a3c-1237-48d9-af2f-7314fb532e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:17.508869 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b301a3c-1237-48d9-af2f-7314fb532e3c admin admin] PATH_INFO: `/v3/projects/74fa8f1187bd493fb0e28b4923eb44eb` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:17.510058 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b301a3c-1237-48d9-af2f-7314fb532e3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=74fa8f1187bd493fb0e28b4923eb44eb)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:17.511982 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b301a3c-1237-48d9-af2f-7314fb532e3c admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:17.668615 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2b301a3c-1237-48d9-af2f-7314fb532e3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74fa8f1187bd493fb0e28b4923eb44eb', 'request_id': 'req-2b301a3c-1237-48d9-af2f-7314fb532e3c'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:17.675558 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2b301a3c-1237-48d9-af2f-7314fb532e3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74fa8f1187bd493fb0e28b4923eb44eb', 'request_id': 'req-2b301a3c-1237-48d9-af2f-7314fb532e3c'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:17.757245 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2b301a3c-1237-48d9-af2f-7314fb532e3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74fa8f1187bd493fb0e28b4923eb44eb', 'request_id': 'req-2b301a3c-1237-48d9-af2f-7314fb532e3c'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:17.770289 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2b301a3c-1237-48d9-af2f-7314fb532e3c admin admin] The token cache is being invalidate because project 74fa8f1187bd493fb0e28b4923eb44eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:34:17.773056 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2b301a3c-1237-48d9-af2f-7314fb532e3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:17.773580 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2b301a3c-1237-48d9-af2f-7314fb532e3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:17.775475 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1176/2341] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:34:17 2022] DELETE /identity/v3/projects/74fa8f1187bd493fb0e28b4923eb44eb => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:34:17.780042 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7fb0f2-572f-48cc-9079-ef56189bc569 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:17.781423 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-6a7fb0f2-572f-48cc-9079-ef56189bc569 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:17.793672 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7fb0f2-572f-48cc-9079-ef56189bc569 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:17.847172 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64812cc7-1c2d-4d0d-b881-527f1278c9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:17.848021 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64812cc7-1c2d-4d0d-b881-527f1278c9bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:17.848303 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64812cc7-1c2d-4d0d-b881-527f1278c9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:17.848573 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64812cc7-1c2d-4d0d-b881-527f1278c9bb admin admin] PATH_INFO: `/v3/users/eecc17895c7a46fd835e267342919e50` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:17.849737 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64812cc7-1c2d-4d0d-b881-527f1278c9bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=eecc17895c7a46fd835e267342919e50)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:17.851639 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64812cc7-1c2d-4d0d-b881-527f1278c9bb admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:18.114246 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-64812cc7-1c2d-4d0d-b881-527f1278c9bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eecc17895c7a46fd835e267342919e50'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:18.115106 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-64812cc7-1c2d-4d0d-b881-527f1278c9bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eecc17895c7a46fd835e267342919e50'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:18.204053 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-64812cc7-1c2d-4d0d-b881-527f1278c9bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eecc17895c7a46fd835e267342919e50'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:18.204744 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-64812cc7-1c2d-4d0d-b881-527f1278c9bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eecc17895c7a46fd835e267342919e50'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:18.217748 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-64812cc7-1c2d-4d0d-b881-527f1278c9bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eecc17895c7a46fd835e267342919e50'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:18.229891 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1166/2342] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:34:17 2022] DELETE /identity/v3/users/eecc17895c7a46fd835e267342919e50 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:34:18.638862 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b301a3c-1237-48d9-af2f-7314fb532e3c admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:18.640348 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-2b301a3c-1237-48d9-af2f-7314fb532e3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:18.653460 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b301a3c-1237-48d9-af2f-7314fb532e3c admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:18.709135 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d3d29-5e13-42b1-ae5b-4e9c6cd7b35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:18.710011 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d3d29-5e13-42b1-ae5b-4e9c6cd7b35e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:18.710297 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d3d29-5e13-42b1-ae5b-4e9c6cd7b35e admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:18.710577 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d3d29-5e13-42b1-ae5b-4e9c6cd7b35e admin admin] PATH_INFO: `/v3/projects/26e1364c5c4c470785b9d2de78fd2086` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:18.711778 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d3d29-5e13-42b1-ae5b-4e9c6cd7b35e admin admin] RBAC: Authorizing `identity:delete_project(project_id=26e1364c5c4c470785b9d2de78fd2086)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:18.713666 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d3d29-5e13-42b1-ae5b-4e9c6cd7b35e admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:18.830756 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-9e9d3d29-5e13-42b1-ae5b-4e9c6cd7b35e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26e1364c5c4c470785b9d2de78fd2086', 'request_id': 'req-9e9d3d29-5e13-42b1-ae5b-4e9c6cd7b35e'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:18.836795 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-9e9d3d29-5e13-42b1-ae5b-4e9c6cd7b35e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26e1364c5c4c470785b9d2de78fd2086', 'request_id': 'req-9e9d3d29-5e13-42b1-ae5b-4e9c6cd7b35e'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:18.910878 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-9e9d3d29-5e13-42b1-ae5b-4e9c6cd7b35e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26e1364c5c4c470785b9d2de78fd2086', 'request_id': 'req-9e9d3d29-5e13-42b1-ae5b-4e9c6cd7b35e'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:18.921559 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-9e9d3d29-5e13-42b1-ae5b-4e9c6cd7b35e admin admin] The token cache is being invalidate because project 26e1364c5c4c470785b9d2de78fd2086 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:34:18.926787 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-9e9d3d29-5e13-42b1-ae5b-4e9c6cd7b35e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:18.926787 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-9e9d3d29-5e13-42b1-ae5b-4e9c6cd7b35e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:18.926787 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1177/2343] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:34:18 2022] DELETE /identity/v3/projects/26e1364c5c4c470785b9d2de78fd2086 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:34:18.930160 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303676b-57bc-4de9-a71a-d70f5fe3f7b7 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:18.930633 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303676b-57bc-4de9-a71a-d70f5fe3f7b7 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:18.930746 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303676b-57bc-4de9-a71a-d70f5fe3f7b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:18.948520 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-0303676b-57bc-4de9-a71a-d70f5fe3f7b7 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:34:18.949764 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-0303676b-57bc-4de9-a71a-d70f5fe3f7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:19.006825 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1167/2344] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:34:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:34:19.016356 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65bd20b-1a38-4304-9081-7dda16aa34f9 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:19.016653 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65bd20b-1a38-4304-9081-7dda16aa34f9 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:19.016936 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65bd20b-1a38-4304-9081-7dda16aa34f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:19.035534 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-f65bd20b-1a38-4304-9081-7dda16aa34f9 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:34:19.036862 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f65bd20b-1a38-4304-9081-7dda16aa34f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:19.045497 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1178/2345] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:34:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:34:19.049735 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0303676b-57bc-4de9-a71a-d70f5fe3f7b7 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:19.059018 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0303676b-57bc-4de9-a71a-d70f5fe3f7b7 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:19.063541 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb2da6-dfce-4dd2-aabe-acff774c7e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:19.064227 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb2da6-dfce-4dd2-aabe-acff774c7e88 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:19.064513 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb2da6-dfce-4dd2-aabe-acff774c7e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:19.064786 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb2da6-dfce-4dd2-aabe-acff774c7e88 admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:19.065506 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb2da6-dfce-4dd2-aabe-acff774c7e88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:34:19.065814 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb2da6-dfce-4dd2-aabe-acff774c7e88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:19.067458 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb2da6-dfce-4dd2-aabe-acff774c7e88 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:19.078955 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1168/2346] 10.222.0.24 () {58 vars in 1152 bytes} [Thu Apr 7 06:34:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:34:19.083138 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65bd20b-1a38-4304-9081-7dda16aa34f9 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:19.092676 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65bd20b-1a38-4304-9081-7dda16aa34f9 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:19.097309 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52235926-0be7-421a-8773-a3ee71576e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:19.097959 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52235926-0be7-421a-8773-a3ee71576e8d admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:19.098247 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52235926-0be7-421a-8773-a3ee71576e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:19.098527 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52235926-0be7-421a-8773-a3ee71576e8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:19.099211 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52235926-0be7-421a-8773-a3ee71576e8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:19.101128 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52235926-0be7-421a-8773-a3ee71576e8d admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:19.192253 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1179/2347] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:34:19 2022] POST /identity/v3/projects => generated 393 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:34:19.196278 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb2da6-dfce-4dd2-aabe-acff774c7e88 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:19.206741 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb2da6-dfce-4dd2-aabe-acff774c7e88 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:19.259725 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e89fd50-8527-493f-922e-455a334b76cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:19.260416 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89fd50-8527-493f-922e-455a334b76cb admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:19.260704 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89fd50-8527-493f-922e-455a334b76cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:19.260979 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89fd50-8527-493f-922e-455a334b76cb admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:19.261702 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e89fd50-8527-493f-922e-455a334b76cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:19.264161 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e89fd50-8527-493f-922e-455a334b76cb admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:19.347673 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1169/2348] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:34:19 2022] POST /identity/v3/users => generated 297 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:34:19.351197 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52235926-0be7-421a-8773-a3ee71576e8d admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:19.362394 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52235926-0be7-421a-8773-a3ee71576e8d admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:19.367534 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215d1f95-9389-4e65-8815-fa7473beaa1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:19.368233 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d1f95-9389-4e65-8815-fa7473beaa1c admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:19.372870 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d1f95-9389-4e65-8815-fa7473beaa1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:19.372870 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d1f95-9389-4e65-8815-fa7473beaa1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:19.372870 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215d1f95-9389-4e65-8815-fa7473beaa1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:19.372870 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215d1f95-9389-4e65-8815-fa7473beaa1c admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:19.381974 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1180/2349] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:34:19.386057 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e89fd50-8527-493f-922e-455a334b76cb admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:19.396653 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e89fd50-8527-493f-922e-455a334b76cb admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:19.401240 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecf764c-539c-42a6-a113-31c566d81abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:19.401899 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf764c-539c-42a6-a113-31c566d81abc admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:19.402179 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf764c-539c-42a6-a113-31c566d81abc admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:19.402456 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf764c-539c-42a6-a113-31c566d81abc admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:19.403426 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecf764c-539c-42a6-a113-31c566d81abc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:19.407454 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecf764c-539c-42a6-a113-31c566d81abc admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:19.415765 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1170/2350] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 07 06:34:19.420381 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215d1f95-9389-4e65-8815-fa7473beaa1c admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:19.430930 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215d1f95-9389-4e65-8815-fa7473beaa1c admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:19.435848 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47503a71-d9e8-4fe8-9618-52899fcc3caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:19.437047 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47503a71-d9e8-4fe8-9618-52899fcc3caa admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:19.437352 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47503a71-d9e8-4fe8-9618-52899fcc3caa admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:19.437631 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47503a71-d9e8-4fe8-9618-52899fcc3caa admin admin] PATH_INFO: `/v3/projects/f1eb4281cce04ffa99e2f0a8e5c3ac71/users/ce7aecc52cb54fa79b2604135333cc14/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:19.458248 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47503a71-d9e8-4fe8-9618-52899fcc3caa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1eb4281cce04ffa99e2f0a8e5c3ac71, user_id=ce7aecc52cb54fa79b2604135333cc14, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:19.460995 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47503a71-d9e8-4fe8-9618-52899fcc3caa admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:19.531831 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1181/2351] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:34:19 2022] PUT /identity/v3/projects/f1eb4281cce04ffa99e2f0a8e5c3ac71/users/ce7aecc52cb54fa79b2604135333cc14/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:34:19.548940 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b5101-4e96-4c55-92fd-2698bb53cd0c None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:19.549232 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b5101-4e96-4c55-92fd-2698bb53cd0c None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:19.549508 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b5101-4e96-4c55-92fd-2698bb53cd0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:19.574731 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-ab9b5101-4e96-4c55-92fd-2698bb53cd0c None None] MFA Rules not processed for user `ce7aecc52cb54fa79b2604135333cc14`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:34:19.576562 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-ab9b5101-4e96-4c55-92fd-2698bb53cd0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:19.636607 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1171/2352] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:34:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:34:19.641246 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47503a71-d9e8-4fe8-9618-52899fcc3caa admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:19.702926 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47503a71-d9e8-4fe8-9618-52899fcc3caa admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:19.707382 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb588687-11a1-4406-8390-85eb598897e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:19.708068 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb588687-11a1-4406-8390-85eb598897e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:19.708370 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb588687-11a1-4406-8390-85eb598897e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:19.708629 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb588687-11a1-4406-8390-85eb598897e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:19.709305 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb588687-11a1-4406-8390-85eb598897e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:19.711220 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb588687-11a1-4406-8390-85eb598897e1 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:19.821841 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1182/2353] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:34:19 2022] POST /identity/v3/projects => generated 391 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:34:19.826006 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9b5101-4e96-4c55-92fd-2698bb53cd0c None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:19.836548 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9b5101-4e96-4c55-92fd-2698bb53cd0c None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:19.893746 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98310c8-6788-4884-84c2-576200c265d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:19.894434 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98310c8-6788-4884-84c2-576200c265d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:19.894723 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98310c8-6788-4884-84c2-576200c265d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:19.895004 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98310c8-6788-4884-84c2-576200c265d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:19.895704 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98310c8-6788-4884-84c2-576200c265d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:19.897665 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98310c8-6788-4884-84c2-576200c265d8 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:20.014395 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1172/2354] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:34:19 2022] POST /identity/v3/users => generated 302 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:34:20.018265 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb588687-11a1-4406-8390-85eb598897e1 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:20.028373 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb588687-11a1-4406-8390-85eb598897e1 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:20.033741 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb8d821-5ce5-49bd-a64a-a72415947bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:20.034408 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8d821-5ce5-49bd-a64a-a72415947bd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:20.034693 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8d821-5ce5-49bd-a64a-a72415947bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:20.034967 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8d821-5ce5-49bd-a64a-a72415947bd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:20.035702 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb8d821-5ce5-49bd-a64a-a72415947bd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:20.037307 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb8d821-5ce5-49bd-a64a-a72415947bd5 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:20.047047 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1183/2355] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:34:20.051031 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98310c8-6788-4884-84c2-576200c265d8 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:20.060635 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98310c8-6788-4884-84c2-576200c265d8 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:20.065199 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d3a9c0-1bcc-48fe-90d9-3657ff914242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:20.066064 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3a9c0-1bcc-48fe-90d9-3657ff914242 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:20.066352 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3a9c0-1bcc-48fe-90d9-3657ff914242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:20.066630 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3a9c0-1bcc-48fe-90d9-3657ff914242 admin admin] PATH_INFO: `/v3/projects/5df099c8adb047fc8aaecf45acaedf89/users/9b11048326fb48b2af218c076447a91e/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:20.081699 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d3a9c0-1bcc-48fe-90d9-3657ff914242 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5df099c8adb047fc8aaecf45acaedf89, user_id=9b11048326fb48b2af218c076447a91e, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:20.084456 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d3a9c0-1bcc-48fe-90d9-3657ff914242 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:20.186113 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1173/2356] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:34:20 2022] PUT /identity/v3/projects/5df099c8adb047fc8aaecf45acaedf89/users/9b11048326fb48b2af218c076447a91e/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:34:20.190469 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb8d821-5ce5-49bd-a64a-a72415947bd5 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:20.201978 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb8d821-5ce5-49bd-a64a-a72415947bd5 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:20.257578 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f4efcc-3401-4b8f-b996-398233b7592d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:20.258295 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4efcc-3401-4b8f-b996-398233b7592d admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:20.258590 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4efcc-3401-4b8f-b996-398233b7592d admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:20.258961 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4efcc-3401-4b8f-b996-398233b7592d admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:20.259680 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f4efcc-3401-4b8f-b996-398233b7592d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:20.261315 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f4efcc-3401-4b8f-b996-398233b7592d admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:20.271885 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1184/2357] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:34:20.276059 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d3a9c0-1bcc-48fe-90d9-3657ff914242 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:20.286384 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d3a9c0-1bcc-48fe-90d9-3657ff914242 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:20.290968 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9193529-2e1c-44ed-96b2-e3c19cd9b180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:20.291879 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9193529-2e1c-44ed-96b2-e3c19cd9b180 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:20.292166 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9193529-2e1c-44ed-96b2-e3c19cd9b180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:20.292443 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9193529-2e1c-44ed-96b2-e3c19cd9b180 admin admin] PATH_INFO: `/v3/projects/5df099c8adb047fc8aaecf45acaedf89/users/9b11048326fb48b2af218c076447a91e/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:20.294382 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9193529-2e1c-44ed-96b2-e3c19cd9b180 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5df099c8adb047fc8aaecf45acaedf89, user_id=9b11048326fb48b2af218c076447a91e, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:20.297154 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9193529-2e1c-44ed-96b2-e3c19cd9b180 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:20.312694 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1174/2358] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:34:20 2022] PUT /identity/v3/projects/5df099c8adb047fc8aaecf45acaedf89/users/9b11048326fb48b2af218c076447a91e/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:34:20.323500 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a50f68-f4a9-49ad-8bde-bfa511db3f89 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:20.323828 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a50f68-f4a9-49ad-8bde-bfa511db3f89 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:20.324113 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a50f68-f4a9-49ad-8bde-bfa511db3f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:20.350037 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-c8a50f68-f4a9-49ad-8bde-bfa511db3f89 None None] MFA Rules not processed for user `9b11048326fb48b2af218c076447a91e`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:34:20.351230 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c8a50f68-f4a9-49ad-8bde-bfa511db3f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:20.416529 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1185/2359] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:34:20 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:34:20.427141 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9193529-2e1c-44ed-96b2-e3c19cd9b180 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:20.428870 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b9193529-2e1c-44ed-96b2-e3c19cd9b180 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:20.487951 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9193529-2e1c-44ed-96b2-e3c19cd9b180 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:20.491886 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4e2ad5-c2c6-4c98-bfed-2237bf1d9f77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:20.492540 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e2ad5-c2c6-4c98-bfed-2237bf1d9f77 service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:20.492826 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e2ad5-c2c6-4c98-bfed-2237bf1d9f77 service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:20.493104 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e2ad5-c2c6-4c98-bfed-2237bf1d9f77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:20.504376 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4e2ad5-c2c6-4c98-bfed-2237bf1d9f77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:20.505957 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4e2ad5-c2c6-4c98-bfed-2237bf1d9f77 service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:20.516493 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1175/2360] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:34:20 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:34:20.580141 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a50f68-f4a9-49ad-8bde-bfa511db3f89 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:20.581536 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c8a50f68-f4a9-49ad-8bde-bfa511db3f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:20.594500 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a50f68-f4a9-49ad-8bde-bfa511db3f89 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:20.598096 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c05777-f38a-4466-8c85-f450f9f142b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:20.598822 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c05777-f38a-4466-8c85-f450f9f142b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:20.599780 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c05777-f38a-4466-8c85-f450f9f142b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:20.599780 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c05777-f38a-4466-8c85-f450f9f142b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:20.667296 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c05777-f38a-4466-8c85-f450f9f142b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:20.668775 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c05777-f38a-4466-8c85-f450f9f142b9 service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:20.680196 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1186/2361] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:34:20 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:34:25.843544 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4e2ad5-c2c6-4c98-bfed-2237bf1d9f77 service cinder] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:25.911830 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4e2ad5-c2c6-4c98-bfed-2237bf1d9f77 service cinder] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:25.916777 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e8fbb-3ffc-463e-8d2f-2d174aff7ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:25.917977 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e8fbb-3ffc-463e-8d2f-2d174aff7ef8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:25.918272 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e8fbb-3ffc-463e-8d2f-2d174aff7ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:25.918677 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e8fbb-3ffc-463e-8d2f-2d174aff7ef8 admin admin] PATH_INFO: `/v3/users/ce7aecc52cb54fa79b2604135333cc14` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:25.919965 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535e8fbb-3ffc-463e-8d2f-2d174aff7ef8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce7aecc52cb54fa79b2604135333cc14)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:25.921904 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535e8fbb-3ffc-463e-8d2f-2d174aff7ef8 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:26.102185 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-535e8fbb-3ffc-463e-8d2f-2d174aff7ef8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce7aecc52cb54fa79b2604135333cc14'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:26.102838 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-535e8fbb-3ffc-463e-8d2f-2d174aff7ef8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce7aecc52cb54fa79b2604135333cc14'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:26.213364 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-535e8fbb-3ffc-463e-8d2f-2d174aff7ef8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce7aecc52cb54fa79b2604135333cc14'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:26.214094 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-535e8fbb-3ffc-463e-8d2f-2d174aff7ef8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce7aecc52cb54fa79b2604135333cc14'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:26.237201 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-535e8fbb-3ffc-463e-8d2f-2d174aff7ef8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce7aecc52cb54fa79b2604135333cc14'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:26.258101 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e8f3b0-1852-44a8-8721-1125c3f4535e None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:26.258538 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1176/2362] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:34:25 2022] DELETE /identity/v3/users/ce7aecc52cb54fa79b2604135333cc14 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:34:26.258634 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e8f3b0-1852-44a8-8721-1125c3f4535e None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:26.258634 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e8f3b0-1852-44a8-8721-1125c3f4535e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:26.290295 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-93e8f3b0-1852-44a8-8721-1125c3f4535e None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:34:26.292556 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-93e8f3b0-1852-44a8-8721-1125c3f4535e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:26.394507 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1187/2363] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:34:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:34:26.404804 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e8fbb-3ffc-463e-8d2f-2d174aff7ef8 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:26.406213 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-535e8fbb-3ffc-463e-8d2f-2d174aff7ef8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:26.461028 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e8fbb-3ffc-463e-8d2f-2d174aff7ef8 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:26.464686 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1484a83-43e4-41a8-b75e-81d3a50674e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:26.465330 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1484a83-43e4-41a8-b75e-81d3a50674e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:26.465615 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1484a83-43e4-41a8-b75e-81d3a50674e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:26.466471 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1484a83-43e4-41a8-b75e-81d3a50674e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:26.475360 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1484a83-43e4-41a8-b75e-81d3a50674e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:26.476919 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1484a83-43e4-41a8-b75e-81d3a50674e9 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:26.487291 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1177/2364] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:34:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 07 06:34:27.176022 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e8f3b0-1852-44a8-8721-1125c3f4535e None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:27.177728 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-93e8f3b0-1852-44a8-8721-1125c3f4535e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:27.203702 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e8f3b0-1852-44a8-8721-1125c3f4535e None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:27.217365 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b55499-4f19-4df1-b0fb-3860e36a7545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:27.219914 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b55499-4f19-4df1-b0fb-3860e36a7545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:27.219914 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b55499-4f19-4df1-b0fb-3860e36a7545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:27.219914 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b55499-4f19-4df1-b0fb-3860e36a7545 admin admin] PATH_INFO: `/v3/projects/f1eb4281cce04ffa99e2f0a8e5c3ac71` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:27.220159 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b55499-4f19-4df1-b0fb-3860e36a7545 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1eb4281cce04ffa99e2f0a8e5c3ac71)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:27.221904 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b55499-4f19-4df1-b0fb-3860e36a7545 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:27.341424 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-63b55499-4f19-4df1-b0fb-3860e36a7545 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1eb4281cce04ffa99e2f0a8e5c3ac71', 'request_id': 'req-63b55499-4f19-4df1-b0fb-3860e36a7545'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:27.347704 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-63b55499-4f19-4df1-b0fb-3860e36a7545 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1eb4281cce04ffa99e2f0a8e5c3ac71', 'request_id': 'req-63b55499-4f19-4df1-b0fb-3860e36a7545'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:27.419841 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-63b55499-4f19-4df1-b0fb-3860e36a7545 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1eb4281cce04ffa99e2f0a8e5c3ac71', 'request_id': 'req-63b55499-4f19-4df1-b0fb-3860e36a7545'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:27.433156 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-63b55499-4f19-4df1-b0fb-3860e36a7545 admin admin] The token cache is being invalidate because project f1eb4281cce04ffa99e2f0a8e5c3ac71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:34:27.433589 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-63b55499-4f19-4df1-b0fb-3860e36a7545 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:27.434180 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-63b55499-4f19-4df1-b0fb-3860e36a7545 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:27.436720 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1188/2365] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:34:27 2022] DELETE /identity/v3/projects/f1eb4281cce04ffa99e2f0a8e5c3ac71 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:34:27.440904 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1484a83-43e4-41a8-b75e-81d3a50674e9 service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:27.453198 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1484a83-43e4-41a8-b75e-81d3a50674e9 service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:27.517220 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eede407-ed8f-4e77-9cb1-cb9748437b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:27.518101 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eede407-ed8f-4e77-9cb1-cb9748437b3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:27.518409 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eede407-ed8f-4e77-9cb1-cb9748437b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:27.518713 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eede407-ed8f-4e77-9cb1-cb9748437b3f admin admin] PATH_INFO: `/v3/users/9b11048326fb48b2af218c076447a91e` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:27.520108 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eede407-ed8f-4e77-9cb1-cb9748437b3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b11048326fb48b2af218c076447a91e)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:27.522258 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eede407-ed8f-4e77-9cb1-cb9748437b3f admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:27.787612 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7eede407-ed8f-4e77-9cb1-cb9748437b3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b11048326fb48b2af218c076447a91e'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:27.789132 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7eede407-ed8f-4e77-9cb1-cb9748437b3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b11048326fb48b2af218c076447a91e'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:27.876639 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7eede407-ed8f-4e77-9cb1-cb9748437b3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b11048326fb48b2af218c076447a91e'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:27.878564 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7eede407-ed8f-4e77-9cb1-cb9748437b3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b11048326fb48b2af218c076447a91e'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:27.893074 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7eede407-ed8f-4e77-9cb1-cb9748437b3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b11048326fb48b2af218c076447a91e'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:27.907502 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1178/2366] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:34:27 2022] DELETE /identity/v3/users/9b11048326fb48b2af218c076447a91e => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:34:28.330827 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b55499-4f19-4df1-b0fb-3860e36a7545 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:28.332402 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-63b55499-4f19-4df1-b0fb-3860e36a7545 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:28.346719 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b55499-4f19-4df1-b0fb-3860e36a7545 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:28.408452 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b72af8-d7a1-4581-bb23-faef786674f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:28.409310 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b72af8-d7a1-4581-bb23-faef786674f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:28.409590 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b72af8-d7a1-4581-bb23-faef786674f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:28.409863 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b72af8-d7a1-4581-bb23-faef786674f3 admin admin] PATH_INFO: `/v3/projects/5df099c8adb047fc8aaecf45acaedf89` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:28.411151 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b72af8-d7a1-4581-bb23-faef786674f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5df099c8adb047fc8aaecf45acaedf89)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:28.413076 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b72af8-d7a1-4581-bb23-faef786674f3 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:28.536817 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b5b72af8-d7a1-4581-bb23-faef786674f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5df099c8adb047fc8aaecf45acaedf89', 'request_id': 'req-b5b72af8-d7a1-4581-bb23-faef786674f3'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:28.541426 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b5b72af8-d7a1-4581-bb23-faef786674f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5df099c8adb047fc8aaecf45acaedf89', 'request_id': 'req-b5b72af8-d7a1-4581-bb23-faef786674f3'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:28.612802 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b5b72af8-d7a1-4581-bb23-faef786674f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5df099c8adb047fc8aaecf45acaedf89', 'request_id': 'req-b5b72af8-d7a1-4581-bb23-faef786674f3'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:28.623802 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b5b72af8-d7a1-4581-bb23-faef786674f3 admin admin] The token cache is being invalidate because project 5df099c8adb047fc8aaecf45acaedf89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:34:28.626489 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b5b72af8-d7a1-4581-bb23-faef786674f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:28.626489 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b5b72af8-d7a1-4581-bb23-faef786674f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:28.626489 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1189/2367] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:34:28 2022] DELETE /identity/v3/projects/5df099c8adb047fc8aaecf45acaedf89 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:34:28.631259 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f85d65b-0d29-4d1a-8854-e813e3d526e8 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:28.631738 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f85d65b-0d29-4d1a-8854-e813e3d526e8 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:28.631956 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f85d65b-0d29-4d1a-8854-e813e3d526e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:28.650428 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-6f85d65b-0d29-4d1a-8854-e813e3d526e8 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:34:28.660693 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-6f85d65b-0d29-4d1a-8854-e813e3d526e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:28.725865 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1179/2368] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:34:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:34:28.734253 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc7315-6549-4506-b848-ebcb131601de None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:28.734547 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc7315-6549-4506-b848-ebcb131601de None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:28.735235 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc7315-6549-4506-b848-ebcb131601de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:28.755845 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-9fdc7315-6549-4506-b848-ebcb131601de None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:34:28.756986 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-9fdc7315-6549-4506-b848-ebcb131601de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:28.768027 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1190/2369] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:34:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:34:28.772508 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f85d65b-0d29-4d1a-8854-e813e3d526e8 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:28.786263 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f85d65b-0d29-4d1a-8854-e813e3d526e8 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:28.790918 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c646da-b1cc-41a7-9ec0-cd77b8117951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:28.791583 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c646da-b1cc-41a7-9ec0-cd77b8117951 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:28.791910 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c646da-b1cc-41a7-9ec0-cd77b8117951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:28.792192 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c646da-b1cc-41a7-9ec0-cd77b8117951 admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:28.792978 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c646da-b1cc-41a7-9ec0-cd77b8117951 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:34:28.793289 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c646da-b1cc-41a7-9ec0-cd77b8117951 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:28.795417 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c646da-b1cc-41a7-9ec0-cd77b8117951 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:28.808603 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1180/2370] 10.222.0.24 () {58 vars in 1152 bytes} [Thu Apr 7 06:34:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:34:28.813614 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdc7315-6549-4506-b848-ebcb131601de None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:28.822831 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdc7315-6549-4506-b848-ebcb131601de None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:28.828151 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32018c75-0f9c-4271-9455-5924a89ea6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:28.828808 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32018c75-0f9c-4271-9455-5924a89ea6f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:28.829098 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32018c75-0f9c-4271-9455-5924a89ea6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:28.829376 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32018c75-0f9c-4271-9455-5924a89ea6f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:28.830078 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32018c75-0f9c-4271-9455-5924a89ea6f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:28.832029 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32018c75-0f9c-4271-9455-5924a89ea6f3 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:28.952985 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1191/2371] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:34:28 2022] POST /identity/v3/projects => generated 365 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:34:28.957403 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c646da-b1cc-41a7-9ec0-cd77b8117951 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:28.967609 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c646da-b1cc-41a7-9ec0-cd77b8117951 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:29.028814 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7327b754-5247-440d-99c0-7104f0bc3730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:29.029495 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327b754-5247-440d-99c0-7104f0bc3730 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:29.029785 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327b754-5247-440d-99c0-7104f0bc3730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:29.030080 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327b754-5247-440d-99c0-7104f0bc3730 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:29.030778 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7327b754-5247-440d-99c0-7104f0bc3730 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:29.032877 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7327b754-5247-440d-99c0-7104f0bc3730 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:29.112528 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1181/2372] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:34:28 2022] POST /identity/v3/users => generated 283 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:34:29.116850 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32018c75-0f9c-4271-9455-5924a89ea6f3 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:29.128272 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32018c75-0f9c-4271-9455-5924a89ea6f3 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:29.133419 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa19986-20cb-40b1-ba21-0731590357cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:29.134914 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa19986-20cb-40b1-ba21-0731590357cc admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:29.134914 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa19986-20cb-40b1-ba21-0731590357cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:29.134914 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa19986-20cb-40b1-ba21-0731590357cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:29.135502 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa19986-20cb-40b1-ba21-0731590357cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:29.137142 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa19986-20cb-40b1-ba21-0731590357cc admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:29.151107 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1192/2373] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:34:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 07 06:34:29.155168 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7327b754-5247-440d-99c0-7104f0bc3730 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:29.165518 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7327b754-5247-440d-99c0-7104f0bc3730 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:29.170806 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b9bb02-466a-4d15-9167-143ddcba7d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:29.171487 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9bb02-466a-4d15-9167-143ddcba7d84 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:29.171898 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9bb02-466a-4d15-9167-143ddcba7d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:29.172310 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9bb02-466a-4d15-9167-143ddcba7d84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:29.173054 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b9bb02-466a-4d15-9167-143ddcba7d84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:29.174650 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b9bb02-466a-4d15-9167-143ddcba7d84 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:29.189302 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1182/2374] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:34:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 07 06:34:29.193423 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa19986-20cb-40b1-ba21-0731590357cc admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:29.204117 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa19986-20cb-40b1-ba21-0731590357cc admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:29.209954 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51676a7c-ff11-4086-b88d-e599a63272dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:29.210849 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51676a7c-ff11-4086-b88d-e599a63272dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:29.211134 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51676a7c-ff11-4086-b88d-e599a63272dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:29.211414 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51676a7c-ff11-4086-b88d-e599a63272dd admin admin] PATH_INFO: `/v3/projects/e5dec112c56645528cf7b600e0bbb3ce/users/7678e53935304228b79bc8c0452b32cc/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:29.228487 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b9bb02-466a-4d15-9167-143ddcba7d84 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:29.229066 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51676a7c-ff11-4086-b88d-e599a63272dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5dec112c56645528cf7b600e0bbb3ce, user_id=7678e53935304228b79bc8c0452b32cc, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:29.232011 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51676a7c-ff11-4086-b88d-e599a63272dd admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:29.232660 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-62b9bb02-466a-4d15-9167-143ddcba7d84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:29.291114 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b9bb02-466a-4d15-9167-143ddcba7d84 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:29.295260 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6cd96d-8624-4349-b9d9-08a03bd71df4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:29.296484 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6cd96d-8624-4349-b9d9-08a03bd71df4 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:29.296767 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6cd96d-8624-4349-b9d9-08a03bd71df4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:29.305846 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6cd96d-8624-4349-b9d9-08a03bd71df4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:29.305846 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-1a6cd96d-8624-4349-b9d9-08a03bd71df4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:29.306045 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1193/2375] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:34:29 2022] PUT /identity/v3/projects/e5dec112c56645528cf7b600e0bbb3ce/users/7678e53935304228b79bc8c0452b32cc/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:34:29.311141 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6cd96d-8624-4349-b9d9-08a03bd71df4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:29.311287 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106bc21-1021-45c7-9b00-c181daf7540a None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:29.311511 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106bc21-1021-45c7-9b00-c181daf7540a None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:29.311816 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106bc21-1021-45c7-9b00-c181daf7540a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:29.312643 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6cd96d-8624-4349-b9d9-08a03bd71df4 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:29.323059 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1183/2376] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:34:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:34:29.341804 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-3106bc21-1021-45c7-9b00-c181daf7540a None None] MFA Rules not processed for user `7678e53935304228b79bc8c0452b32cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:34:29.343025 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-3106bc21-1021-45c7-9b00-c181daf7540a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:29.419628 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1194/2377] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:34:29 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:34:29.424732 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6cd96d-8624-4349-b9d9-08a03bd71df4 service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:29.437379 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6cd96d-8624-4349-b9d9-08a03bd71df4 service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:29.503222 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3add2c79-806c-4a02-991d-a38a74e2d117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:29.504341 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add2c79-806c-4a02-991d-a38a74e2d117 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:29.504865 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add2c79-806c-4a02-991d-a38a74e2d117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:29.505356 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add2c79-806c-4a02-991d-a38a74e2d117 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:29.506631 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3add2c79-806c-4a02-991d-a38a74e2d117 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:29.508878 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3add2c79-806c-4a02-991d-a38a74e2d117 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:29.587314 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1184/2378] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:34:29 2022] POST /identity/v3/projects => generated 365 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:34:29.593278 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3106bc21-1021-45c7-9b00-c181daf7540a None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:29.605672 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3106bc21-1021-45c7-9b00-c181daf7540a None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:29.668467 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2131585a-4bf3-401c-8ead-2a03d4c0c19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:29.669153 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131585a-4bf3-401c-8ead-2a03d4c0c19e admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:29.669502 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131585a-4bf3-401c-8ead-2a03d4c0c19e admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:29.669830 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131585a-4bf3-401c-8ead-2a03d4c0c19e admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:29.670635 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2131585a-4bf3-401c-8ead-2a03d4c0c19e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:29.672894 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2131585a-4bf3-401c-8ead-2a03d4c0c19e admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:29.769803 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1195/2379] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:34:29 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:34:29.774581 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3add2c79-806c-4a02-991d-a38a74e2d117 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:29.786368 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3add2c79-806c-4a02-991d-a38a74e2d117 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:29.791579 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95407312-d205-45cc-949d-a2ab0e4ab228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:29.792028 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95407312-d205-45cc-949d-a2ab0e4ab228 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:29.792316 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95407312-d205-45cc-949d-a2ab0e4ab228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:29.792590 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95407312-d205-45cc-949d-a2ab0e4ab228 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:29.793333 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95407312-d205-45cc-949d-a2ab0e4ab228 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:29.795681 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95407312-d205-45cc-949d-a2ab0e4ab228 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:29.806950 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1185/2380] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:34:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:34:29.811175 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2131585a-4bf3-401c-8ead-2a03d4c0c19e admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:29.822231 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2131585a-4bf3-401c-8ead-2a03d4c0c19e admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:29.827593 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09436d44-c9f3-4382-8f9f-3a937bd36764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:29.828513 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09436d44-c9f3-4382-8f9f-3a937bd36764 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:29.828845 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09436d44-c9f3-4382-8f9f-3a937bd36764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:29.829129 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09436d44-c9f3-4382-8f9f-3a937bd36764 admin admin] PATH_INFO: `/v3/projects/48f12034a81c4076b4240ba285545d9b/users/4d095e8e21d94bcbb49b1559d5550213/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:29.845227 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09436d44-c9f3-4382-8f9f-3a937bd36764 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48f12034a81c4076b4240ba285545d9b, user_id=4d095e8e21d94bcbb49b1559d5550213, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:29.847241 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09436d44-c9f3-4382-8f9f-3a937bd36764 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:29.952350 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1196/2381] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:34:29 2022] PUT /identity/v3/projects/48f12034a81c4076b4240ba285545d9b/users/4d095e8e21d94bcbb49b1559d5550213/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:34:29.956465 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95407312-d205-45cc-949d-a2ab0e4ab228 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:29.967298 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95407312-d205-45cc-949d-a2ab0e4ab228 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:30.026265 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3537c3b3-df1a-4704-a631-7577d8b38b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:30.026940 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537c3b3-df1a-4704-a631-7577d8b38b43 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:30.027244 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537c3b3-df1a-4704-a631-7577d8b38b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:30.027514 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537c3b3-df1a-4704-a631-7577d8b38b43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:30.028312 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3537c3b3-df1a-4704-a631-7577d8b38b43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:30.029904 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3537c3b3-df1a-4704-a631-7577d8b38b43 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:30.042832 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1186/2382] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:34:29 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:34:30.044408 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09436d44-c9f3-4382-8f9f-3a937bd36764 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:30.054554 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09436d44-c9f3-4382-8f9f-3a937bd36764 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:30.059119 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed824d06-59e0-4c4f-ab7a-c0d0726a6a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:30.060545 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed824d06-59e0-4c4f-ab7a-c0d0726a6a2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:30.060834 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed824d06-59e0-4c4f-ab7a-c0d0726a6a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:30.061109 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed824d06-59e0-4c4f-ab7a-c0d0726a6a2b admin admin] PATH_INFO: `/v3/projects/48f12034a81c4076b4240ba285545d9b/users/4d095e8e21d94bcbb49b1559d5550213/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:30.063070 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed824d06-59e0-4c4f-ab7a-c0d0726a6a2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=48f12034a81c4076b4240ba285545d9b, user_id=4d095e8e21d94bcbb49b1559d5550213, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:30.065740 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed824d06-59e0-4c4f-ab7a-c0d0726a6a2b admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:30.076271 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1197/2383] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:34:30 2022] PUT /identity/v3/projects/48f12034a81c4076b4240ba285545d9b/users/4d095e8e21d94bcbb49b1559d5550213/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:34:30.087822 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24897da-3b28-4b8c-be5c-0a481df7fd67 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:30.088119 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24897da-3b28-4b8c-be5c-0a481df7fd67 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:30.088407 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24897da-3b28-4b8c-be5c-0a481df7fd67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:30.114265 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-b24897da-3b28-4b8c-be5c-0a481df7fd67 None None] MFA Rules not processed for user `4d095e8e21d94bcbb49b1559d5550213`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:34:30.115653 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b24897da-3b28-4b8c-be5c-0a481df7fd67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:30.182566 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1187/2384] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:34:30 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:34:30.194276 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed824d06-59e0-4c4f-ab7a-c0d0726a6a2b admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:30.196006 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-ed824d06-59e0-4c4f-ab7a-c0d0726a6a2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:30.251486 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed824d06-59e0-4c4f-ab7a-c0d0726a6a2b admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:30.255232 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae2fa2-5dcf-4728-b209-4727b519824e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:30.255917 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae2fa2-5dcf-4728-b209-4727b519824e service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:30.256206 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae2fa2-5dcf-4728-b209-4727b519824e service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:30.256482 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae2fa2-5dcf-4728-b209-4727b519824e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:30.265971 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ae2fa2-5dcf-4728-b209-4727b519824e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:30.267436 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ae2fa2-5dcf-4728-b209-4727b519824e service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:30.276982 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1198/2385] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:34:30 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:34:30.532423 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24897da-3b28-4b8c-be5c-0a481df7fd67 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:30.541871 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24897da-3b28-4b8c-be5c-0a481df7fd67 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:30.547409 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d085e-5f17-4760-96cc-75eba5f1bc37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:30.547409 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d085e-5f17-4760-96cc-75eba5f1bc37 service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:30.547409 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d085e-5f17-4760-96cc-75eba5f1bc37 service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:30.547409 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d085e-5f17-4760-96cc-75eba5f1bc37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:30.602091 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05d085e-5f17-4760-96cc-75eba5f1bc37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:30.603515 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05d085e-5f17-4760-96cc-75eba5f1bc37 service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:30.612675 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1188/2386] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:34:30 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:34:33.470504 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae2fa2-5dcf-4728-b209-4727b519824e service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:33.471981 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-91ae2fa2-5dcf-4728-b209-4727b519824e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:33.531480 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae2fa2-5dcf-4728-b209-4727b519824e service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:33.535071 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d8fd12-0f3e-4207-9f34-ba5f5211f822 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:33.535723 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8fd12-0f3e-4207-9f34-ba5f5211f822 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:33.536045 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8fd12-0f3e-4207-9f34-ba5f5211f822 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:33.536317 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8fd12-0f3e-4207-9f34-ba5f5211f822 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:33.538157 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b0d8fd12-0f3e-4207-9f34-ba5f5211f822 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:33.576242 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d085e-5f17-4760-96cc-75eba5f1bc37 service cinder] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:33.577730 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-c05d085e-5f17-4760-96cc-75eba5f1bc37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:33.604824 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d8fd12-0f3e-4207-9f34-ba5f5211f822 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:33.606366 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d8fd12-0f3e-4207-9f34-ba5f5211f822 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:33.616445 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1199/2387] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:34:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 07 06:34:33.652047 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d085e-5f17-4760-96cc-75eba5f1bc37 service cinder] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:33.657075 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7011c-c338-47e2-9296-a485e168d962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:33.657947 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7011c-c338-47e2-9296-a485e168d962 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:33.658380 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7011c-c338-47e2-9296-a485e168d962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:33.658661 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7011c-c338-47e2-9296-a485e168d962 admin admin] PATH_INFO: `/v3/users/c9ac85053def476489ee1843bbd02316` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:33.660150 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b7011c-c338-47e2-9296-a485e168d962 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9ac85053def476489ee1843bbd02316)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:33.663285 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b7011c-c338-47e2-9296-a485e168d962 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:33.938817 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-32b7011c-c338-47e2-9296-a485e168d962 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9ac85053def476489ee1843bbd02316'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:33.939549 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-32b7011c-c338-47e2-9296-a485e168d962 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9ac85053def476489ee1843bbd02316'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:34.064678 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-32b7011c-c338-47e2-9296-a485e168d962 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9ac85053def476489ee1843bbd02316'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:34.065477 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-32b7011c-c338-47e2-9296-a485e168d962 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9ac85053def476489ee1843bbd02316'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:34.079434 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-32b7011c-c338-47e2-9296-a485e168d962 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9ac85053def476489ee1843bbd02316'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:34.097400 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1189/2388] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:34:33 2022] DELETE /identity/v3/users/c9ac85053def476489ee1843bbd02316 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:34:34.368716 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d8fd12-0f3e-4207-9f34-ba5f5211f822 service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:34.379438 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d8fd12-0f3e-4207-9f34-ba5f5211f822 service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:34.460827 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da4a91-ff5f-4c75-96c4-fe6bbc5a73b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:34.461814 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da4a91-ff5f-4c75-96c4-fe6bbc5a73b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:34.462107 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da4a91-ff5f-4c75-96c4-fe6bbc5a73b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:34.462475 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da4a91-ff5f-4c75-96c4-fe6bbc5a73b5 admin admin] PATH_INFO: `/v3/projects/e654563225464c6c925e0f97b63a12d7` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:34.463591 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6da4a91-ff5f-4c75-96c4-fe6bbc5a73b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e654563225464c6c925e0f97b63a12d7)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:34.465613 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6da4a91-ff5f-4c75-96c4-fe6bbc5a73b5 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:34.660648 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d6da4a91-ff5f-4c75-96c4-fe6bbc5a73b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e654563225464c6c925e0f97b63a12d7', 'request_id': 'req-d6da4a91-ff5f-4c75-96c4-fe6bbc5a73b5'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:34.667439 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d6da4a91-ff5f-4c75-96c4-fe6bbc5a73b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e654563225464c6c925e0f97b63a12d7', 'request_id': 'req-d6da4a91-ff5f-4c75-96c4-fe6bbc5a73b5'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:34.765008 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d6da4a91-ff5f-4c75-96c4-fe6bbc5a73b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e654563225464c6c925e0f97b63a12d7', 'request_id': 'req-d6da4a91-ff5f-4c75-96c4-fe6bbc5a73b5'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:34.782361 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d6da4a91-ff5f-4c75-96c4-fe6bbc5a73b5 admin admin] The token cache is being invalidate because project e654563225464c6c925e0f97b63a12d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:34:34.782712 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d6da4a91-ff5f-4c75-96c4-fe6bbc5a73b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:34.783564 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d6da4a91-ff5f-4c75-96c4-fe6bbc5a73b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:34.786635 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1200/2389] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:34:34 2022] DELETE /identity/v3/projects/e654563225464c6c925e0f97b63a12d7 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:34:34.791836 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df3434-866c-4c50-ba35-22d9fb7244fb None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:34.792345 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df3434-866c-4c50-ba35-22d9fb7244fb None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:34.792472 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df3434-866c-4c50-ba35-22d9fb7244fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:34.817185 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-a4df3434-866c-4c50-ba35-22d9fb7244fb None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:34:34.818547 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a4df3434-866c-4c50-ba35-22d9fb7244fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:34.896267 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1190/2390] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:34:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:34:34.904666 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc200d-2e69-4215-9a47-84bdd106184d None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:34.904962 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc200d-2e69-4215-9a47-84bdd106184d None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:34.905247 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc200d-2e69-4215-9a47-84bdd106184d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:34.926923 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-13bc200d-2e69-4215-9a47-84bdd106184d None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:34:34.928419 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-13bc200d-2e69-4215-9a47-84bdd106184d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:34.945740 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1201/2391] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:34:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:34:34.949029 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df3434-866c-4c50-ba35-22d9fb7244fb None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:34.964611 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df3434-866c-4c50-ba35-22d9fb7244fb None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:34.970379 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c846123-10db-4ebf-aee8-9880ca77c8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:34.971208 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c846123-10db-4ebf-aee8-9880ca77c8cb admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:34.972420 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c846123-10db-4ebf-aee8-9880ca77c8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:34.972792 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c846123-10db-4ebf-aee8-9880ca77c8cb admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:34.973621 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c846123-10db-4ebf-aee8-9880ca77c8cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:34:34.974009 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c846123-10db-4ebf-aee8-9880ca77c8cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:34.976363 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c846123-10db-4ebf-aee8-9880ca77c8cb admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:34.993553 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1191/2392] 10.222.0.24 () {58 vars in 1152 bytes} [Thu Apr 7 06:34:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:34:34.994803 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc200d-2e69-4215-9a47-84bdd106184d None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:35.004990 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc200d-2e69-4215-9a47-84bdd106184d None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:35.010363 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401bd555-65dc-4916-b3ab-e7f8623f8f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:35.011044 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401bd555-65dc-4916-b3ab-e7f8623f8f79 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:35.012085 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401bd555-65dc-4916-b3ab-e7f8623f8f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:35.012899 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401bd555-65dc-4916-b3ab-e7f8623f8f79 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:35.013612 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401bd555-65dc-4916-b3ab-e7f8623f8f79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:35.015536 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401bd555-65dc-4916-b3ab-e7f8623f8f79 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:35.111380 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1202/2393] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:34:34 2022] POST /identity/v3/projects => generated 383 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:34:35.112807 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c846123-10db-4ebf-aee8-9880ca77c8cb admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:35.124112 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c846123-10db-4ebf-aee8-9880ca77c8cb admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:35.186266 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cbcfb5-fb8c-4f35-b5af-5ff765527a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:35.186955 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbcfb5-fb8c-4f35-b5af-5ff765527a86 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:35.187248 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbcfb5-fb8c-4f35-b5af-5ff765527a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:35.187525 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbcfb5-fb8c-4f35-b5af-5ff765527a86 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:35.188300 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cbcfb5-fb8c-4f35-b5af-5ff765527a86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:35.190272 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cbcfb5-fb8c-4f35-b5af-5ff765527a86 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:35.361905 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1192/2394] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:34:35 2022] POST /identity/v3/users => generated 292 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:34:35.363242 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401bd555-65dc-4916-b3ab-e7f8623f8f79 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:35.379295 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401bd555-65dc-4916-b3ab-e7f8623f8f79 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:35.381653 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a00f8-227f-4741-a228-e9a0be7d8b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:35.392655 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a00f8-227f-4741-a228-e9a0be7d8b90 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:35.392935 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a00f8-227f-4741-a228-e9a0be7d8b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:35.393213 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a00f8-227f-4741-a228-e9a0be7d8b90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:35.394093 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988a00f8-227f-4741-a228-e9a0be7d8b90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:35.395716 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988a00f8-227f-4741-a228-e9a0be7d8b90 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:35.408419 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1203/2395] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 07 06:34:35.412521 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cbcfb5-fb8c-4f35-b5af-5ff765527a86 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:35.423485 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cbcfb5-fb8c-4f35-b5af-5ff765527a86 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:35.428661 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f5da7-aa41-43a7-b9d7-bf58fc3598b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:35.429323 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f5da7-aa41-43a7-b9d7-bf58fc3598b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:35.429612 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f5da7-aa41-43a7-b9d7-bf58fc3598b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:35.429893 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f5da7-aa41-43a7-b9d7-bf58fc3598b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:35.430686 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f5da7-aa41-43a7-b9d7-bf58fc3598b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:35.432330 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f5da7-aa41-43a7-b9d7-bf58fc3598b0 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:35.444399 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1193/2396] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 07 06:34:35.449257 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a00f8-227f-4741-a228-e9a0be7d8b90 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:35.461296 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a00f8-227f-4741-a228-e9a0be7d8b90 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:35.466847 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df046626-47b1-48eb-8f88-ff290e08da71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:35.467912 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df046626-47b1-48eb-8f88-ff290e08da71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:35.468300 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df046626-47b1-48eb-8f88-ff290e08da71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:35.468689 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df046626-47b1-48eb-8f88-ff290e08da71 admin admin] PATH_INFO: `/v3/projects/f9342c5b18aa4785bda52c5f540d6d3d/users/2de8ec9a1caa4ede86c6145dd22ef0ec/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:35.485995 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df046626-47b1-48eb-8f88-ff290e08da71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9342c5b18aa4785bda52c5f540d6d3d, user_id=2de8ec9a1caa4ede86c6145dd22ef0ec, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:35.488939 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df046626-47b1-48eb-8f88-ff290e08da71 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:35.588501 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1204/2397] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:34:35 2022] PUT /identity/v3/projects/f9342c5b18aa4785bda52c5f540d6d3d/users/2de8ec9a1caa4ede86c6145dd22ef0ec/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:34:35.599136 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29009b13-12c7-4a7a-a1c2-fb9a7aa61fb5 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:35.606716 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29009b13-12c7-4a7a-a1c2-fb9a7aa61fb5 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:35.606716 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29009b13-12c7-4a7a-a1c2-fb9a7aa61fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:35.649282 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-29009b13-12c7-4a7a-a1c2-fb9a7aa61fb5 None None] MFA Rules not processed for user `2de8ec9a1caa4ede86c6145dd22ef0ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:34:35.650549 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-29009b13-12c7-4a7a-a1c2-fb9a7aa61fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:35.724854 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1194/2398] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:34:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:34:35.736977 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df046626-47b1-48eb-8f88-ff290e08da71 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:35.738856 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-df046626-47b1-48eb-8f88-ff290e08da71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:35.847223 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df046626-47b1-48eb-8f88-ff290e08da71 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:35.855027 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be37f9-76ab-4c38-95bf-0fd93b59a797 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cd81f6620f410db450871fb29961f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:35.856813 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be37f9-76ab-4c38-95bf-0fd93b59a797 service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:35.857286 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be37f9-76ab-4c38-95bf-0fd93b59a797 service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:35.857824 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be37f9-76ab-4c38-95bf-0fd93b59a797 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:35.872822 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57be37f9-76ab-4c38-95bf-0fd93b59a797 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:35.878555 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57be37f9-76ab-4c38-95bf-0fd93b59a797 service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:35.919878 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1205/2399] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:34:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:34:37.807918 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29009b13-12c7-4a7a-a1c2-fb9a7aa61fb5 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:37.809398 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-29009b13-12c7-4a7a-a1c2-fb9a7aa61fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:37.976904 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29009b13-12c7-4a7a-a1c2-fb9a7aa61fb5 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:37.986104 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271bfe29-9928-47f0-86b9-1a53ba7dfa28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:37.987223 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271bfe29-9928-47f0-86b9-1a53ba7dfa28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:37.988222 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271bfe29-9928-47f0-86b9-1a53ba7dfa28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:37.988222 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271bfe29-9928-47f0-86b9-1a53ba7dfa28 admin admin] PATH_INFO: `/v3/users/7678e53935304228b79bc8c0452b32cc` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:37.990307 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271bfe29-9928-47f0-86b9-1a53ba7dfa28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7678e53935304228b79bc8c0452b32cc)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:37.993067 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271bfe29-9928-47f0-86b9-1a53ba7dfa28 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:38.233513 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-271bfe29-9928-47f0-86b9-1a53ba7dfa28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7678e53935304228b79bc8c0452b32cc'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:38.234201 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-271bfe29-9928-47f0-86b9-1a53ba7dfa28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7678e53935304228b79bc8c0452b32cc'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:38.265640 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be37f9-76ab-4c38-95bf-0fd93b59a797 service nova] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:38.267620 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-57be37f9-76ab-4c38-95bf-0fd93b59a797 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:38.292237 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be37f9-76ab-4c38-95bf-0fd93b59a797 service nova] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:38.292237 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51689af3-0349-4b02-8a3d-a71a1777d0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:38.292237 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51689af3-0349-4b02-8a3d-a71a1777d0ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:38.292237 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51689af3-0349-4b02-8a3d-a71a1777d0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:38.293070 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51689af3-0349-4b02-8a3d-a71a1777d0ed admin admin] PATH_INFO: `/v3/users/9dfc8205c02f4f83bafdac7217b3e685` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:38.293070 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51689af3-0349-4b02-8a3d-a71a1777d0ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dfc8205c02f4f83bafdac7217b3e685)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:38.295706 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51689af3-0349-4b02-8a3d-a71a1777d0ed admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:38.311475 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-271bfe29-9928-47f0-86b9-1a53ba7dfa28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7678e53935304228b79bc8c0452b32cc'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:38.312162 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-271bfe29-9928-47f0-86b9-1a53ba7dfa28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7678e53935304228b79bc8c0452b32cc'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:38.325416 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-271bfe29-9928-47f0-86b9-1a53ba7dfa28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7678e53935304228b79bc8c0452b32cc'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:38.338501 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1195/2400] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:34:37 2022] DELETE /identity/v3/users/7678e53935304228b79bc8c0452b32cc => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:34:38.343423 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00399bd-4bfc-4b31-b322-954aa2d08c8f None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:38.347334 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00399bd-4bfc-4b31-b322-954aa2d08c8f None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:38.347334 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00399bd-4bfc-4b31-b322-954aa2d08c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:38.361835 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-a00399bd-4bfc-4b31-b322-954aa2d08c8f None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:34:38.363078 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a00399bd-4bfc-4b31-b322-954aa2d08c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:38.433561 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1196/2401] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:34:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:34:38.446991 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00399bd-4bfc-4b31-b322-954aa2d08c8f None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:38.448739 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a00399bd-4bfc-4b31-b322-954aa2d08c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:38.510932 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-51689af3-0349-4b02-8a3d-a71a1777d0ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dfc8205c02f4f83bafdac7217b3e685'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:38.536695 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-51689af3-0349-4b02-8a3d-a71a1777d0ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dfc8205c02f4f83bafdac7217b3e685'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:38.543296 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00399bd-4bfc-4b31-b322-954aa2d08c8f None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:38.549410 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60215c9-609f-4dc5-8f75-73e1bfe48ff3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:38.550148 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60215c9-609f-4dc5-8f75-73e1bfe48ff3 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:38.550438 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60215c9-609f-4dc5-8f75-73e1bfe48ff3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:38.550717 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60215c9-609f-4dc5-8f75-73e1bfe48ff3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:38.560434 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60215c9-609f-4dc5-8f75-73e1bfe48ff3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:38.561873 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60215c9-609f-4dc5-8f75-73e1bfe48ff3 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:38.571491 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1197/2402] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:34:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 07 06:34:38.614320 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-51689af3-0349-4b02-8a3d-a71a1777d0ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dfc8205c02f4f83bafdac7217b3e685'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:38.615385 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-51689af3-0349-4b02-8a3d-a71a1777d0ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dfc8205c02f4f83bafdac7217b3e685'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:38.616055 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-51689af3-0349-4b02-8a3d-a71a1777d0ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dfc8205c02f4f83bafdac7217b3e685'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:38.632105 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1206/2403] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:34:38 2022] DELETE /identity/v3/users/9dfc8205c02f4f83bafdac7217b3e685 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:34:38.966578 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60215c9-609f-4dc5-8f75-73e1bfe48ff3 service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:38.967145 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-e60215c9-609f-4dc5-8f75-73e1bfe48ff3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:38.980842 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60215c9-609f-4dc5-8f75-73e1bfe48ff3 service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:39.039011 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afa20ee-ec64-477a-8d89-ac0f459bb681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:39.039901 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa20ee-ec64-477a-8d89-ac0f459bb681 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:39.040290 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa20ee-ec64-477a-8d89-ac0f459bb681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:39.040574 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa20ee-ec64-477a-8d89-ac0f459bb681 admin admin] PATH_INFO: `/v3/projects/a0889ebfa7d7493ba7e12b13516d4fb7` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:39.043625 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afa20ee-ec64-477a-8d89-ac0f459bb681 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0889ebfa7d7493ba7e12b13516d4fb7)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:39.043848 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afa20ee-ec64-477a-8d89-ac0f459bb681 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:39.045351 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51689af3-0349-4b02-8a3d-a71a1777d0ed admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:39.047816 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-51689af3-0349-4b02-8a3d-a71a1777d0ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:39.070601 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51689af3-0349-4b02-8a3d-a71a1777d0ed admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:39.078190 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaea2dc-5bf1-4120-8594-06bf4e289f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:39.078942 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaea2dc-5bf1-4120-8594-06bf4e289f1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:39.079225 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaea2dc-5bf1-4120-8594-06bf4e289f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:39.079498 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaea2dc-5bf1-4120-8594-06bf4e289f1a admin admin] PATH_INFO: `/v3/projects/e5dec112c56645528cf7b600e0bbb3ce` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:39.080905 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaea2dc-5bf1-4120-8594-06bf4e289f1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5dec112c56645528cf7b600e0bbb3ce)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:39.083734 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaea2dc-5bf1-4120-8594-06bf4e289f1a admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:39.167285 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-6afa20ee-ec64-477a-8d89-ac0f459bb681 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0889ebfa7d7493ba7e12b13516d4fb7', 'request_id': 'req-6afa20ee-ec64-477a-8d89-ac0f459bb681'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:39.172484 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-6afa20ee-ec64-477a-8d89-ac0f459bb681 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0889ebfa7d7493ba7e12b13516d4fb7', 'request_id': 'req-6afa20ee-ec64-477a-8d89-ac0f459bb681'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:39.229185 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-bfaea2dc-5bf1-4120-8594-06bf4e289f1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5dec112c56645528cf7b600e0bbb3ce', 'request_id': 'req-bfaea2dc-5bf1-4120-8594-06bf4e289f1a'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:39.235158 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-bfaea2dc-5bf1-4120-8594-06bf4e289f1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5dec112c56645528cf7b600e0bbb3ce', 'request_id': 'req-bfaea2dc-5bf1-4120-8594-06bf4e289f1a'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:39.241449 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-6afa20ee-ec64-477a-8d89-ac0f459bb681 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0889ebfa7d7493ba7e12b13516d4fb7', 'request_id': 'req-6afa20ee-ec64-477a-8d89-ac0f459bb681'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:39.253038 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-6afa20ee-ec64-477a-8d89-ac0f459bb681 admin admin] The token cache is being invalidate because project a0889ebfa7d7493ba7e12b13516d4fb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:34:39.255651 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-6afa20ee-ec64-477a-8d89-ac0f459bb681 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:39.255651 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-6afa20ee-ec64-477a-8d89-ac0f459bb681 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:39.255651 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1198/2404] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:34:38 2022] DELETE /identity/v3/projects/a0889ebfa7d7493ba7e12b13516d4fb7 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:34:39.260536 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc1825-7091-4ca0-adae-2cce0d5ca67c None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:39.260827 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc1825-7091-4ca0-adae-2cce0d5ca67c None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:39.261093 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc1825-7091-4ca0-adae-2cce0d5ca67c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:39.279144 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-a8fc1825-7091-4ca0-adae-2cce0d5ca67c None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:34:39.280510 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a8fc1825-7091-4ca0-adae-2cce0d5ca67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:39.321472 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-bfaea2dc-5bf1-4120-8594-06bf4e289f1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5dec112c56645528cf7b600e0bbb3ce', 'request_id': 'req-bfaea2dc-5bf1-4120-8594-06bf4e289f1a'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:39.333158 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-bfaea2dc-5bf1-4120-8594-06bf4e289f1a admin admin] The token cache is being invalidate because project e5dec112c56645528cf7b600e0bbb3ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:34:39.333451 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-bfaea2dc-5bf1-4120-8594-06bf4e289f1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:39.334107 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-bfaea2dc-5bf1-4120-8594-06bf4e289f1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:39.335646 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1207/2405] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:34:39 2022] DELETE /identity/v3/projects/e5dec112c56645528cf7b600e0bbb3ce => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:34:39.337358 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1199/2406] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:34:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:34:39.339663 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaea2dc-5bf1-4120-8594-06bf4e289f1a admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:39.340951 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-bfaea2dc-5bf1-4120-8594-06bf4e289f1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:39.344757 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab6381-cdfc-4b22-b347-56981ded11fa None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:39.345049 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab6381-cdfc-4b22-b347-56981ded11fa None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:39.345328 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab6381-cdfc-4b22-b347-56981ded11fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:39.353602 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaea2dc-5bf1-4120-8594-06bf4e289f1a admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:39.358320 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c75efd-f5aa-4c7a-ab27-058faba082a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:39.360264 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c75efd-f5aa-4c7a-ab27-058faba082a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:39.360264 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c75efd-f5aa-4c7a-ab27-058faba082a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:39.360264 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c75efd-f5aa-4c7a-ab27-058faba082a1 admin admin] PATH_INFO: `/v3/users/4d095e8e21d94bcbb49b1559d5550213` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:39.361368 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c75efd-f5aa-4c7a-ab27-058faba082a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d095e8e21d94bcbb49b1559d5550213)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:39.362885 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-2fab6381-cdfc-4b22-b347-56981ded11fa None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:34:39.363320 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c75efd-f5aa-4c7a-ab27-058faba082a1 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:39.364097 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-2fab6381-cdfc-4b22-b347-56981ded11fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:39.372714 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1200/2407] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:34:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:34:39.376761 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab6381-cdfc-4b22-b347-56981ded11fa None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:39.385879 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab6381-cdfc-4b22-b347-56981ded11fa None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:39.391448 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef87d94-8c6d-4c30-8207-20d85f5e3bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:39.392164 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef87d94-8c6d-4c30-8207-20d85f5e3bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:39.392555 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef87d94-8c6d-4c30-8207-20d85f5e3bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:39.392862 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef87d94-8c6d-4c30-8207-20d85f5e3bd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:39.393631 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef87d94-8c6d-4c30-8207-20d85f5e3bd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:34:39.393936 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef87d94-8c6d-4c30-8207-20d85f5e3bd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:39.395630 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef87d94-8c6d-4c30-8207-20d85f5e3bd2 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:39.406882 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1201/2408] 10.222.0.24 () {58 vars in 1152 bytes} [Thu Apr 7 06:34:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:34:39.410944 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef87d94-8c6d-4c30-8207-20d85f5e3bd2 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:39.420635 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef87d94-8c6d-4c30-8207-20d85f5e3bd2 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:39.425308 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4440607-5766-4d81-84a2-370aeb024f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:39.425911 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4440607-5766-4d81-84a2-370aeb024f0f admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:39.426194 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4440607-5766-4d81-84a2-370aeb024f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:39.426465 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4440607-5766-4d81-84a2-370aeb024f0f admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:39.427128 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4440607-5766-4d81-84a2-370aeb024f0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:39.429013 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4440607-5766-4d81-84a2-370aeb024f0f admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:39.558743 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1202/2409] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:34:39 2022] POST /identity/v3/projects => generated 373 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:34:39.563179 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4440607-5766-4d81-84a2-370aeb024f0f admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:39.624301 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4440607-5766-4d81-84a2-370aeb024f0f admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:39.628982 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112184fb-c055-4f36-a43c-175f5d45d375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:39.629656 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112184fb-c055-4f36-a43c-175f5d45d375 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:39.629940 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112184fb-c055-4f36-a43c-175f5d45d375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:39.630216 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112184fb-c055-4f36-a43c-175f5d45d375 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:39.630899 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112184fb-c055-4f36-a43c-175f5d45d375 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:39.632855 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112184fb-c055-4f36-a43c-175f5d45d375 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:39.639078 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-47c75efd-f5aa-4c7a-ab27-058faba082a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d095e8e21d94bcbb49b1559d5550213'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:39.650724 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-47c75efd-f5aa-4c7a-ab27-058faba082a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d095e8e21d94bcbb49b1559d5550213'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:39.728286 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1203/2410] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:34:39 2022] POST /identity/v3/users => generated 287 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:34:39.733162 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112184fb-c055-4f36-a43c-175f5d45d375 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:39.740262 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-47c75efd-f5aa-4c7a-ab27-058faba082a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d095e8e21d94bcbb49b1559d5550213'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:39.744665 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-47c75efd-f5aa-4c7a-ab27-058faba082a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d095e8e21d94bcbb49b1559d5550213'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:39.744665 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-47c75efd-f5aa-4c7a-ab27-058faba082a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d095e8e21d94bcbb49b1559d5550213'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:39.744894 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112184fb-c055-4f36-a43c-175f5d45d375 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:39.748711 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d644b-b470-4a9c-a977-a28c298bb14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:39.749338 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d644b-b470-4a9c-a977-a28c298bb14f admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:39.749626 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d644b-b470-4a9c-a977-a28c298bb14f admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:39.749933 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d644b-b470-4a9c-a977-a28c298bb14f admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:39.750662 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000d644b-b470-4a9c-a977-a28c298bb14f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:39.752372 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000d644b-b470-4a9c-a977-a28c298bb14f admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:39.755666 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1208/2411] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:34:39 2022] DELETE /identity/v3/users/4d095e8e21d94bcbb49b1559d5550213 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:34:39.771840 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1204/2412] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:34:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 07 06:34:39.773578 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c75efd-f5aa-4c7a-ab27-058faba082a1 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:39.775417 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-47c75efd-f5aa-4c7a-ab27-058faba082a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:39.846434 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c75efd-f5aa-4c7a-ab27-058faba082a1 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:39.851255 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81837c8e-6d6f-403d-9dd3-e7557519ec9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:39.851977 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81837c8e-6d6f-403d-9dd3-e7557519ec9f admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:39.852269 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81837c8e-6d6f-403d-9dd3-e7557519ec9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:39.852552 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81837c8e-6d6f-403d-9dd3-e7557519ec9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:39.853287 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81837c8e-6d6f-403d-9dd3-e7557519ec9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:39.854879 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81837c8e-6d6f-403d-9dd3-e7557519ec9f admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:39.865660 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1209/2413] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:34:39 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:34:39.869973 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d644b-b470-4a9c-a977-a28c298bb14f admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:39.880083 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d644b-b470-4a9c-a977-a28c298bb14f admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:39.885054 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2845a5-9486-4e4a-a8ab-5d0b0eba2bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:39.885939 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2845a5-9486-4e4a-a8ab-5d0b0eba2bfb admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:39.886227 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2845a5-9486-4e4a-a8ab-5d0b0eba2bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:39.886510 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2845a5-9486-4e4a-a8ab-5d0b0eba2bfb admin admin] PATH_INFO: `/v3/projects/05f84b542fb146608e257ab7edf1d6e5/users/837a682e15e043afaccb08fe5a8b9d0a/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:39.901182 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2845a5-9486-4e4a-a8ab-5d0b0eba2bfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=05f84b542fb146608e257ab7edf1d6e5, user_id=837a682e15e043afaccb08fe5a8b9d0a, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:39.904757 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2845a5-9486-4e4a-a8ab-5d0b0eba2bfb admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:39.991646 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1205/2414] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:34:39 2022] PUT /identity/v3/projects/05f84b542fb146608e257ab7edf1d6e5/users/837a682e15e043afaccb08fe5a8b9d0a/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:34:40.002577 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c314c31f-cef8-4765-a463-f8ee0561a7e4 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:40.002910 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c314c31f-cef8-4765-a463-f8ee0561a7e4 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:40.003158 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c314c31f-cef8-4765-a463-f8ee0561a7e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:40.031456 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-c314c31f-cef8-4765-a463-f8ee0561a7e4 None None] MFA Rules not processed for user `837a682e15e043afaccb08fe5a8b9d0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:34:40.032688 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c314c31f-cef8-4765-a463-f8ee0561a7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:40.095097 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1210/2415] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:34:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:34:40.106975 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2845a5-9486-4e4a-a8ab-5d0b0eba2bfb admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:40.108782 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-4c2845a5-9486-4e4a-a8ab-5d0b0eba2bfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:40.190193 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2845a5-9486-4e4a-a8ab-5d0b0eba2bfb admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:40.195764 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bd3edf-32e9-468e-b2e7-5f3898938e60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cd81f6620f410db450871fb29961f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:40.196425 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd3edf-32e9-468e-b2e7-5f3898938e60 service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:40.196712 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd3edf-32e9-468e-b2e7-5f3898938e60 service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:40.196990 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd3edf-32e9-468e-b2e7-5f3898938e60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:40.205099 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bd3edf-32e9-468e-b2e7-5f3898938e60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:40.206679 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bd3edf-32e9-468e-b2e7-5f3898938e60 service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:40.216019 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1206/2416] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:34:40 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:34:40.256453 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c314c31f-cef8-4765-a463-f8ee0561a7e4 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:40.257874 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c314c31f-cef8-4765-a463-f8ee0561a7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:40.326874 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c314c31f-cef8-4765-a463-f8ee0561a7e4 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:40.331615 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7fc1cb-405c-4465-88bd-0860357cecab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:40.332544 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7fc1cb-405c-4465-88bd-0860357cecab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:40.332830 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7fc1cb-405c-4465-88bd-0860357cecab admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:40.333130 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7fc1cb-405c-4465-88bd-0860357cecab admin admin] PATH_INFO: `/v3/projects/48f12034a81c4076b4240ba285545d9b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:40.334316 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7fc1cb-405c-4465-88bd-0860357cecab admin admin] RBAC: Authorizing `identity:delete_project(project_id=48f12034a81c4076b4240ba285545d9b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:40.336274 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7fc1cb-405c-4465-88bd-0860357cecab admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:40.408829 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bd3edf-32e9-468e-b2e7-5f3898938e60 service nova] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:40.420773 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bd3edf-32e9-468e-b2e7-5f3898938e60 service nova] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:40.431581 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-0c7fc1cb-405c-4465-88bd-0860357cecab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48f12034a81c4076b4240ba285545d9b', 'request_id': 'req-0c7fc1cb-405c-4465-88bd-0860357cecab'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:40.437889 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-0c7fc1cb-405c-4465-88bd-0860357cecab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48f12034a81c4076b4240ba285545d9b', 'request_id': 'req-0c7fc1cb-405c-4465-88bd-0860357cecab'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:40.474923 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5588f191-9908-4ad9-8ef9-e6b67a4f2478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:40.475821 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5588f191-9908-4ad9-8ef9-e6b67a4f2478 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:40.476107 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5588f191-9908-4ad9-8ef9-e6b67a4f2478 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:40.476381 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5588f191-9908-4ad9-8ef9-e6b67a4f2478 admin admin] PATH_INFO: `/v3/users/837a682e15e043afaccb08fe5a8b9d0a` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:40.477576 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5588f191-9908-4ad9-8ef9-e6b67a4f2478 admin admin] RBAC: Authorizing `identity:delete_user(user_id=837a682e15e043afaccb08fe5a8b9d0a)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:40.479470 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5588f191-9908-4ad9-8ef9-e6b67a4f2478 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:40.505583 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-0c7fc1cb-405c-4465-88bd-0860357cecab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48f12034a81c4076b4240ba285545d9b', 'request_id': 'req-0c7fc1cb-405c-4465-88bd-0860357cecab'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:40.516890 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-0c7fc1cb-405c-4465-88bd-0860357cecab admin admin] The token cache is being invalidate because project 48f12034a81c4076b4240ba285545d9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:34:40.517193 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-0c7fc1cb-405c-4465-88bd-0860357cecab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:40.517834 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-0c7fc1cb-405c-4465-88bd-0860357cecab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:40.519378 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1211/2417] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:34:40 2022] DELETE /identity/v3/projects/48f12034a81c4076b4240ba285545d9b => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:34:40.524077 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a6013-370e-4bbf-b47c-1e77a0053e3e None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:40.524371 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a6013-370e-4bbf-b47c-1e77a0053e3e None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:40.524654 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a6013-370e-4bbf-b47c-1e77a0053e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:40.542004 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-d23a6013-370e-4bbf-b47c-1e77a0053e3e None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:34:40.543188 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d23a6013-370e-4bbf-b47c-1e77a0053e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:40.551279 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1212/2418] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:34:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:34:40.558587 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb8402-a1fb-4ba8-a3c0-4ef2e3c215ce None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:40.559378 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb8402-a1fb-4ba8-a3c0-4ef2e3c215ce None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:40.559671 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb8402-a1fb-4ba8-a3c0-4ef2e3c215ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:40.577354 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-6cbb8402-a1fb-4ba8-a3c0-4ef2e3c215ce None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:34:40.578511 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-6cbb8402-a1fb-4ba8-a3c0-4ef2e3c215ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:40.586722 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1213/2419] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:34:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:34:40.590732 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb8402-a1fb-4ba8-a3c0-4ef2e3c215ce None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:40.599449 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb8402-a1fb-4ba8-a3c0-4ef2e3c215ce None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:40.604308 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f5ee9-9098-4981-b6a3-6e119b164baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:40.604956 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f5ee9-9098-4981-b6a3-6e119b164baa admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:40.605260 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f5ee9-9098-4981-b6a3-6e119b164baa admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:40.605515 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f5ee9-9098-4981-b6a3-6e119b164baa admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:40.606489 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2f5ee9-9098-4981-b6a3-6e119b164baa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:34:40.606808 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2f5ee9-9098-4981-b6a3-6e119b164baa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:40.608475 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2f5ee9-9098-4981-b6a3-6e119b164baa admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:40.623512 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1214/2420] 10.222.0.24 () {58 vars in 1152 bytes} [Thu Apr 7 06:34:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:34:40.625197 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f5ee9-9098-4981-b6a3-6e119b164baa admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:40.634660 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f5ee9-9098-4981-b6a3-6e119b164baa admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:40.640475 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3177b6f-b094-4137-8a8b-de1820687b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:40.641259 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3177b6f-b094-4137-8a8b-de1820687b78 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:40.641546 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3177b6f-b094-4137-8a8b-de1820687b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:40.641830 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3177b6f-b094-4137-8a8b-de1820687b78 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:40.642519 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3177b6f-b094-4137-8a8b-de1820687b78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:40.644505 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3177b6f-b094-4137-8a8b-de1820687b78 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:40.700638 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-5588f191-9908-4ad9-8ef9-e6b67a4f2478 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '837a682e15e043afaccb08fe5a8b9d0a'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:40.701378 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-5588f191-9908-4ad9-8ef9-e6b67a4f2478 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '837a682e15e043afaccb08fe5a8b9d0a'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:40.711892 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1215/2421] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:34:40 2022] POST /identity/v3/projects => generated 383 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:34:40.716005 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3177b6f-b094-4137-8a8b-de1820687b78 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:40.774188 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3177b6f-b094-4137-8a8b-de1820687b78 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:40.778811 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61ac035-2877-402c-a61c-cadc09782622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:40.779477 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ac035-2877-402c-a61c-cadc09782622 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:40.779784 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ac035-2877-402c-a61c-cadc09782622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:40.780067 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ac035-2877-402c-a61c-cadc09782622 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:40.780752 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61ac035-2877-402c-a61c-cadc09782622 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:40.782658 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61ac035-2877-402c-a61c-cadc09782622 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:40.785045 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-5588f191-9908-4ad9-8ef9-e6b67a4f2478 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '837a682e15e043afaccb08fe5a8b9d0a'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:40.785648 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-5588f191-9908-4ad9-8ef9-e6b67a4f2478 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '837a682e15e043afaccb08fe5a8b9d0a'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:40.799020 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-5588f191-9908-4ad9-8ef9-e6b67a4f2478 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '837a682e15e043afaccb08fe5a8b9d0a'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:40.811982 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1207/2422] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:34:40 2022] DELETE /identity/v3/users/837a682e15e043afaccb08fe5a8b9d0a => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:34:40.816275 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa464839-c352-416e-aab8-73b079d77e09 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:40.816572 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa464839-c352-416e-aab8-73b079d77e09 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:40.816860 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa464839-c352-416e-aab8-73b079d77e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:40.833768 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-aa464839-c352-416e-aab8-73b079d77e09 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:34:40.834963 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-aa464839-c352-416e-aab8-73b079d77e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:40.860549 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1216/2423] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:34:40 2022] POST /identity/v3/users => generated 292 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:34:40.864429 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61ac035-2877-402c-a61c-cadc09782622 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:40.866227 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c61ac035-2877-402c-a61c-cadc09782622 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:40.878438 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61ac035-2877-402c-a61c-cadc09782622 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:40.893025 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1208/2424] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:34:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:34:40.902942 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa464839-c352-416e-aab8-73b079d77e09 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:40.904352 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-aa464839-c352-416e-aab8-73b079d77e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:40.933583 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3ef94-6567-425b-b6af-08ef28d0b4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:40.934977 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3ef94-6567-425b-b6af-08ef28d0b4c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:40.935406 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3ef94-6567-425b-b6af-08ef28d0b4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:40.935695 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3ef94-6567-425b-b6af-08ef28d0b4c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:40.936552 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba3ef94-6567-425b-b6af-08ef28d0b4c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:40.938218 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba3ef94-6567-425b-b6af-08ef28d0b4c4 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:40.948043 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1217/2425] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:34:40 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 07 06:34:40.951870 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3ef94-6567-425b-b6af-08ef28d0b4c4 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:40.960692 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa464839-c352-416e-aab8-73b079d77e09 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:40.961096 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3ef94-6567-425b-b6af-08ef28d0b4c4 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:40.964267 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4e3fce-7bd9-43b2-9327-db0fac817624 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:40.964931 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e3fce-7bd9-43b2-9327-db0fac817624 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:40.965264 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e3fce-7bd9-43b2-9327-db0fac817624 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:40.965561 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e3fce-7bd9-43b2-9327-db0fac817624 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:40.965772 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb4af5d-842a-4b96-9596-b77d3ba285a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:40.966380 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4af5d-842a-4b96-9596-b77d3ba285a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:40.966671 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4af5d-842a-4b96-9596-b77d3ba285a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:40.966952 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4af5d-842a-4b96-9596-b77d3ba285a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:40.967663 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb4af5d-842a-4b96-9596-b77d3ba285a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:40.969249 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb4af5d-842a-4b96-9596-b77d3ba285a6 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:40.974463 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4e3fce-7bd9-43b2-9327-db0fac817624 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:40.975906 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4e3fce-7bd9-43b2-9327-db0fac817624 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:40.979093 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1218/2426] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:34:40 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 07 06:34:40.983514 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb4af5d-842a-4b96-9596-b77d3ba285a6 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:40.986036 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1209/2427] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:34:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 07 06:34:40.995398 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb4af5d-842a-4b96-9596-b77d3ba285a6 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:41.000685 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f2d697-d24a-4d28-bc65-1521f2b37d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:41.001586 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2d697-d24a-4d28-bc65-1521f2b37d8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:41.001872 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2d697-d24a-4d28-bc65-1521f2b37d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:41.002270 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2d697-d24a-4d28-bc65-1521f2b37d8c admin admin] PATH_INFO: `/v3/projects/5c6ae4e865264b53829d40c5c2ef815b/users/96f16fe07e914491a1a810f2cc996989/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:41.016593 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f2d697-d24a-4d28-bc65-1521f2b37d8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c6ae4e865264b53829d40c5c2ef815b, user_id=96f16fe07e914491a1a810f2cc996989, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:41.019256 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f2d697-d24a-4d28-bc65-1521f2b37d8c admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:41.128737 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1219/2428] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:34:40 2022] PUT /identity/v3/projects/5c6ae4e865264b53829d40c5c2ef815b/users/96f16fe07e914491a1a810f2cc996989/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:34:41.139079 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968453dc-239f-4511-9df1-01ca53e4ccc9 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:41.139560 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968453dc-239f-4511-9df1-01ca53e4ccc9 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:41.139657 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968453dc-239f-4511-9df1-01ca53e4ccc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:41.165660 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-968453dc-239f-4511-9df1-01ca53e4ccc9 None None] MFA Rules not processed for user `96f16fe07e914491a1a810f2cc996989`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:34:41.166829 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-968453dc-239f-4511-9df1-01ca53e4ccc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:41.244853 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1210/2429] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:34:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:34:41.249889 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f2d697-d24a-4d28-bc65-1521f2b37d8c admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:41.313070 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f2d697-d24a-4d28-bc65-1521f2b37d8c admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:41.317952 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bfab7f-d9b7-423d-b801-6aa97c37b124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:41.318616 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bfab7f-d9b7-423d-b801-6aa97c37b124 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:41.318904 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bfab7f-d9b7-423d-b801-6aa97c37b124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:41.319183 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bfab7f-d9b7-423d-b801-6aa97c37b124 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:41.319953 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bfab7f-d9b7-423d-b801-6aa97c37b124 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:41.321892 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bfab7f-d9b7-423d-b801-6aa97c37b124 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:41.370438 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968453dc-239f-4511-9df1-01ca53e4ccc9 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:41.372010 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-968453dc-239f-4511-9df1-01ca53e4ccc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:41.386526 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968453dc-239f-4511-9df1-01ca53e4ccc9 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:41.391207 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab5e43a-276b-4ab3-8638-531923a898a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:41.392187 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5e43a-276b-4ab3-8638-531923a898a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:41.392435 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5e43a-276b-4ab3-8638-531923a898a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:41.392718 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5e43a-276b-4ab3-8638-531923a898a2 admin admin] PATH_INFO: `/v3/projects/05f84b542fb146608e257ab7edf1d6e5` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:41.394040 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab5e43a-276b-4ab3-8638-531923a898a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05f84b542fb146608e257ab7edf1d6e5)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:41.396169 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab5e43a-276b-4ab3-8638-531923a898a2 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:41.406673 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1220/2430] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:34:41 2022] POST /identity/v3/projects => generated 383 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:34:41.410738 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bfab7f-d9b7-423d-b801-6aa97c37b124 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:41.470887 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bfab7f-d9b7-423d-b801-6aa97c37b124 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:41.475703 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b61734-15ec-4a0a-88de-0599d040fe7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:41.476406 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b61734-15ec-4a0a-88de-0599d040fe7e admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:41.476807 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b61734-15ec-4a0a-88de-0599d040fe7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:41.477094 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b61734-15ec-4a0a-88de-0599d040fe7e admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:41.477787 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b61734-15ec-4a0a-88de-0599d040fe7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:41.479859 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b61734-15ec-4a0a-88de-0599d040fe7e admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:41.495258 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-cab5e43a-276b-4ab3-8638-531923a898a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05f84b542fb146608e257ab7edf1d6e5', 'request_id': 'req-cab5e43a-276b-4ab3-8638-531923a898a2'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:41.500733 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-cab5e43a-276b-4ab3-8638-531923a898a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05f84b542fb146608e257ab7edf1d6e5', 'request_id': 'req-cab5e43a-276b-4ab3-8638-531923a898a2'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:41.551187 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1221/2431] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:34:41 2022] POST /identity/v3/users => generated 298 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:34:41.555145 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b61734-15ec-4a0a-88de-0599d040fe7e admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:41.562688 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-cab5e43a-276b-4ab3-8638-531923a898a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05f84b542fb146608e257ab7edf1d6e5', 'request_id': 'req-cab5e43a-276b-4ab3-8638-531923a898a2'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:41.564755 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b61734-15ec-4a0a-88de-0599d040fe7e admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:41.573966 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-cab5e43a-276b-4ab3-8638-531923a898a2 admin admin] The token cache is being invalidate because project 05f84b542fb146608e257ab7edf1d6e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:34:41.574263 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-cab5e43a-276b-4ab3-8638-531923a898a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:41.574929 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-cab5e43a-276b-4ab3-8638-531923a898a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:41.576539 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1211/2432] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:34:41 2022] DELETE /identity/v3/projects/05f84b542fb146608e257ab7edf1d6e5 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:34:41.581220 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89819d-f320-4d67-9a9a-95ef4a75a184 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:41.581608 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89819d-f320-4d67-9a9a-95ef4a75a184 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:41.581960 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89819d-f320-4d67-9a9a-95ef4a75a184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:41.600733 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-1e89819d-f320-4d67-9a9a-95ef4a75a184 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:34:41.601996 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-1e89819d-f320-4d67-9a9a-95ef4a75a184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:41.621881 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cbefaa-4f3c-42b1-9c21-29f6bf0f2b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:41.622556 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cbefaa-4f3c-42b1-9c21-29f6bf0f2b83 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:41.622847 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cbefaa-4f3c-42b1-9c21-29f6bf0f2b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:41.623290 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cbefaa-4f3c-42b1-9c21-29f6bf0f2b83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:41.624052 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cbefaa-4f3c-42b1-9c21-29f6bf0f2b83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:41.625653 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cbefaa-4f3c-42b1-9c21-29f6bf0f2b83 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:41.635223 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1222/2433] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:34:41 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 07 06:34:41.639996 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cbefaa-4f3c-42b1-9c21-29f6bf0f2b83 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:41.641718 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d7cbefaa-4f3c-42b1-9c21-29f6bf0f2b83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:41.655190 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cbefaa-4f3c-42b1-9c21-29f6bf0f2b83 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:41.660739 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9bf04e-50ce-4583-b405-6f333638a80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:41.661680 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9bf04e-50ce-4583-b405-6f333638a80b admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:41.661911 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9bf04e-50ce-4583-b405-6f333638a80b admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:41.662274 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9bf04e-50ce-4583-b405-6f333638a80b admin admin] PATH_INFO: `/v3/projects/014c57bae5f643eb809abce0ecf87749/users/5f93f51d75c548bba99d94ca8e9fcf94/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:41.664423 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1212/2434] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:34:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:34:41.672270 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1453e2e-f53d-478d-8693-452ceeb528b8 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:41.672692 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1453e2e-f53d-478d-8693-452ceeb528b8 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:41.672997 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1453e2e-f53d-478d-8693-452ceeb528b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:41.680857 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9bf04e-50ce-4583-b405-6f333638a80b admin admin] RBAC: Authorizing `identity:create_grant(project_id=014c57bae5f643eb809abce0ecf87749, user_id=5f93f51d75c548bba99d94ca8e9fcf94, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:41.683530 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9bf04e-50ce-4583-b405-6f333638a80b admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:41.691627 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-f1453e2e-f53d-478d-8693-452ceeb528b8 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:34:41.692857 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-f1453e2e-f53d-478d-8693-452ceeb528b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:41.701414 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1213/2435] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:34:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:34:41.705592 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1453e2e-f53d-478d-8693-452ceeb528b8 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:41.714213 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1453e2e-f53d-478d-8693-452ceeb528b8 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:41.719365 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2375690-62e5-4241-b353-119b44342548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:41.720027 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2375690-62e5-4241-b353-119b44342548 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:41.720319 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2375690-62e5-4241-b353-119b44342548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:41.720599 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2375690-62e5-4241-b353-119b44342548 admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:41.721372 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2375690-62e5-4241-b353-119b44342548 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:34:41.721636 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2375690-62e5-4241-b353-119b44342548 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:41.723273 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2375690-62e5-4241-b353-119b44342548 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:41.734387 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1214/2436] 10.222.0.24 () {58 vars in 1152 bytes} [Thu Apr 7 06:34:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:34:41.744598 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2375690-62e5-4241-b353-119b44342548 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:41.753957 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2375690-62e5-4241-b353-119b44342548 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:41.758537 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d239c-3cad-4447-add1-3524b22a514b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:41.759224 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d239c-3cad-4447-add1-3524b22a514b admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:41.759537 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d239c-3cad-4447-add1-3524b22a514b admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:41.759927 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d239c-3cad-4447-add1-3524b22a514b admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:41.760578 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076d239c-3cad-4447-add1-3524b22a514b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:41.763059 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076d239c-3cad-4447-add1-3524b22a514b admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:41.771287 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1223/2437] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:34:41 2022] PUT /identity/v3/projects/014c57bae5f643eb809abce0ecf87749/users/5f93f51d75c548bba99d94ca8e9fcf94/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:34:41.775829 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9bf04e-50ce-4583-b405-6f333638a80b admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:41.835951 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9bf04e-50ce-4583-b405-6f333638a80b admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:41.841221 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21efd498-3802-4680-bac6-fae22ba8b362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:41.841892 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efd498-3802-4680-bac6-fae22ba8b362 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:41.842176 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efd498-3802-4680-bac6-fae22ba8b362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:41.842454 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efd498-3802-4680-bac6-fae22ba8b362 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:41.843181 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21efd498-3802-4680-bac6-fae22ba8b362 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:41.844806 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21efd498-3802-4680-bac6-fae22ba8b362 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:41.857794 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1224/2438] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:34:41 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:34:41.858489 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21efd498-3802-4680-bac6-fae22ba8b362 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:41.861605 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1215/2439] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:34:41 2022] POST /identity/v3/projects => generated 373 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:34:41.867979 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21efd498-3802-4680-bac6-fae22ba8b362 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:41.868135 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d239c-3cad-4447-add1-3524b22a514b admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:41.924403 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055e0b1-b835-4891-8557-85cbe7f5aa83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:41.926019 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055e0b1-b835-4891-8557-85cbe7f5aa83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:41.926315 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055e0b1-b835-4891-8557-85cbe7f5aa83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:41.926592 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055e0b1-b835-4891-8557-85cbe7f5aa83 admin admin] PATH_INFO: `/v3/projects/014c57bae5f643eb809abce0ecf87749/users/5f93f51d75c548bba99d94ca8e9fcf94/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:41.928418 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d239c-3cad-4447-add1-3524b22a514b admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:41.928650 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8055e0b1-b835-4891-8557-85cbe7f5aa83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=014c57bae5f643eb809abce0ecf87749, user_id=5f93f51d75c548bba99d94ca8e9fcf94, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:41.932084 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8055e0b1-b835-4891-8557-85cbe7f5aa83 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:41.933182 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41df9995-9d58-4cf8-a797-9851a0acae7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:41.933917 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df9995-9d58-4cf8-a797-9851a0acae7d admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:41.934239 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df9995-9d58-4cf8-a797-9851a0acae7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:41.934508 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df9995-9d58-4cf8-a797-9851a0acae7d admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:41.935192 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41df9995-9d58-4cf8-a797-9851a0acae7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:41.937178 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41df9995-9d58-4cf8-a797-9851a0acae7d admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:41.942674 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1225/2440] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:34:41 2022] PUT /identity/v3/projects/014c57bae5f643eb809abce0ecf87749/users/5f93f51d75c548bba99d94ca8e9fcf94/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:34:41.954497 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441b7d6-b6a4-4496-935c-ee75d1588fb3 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:41.954790 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441b7d6-b6a4-4496-935c-ee75d1588fb3 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:41.955101 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441b7d6-b6a4-4496-935c-ee75d1588fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:41.981349 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-c441b7d6-b6a4-4496-935c-ee75d1588fb3 None None] MFA Rules not processed for user `5f93f51d75c548bba99d94ca8e9fcf94`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:34:41.982617 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c441b7d6-b6a4-4496-935c-ee75d1588fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:42.053098 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1226/2441] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:34:41 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:34:42.057983 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1216/2442] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:34:41 2022] POST /identity/v3/users => generated 287 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:34:42.059446 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441b7d6-b6a4-4496-935c-ee75d1588fb3 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:42.066172 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41df9995-9d58-4cf8-a797-9851a0acae7d admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:42.068111 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-41df9995-9d58-4cf8-a797-9851a0acae7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:42.123478 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441b7d6-b6a4-4496-935c-ee75d1588fb3 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:42.125332 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41df9995-9d58-4cf8-a797-9851a0acae7d admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:42.128458 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa4615-fc62-4d46-8914-dd8a471bd5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:42.129130 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa4615-fc62-4d46-8914-dd8a471bd5ce admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:42.129413 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa4615-fc62-4d46-8914-dd8a471bd5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:42.129692 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa4615-fc62-4d46-8914-dd8a471bd5ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:42.130417 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfa4615-fc62-4d46-8914-dd8a471bd5ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:42.132201 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfa4615-fc62-4d46-8914-dd8a471bd5ce admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:42.142588 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1227/2443] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:34:42 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 07 06:34:42.146531 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa4615-fc62-4d46-8914-dd8a471bd5ce admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:42.159420 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa4615-fc62-4d46-8914-dd8a471bd5ce admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:42.164280 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b07b27c-c52c-488d-941d-e9fcd68a2a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:42.164932 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b07b27c-c52c-488d-941d-e9fcd68a2a3d admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:42.165218 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b07b27c-c52c-488d-941d-e9fcd68a2a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:42.165499 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b07b27c-c52c-488d-941d-e9fcd68a2a3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:42.166285 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b07b27c-c52c-488d-941d-e9fcd68a2a3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:42.167881 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b07b27c-c52c-488d-941d-e9fcd68a2a3d admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:42.174852 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed8ca95-0787-41b7-ab31-1702e5b8c12e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:42.175511 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8ca95-0787-41b7-ab31-1702e5b8c12e service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:42.175835 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8ca95-0787-41b7-ab31-1702e5b8c12e service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:42.176114 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8ca95-0787-41b7-ab31-1702e5b8c12e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:42.178819 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1228/2444] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:34:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 07 06:34:42.182871 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b07b27c-c52c-488d-941d-e9fcd68a2a3d admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:42.188919 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed8ca95-0787-41b7-ab31-1702e5b8c12e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:42.190370 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed8ca95-0787-41b7-ab31-1702e5b8c12e service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:42.193021 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b07b27c-c52c-488d-941d-e9fcd68a2a3d admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:42.197948 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e927960-6648-4e9a-b7c2-bd6a5931c88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:42.198809 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e927960-6648-4e9a-b7c2-bd6a5931c88b admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:42.200653 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e927960-6648-4e9a-b7c2-bd6a5931c88b admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:42.200653 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e927960-6648-4e9a-b7c2-bd6a5931c88b admin admin] PATH_INFO: `/v3/projects/5eb854cd45db49a599036bad33e0edd1/users/815860efc3ca437497bf0722ad539e02/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:42.200925 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1217/2445] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:34:42 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 07 06:34:42.217047 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e927960-6648-4e9a-b7c2-bd6a5931c88b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eb854cd45db49a599036bad33e0edd1, user_id=815860efc3ca437497bf0722ad539e02, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:42.219707 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e927960-6648-4e9a-b7c2-bd6a5931c88b admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:42.323225 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1229/2446] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:34:42 2022] PUT /identity/v3/projects/5eb854cd45db49a599036bad33e0edd1/users/815860efc3ca437497bf0722ad539e02/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:34:42.335011 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba3b10-4750-4ff4-9302-9337c40ed074 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:42.335307 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba3b10-4750-4ff4-9302-9337c40ed074 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:42.335591 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba3b10-4750-4ff4-9302-9337c40ed074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:42.364146 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-f4ba3b10-4750-4ff4-9302-9337c40ed074 None None] MFA Rules not processed for user `815860efc3ca437497bf0722ad539e02`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:34:42.365629 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-f4ba3b10-4750-4ff4-9302-9337c40ed074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:42.371975 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e927960-6648-4e9a-b7c2-bd6a5931c88b admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:42.371975 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-2e927960-6648-4e9a-b7c2-bd6a5931c88b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:42.431639 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e927960-6648-4e9a-b7c2-bd6a5931c88b admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:42.436488 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1218/2447] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:34:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:34:42.437440 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b237d98-1d0c-4830-af01-6cfb601cb020 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:42.437639 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba3b10-4750-4ff4-9302-9337c40ed074 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:42.438108 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b237d98-1d0c-4830-af01-6cfb601cb020 service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:42.438398 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b237d98-1d0c-4830-af01-6cfb601cb020 service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:42.438680 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b237d98-1d0c-4830-af01-6cfb601cb020 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:42.440502 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-8b237d98-1d0c-4830-af01-6cfb601cb020 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:42.500806 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba3b10-4750-4ff4-9302-9337c40ed074 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:42.503501 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b237d98-1d0c-4830-af01-6cfb601cb020 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:42.505118 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b237d98-1d0c-4830-af01-6cfb601cb020 service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:42.506162 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f96314d-58b9-4af8-b313-81d1fae6b936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:42.506969 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96314d-58b9-4af8-b313-81d1fae6b936 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:42.507265 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96314d-58b9-4af8-b313-81d1fae6b936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:42.507551 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96314d-58b9-4af8-b313-81d1fae6b936 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:42.509261 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f96314d-58b9-4af8-b313-81d1fae6b936 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:42.511184 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f96314d-58b9-4af8-b313-81d1fae6b936 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:42.516733 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1230/2448] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:34:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 07 06:34:42.649213 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1219/2449] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:34:42 2022] POST /identity/v3/projects => generated 373 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:34:42.653150 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b237d98-1d0c-4830-af01-6cfb601cb020 service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:42.664187 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b237d98-1d0c-4830-af01-6cfb601cb020 service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:42.728403 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d9c4a8-9baa-42f9-8fb5-f938371f465f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:42.729179 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d9c4a8-9baa-42f9-8fb5-f938371f465f admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:42.729542 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d9c4a8-9baa-42f9-8fb5-f938371f465f admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:42.729898 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d9c4a8-9baa-42f9-8fb5-f938371f465f admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:42.731372 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d9c4a8-9baa-42f9-8fb5-f938371f465f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:42.733609 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d9c4a8-9baa-42f9-8fb5-f938371f465f admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:42.814228 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1231/2450] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:34:42 2022] POST /identity/v3/users => generated 293 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:34:42.818216 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f96314d-58b9-4af8-b313-81d1fae6b936 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:42.828478 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f96314d-58b9-4af8-b313-81d1fae6b936 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:42.833185 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2c547f-a480-4e74-b9d4-919f92ca8150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:42.833845 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c547f-a480-4e74-b9d4-919f92ca8150 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:42.834137 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c547f-a480-4e74-b9d4-919f92ca8150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:42.834419 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c547f-a480-4e74-b9d4-919f92ca8150 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:42.835158 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2c547f-a480-4e74-b9d4-919f92ca8150 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:42.836951 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2c547f-a480-4e74-b9d4-919f92ca8150 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:42.848182 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1220/2451] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:34:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 07 06:34:42.857918 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d9c4a8-9baa-42f9-8fb5-f938371f465f admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:42.863313 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d9c4a8-9baa-42f9-8fb5-f938371f465f admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:42.868521 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce79bcdb-024a-446c-8bbc-fc5fcfd25257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:42.869415 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79bcdb-024a-446c-8bbc-fc5fcfd25257 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:42.869704 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79bcdb-024a-446c-8bbc-fc5fcfd25257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:42.869984 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79bcdb-024a-446c-8bbc-fc5fcfd25257 admin admin] PATH_INFO: `/v3/projects/17388aa054d04a94838b0e9da713924a/users/e80d3961964b4847aa12d3f6e9adb96a/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:42.885168 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce79bcdb-024a-446c-8bbc-fc5fcfd25257 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17388aa054d04a94838b0e9da713924a, user_id=e80d3961964b4847aa12d3f6e9adb96a, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:42.888014 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce79bcdb-024a-446c-8bbc-fc5fcfd25257 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:42.976007 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1232/2452] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:34:42 2022] PUT /identity/v3/projects/17388aa054d04a94838b0e9da713924a/users/e80d3961964b4847aa12d3f6e9adb96a/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:34:42.979998 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2c547f-a480-4e74-b9d4-919f92ca8150 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:42.988475 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce79bcdb-024a-446c-8bbc-fc5fcfd25257 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:42.993818 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2c547f-a480-4e74-b9d4-919f92ca8150 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:43.051002 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce79bcdb-024a-446c-8bbc-fc5fcfd25257 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:43.052372 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168431f-99ed-4667-a8d1-370e8216dcc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:43.052985 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168431f-99ed-4667-a8d1-370e8216dcc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:43.053268 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168431f-99ed-4667-a8d1-370e8216dcc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:43.053663 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168431f-99ed-4667-a8d1-370e8216dcc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:43.054765 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3168431f-99ed-4667-a8d1-370e8216dcc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:43.056180 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1c3aec-6127-4647-bc73-ca4bc482e8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:43.056423 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3168431f-99ed-4667-a8d1-370e8216dcc2 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:43.057082 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c3aec-6127-4647-bc73-ca4bc482e8ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:43.057369 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c3aec-6127-4647-bc73-ca4bc482e8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:43.057655 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c3aec-6127-4647-bc73-ca4bc482e8ca admin admin] PATH_INFO: `/v3/users/96f16fe07e914491a1a810f2cc996989` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:43.059406 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1c3aec-6127-4647-bc73-ca4bc482e8ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=96f16fe07e914491a1a810f2cc996989)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:43.061371 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1c3aec-6127-4647-bc73-ca4bc482e8ca admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:43.067319 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1221/2453] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:34:42 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 07 06:34:43.071482 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168431f-99ed-4667-a8d1-370e8216dcc2 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:43.081866 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168431f-99ed-4667-a8d1-370e8216dcc2 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:43.087733 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f249a1d-e489-4439-ac43-621fbf7d28aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:43.088449 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f249a1d-e489-4439-ac43-621fbf7d28aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:43.088733 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f249a1d-e489-4439-ac43-621fbf7d28aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:43.089010 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f249a1d-e489-4439-ac43-621fbf7d28aa admin admin] PATH_INFO: `/v3/projects/17388aa054d04a94838b0e9da713924a/users/e80d3961964b4847aa12d3f6e9adb96a/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:43.090996 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f249a1d-e489-4439-ac43-621fbf7d28aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=17388aa054d04a94838b0e9da713924a, user_id=e80d3961964b4847aa12d3f6e9adb96a, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:43.093751 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f249a1d-e489-4439-ac43-621fbf7d28aa admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:43.103870 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1222/2454] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:34:43 2022] PUT /identity/v3/projects/17388aa054d04a94838b0e9da713924a/users/e80d3961964b4847aa12d3f6e9adb96a/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:34:43.116036 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74d343-feb7-4e74-b9fc-84c5638655a4 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:43.116374 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74d343-feb7-4e74-b9fc-84c5638655a4 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:43.116662 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74d343-feb7-4e74-b9fc-84c5638655a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:43.142570 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-3a74d343-feb7-4e74-b9fc-84c5638655a4 None None] MFA Rules not processed for user `e80d3961964b4847aa12d3f6e9adb96a`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:34:43.143803 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-3a74d343-feb7-4e74-b9fc-84c5638655a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:43.213732 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1223/2455] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:34:43 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:34:43.224697 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a74d343-feb7-4e74-b9fc-84c5638655a4 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:43.278213 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a74d343-feb7-4e74-b9fc-84c5638655a4 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:43.281971 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fc0011-1c22-4552-988e-0e93135891ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:43.282634 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc0011-1c22-4552-988e-0e93135891ce service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:43.282905 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc0011-1c22-4552-988e-0e93135891ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:43.283182 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc0011-1c22-4552-988e-0e93135891ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:43.292388 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fc0011-1c22-4552-988e-0e93135891ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:43.294387 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fc0011-1c22-4552-988e-0e93135891ce service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:43.302519 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-8b1c3aec-6127-4647-bc73-ca4bc482e8ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96f16fe07e914491a1a810f2cc996989'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:43.304124 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1224/2456] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:34:43 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 07 06:34:43.317007 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-8b1c3aec-6127-4647-bc73-ca4bc482e8ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96f16fe07e914491a1a810f2cc996989'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:43.437062 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-8b1c3aec-6127-4647-bc73-ca4bc482e8ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96f16fe07e914491a1a810f2cc996989'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:43.438211 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-8b1c3aec-6127-4647-bc73-ca4bc482e8ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96f16fe07e914491a1a810f2cc996989'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:43.438898 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-8b1c3aec-6127-4647-bc73-ca4bc482e8ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96f16fe07e914491a1a810f2cc996989'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:43.452074 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1233/2457] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:34:42 2022] DELETE /identity/v3/users/96f16fe07e914491a1a810f2cc996989 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:34:43.456675 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff04640-4fd9-42cb-a68b-6347b29441ee None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:43.456965 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff04640-4fd9-42cb-a68b-6347b29441ee None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:43.457239 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff04640-4fd9-42cb-a68b-6347b29441ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:43.474471 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-4ff04640-4fd9-42cb-a68b-6347b29441ee None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:34:43.475801 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-4ff04640-4fd9-42cb-a68b-6347b29441ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:43.530290 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1c3aec-6127-4647-bc73-ca4bc482e8ca admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:43.531716 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-8b1c3aec-6127-4647-bc73-ca4bc482e8ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:43.539165 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1225/2458] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:34:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:34:43.548808 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff04640-4fd9-42cb-a68b-6347b29441ee None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:43.550123 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-4ff04640-4fd9-42cb-a68b-6347b29441ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:43.592161 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1c3aec-6127-4647-bc73-ca4bc482e8ca admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:43.595789 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0006b0b-4c67-4d14-a29c-34931a8eaac8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:43.596447 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0006b0b-4c67-4d14-a29c-34931a8eaac8 service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:43.596735 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0006b0b-4c67-4d14-a29c-34931a8eaac8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:43.597013 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0006b0b-4c67-4d14-a29c-34931a8eaac8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:43.598896 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d0006b0b-4c67-4d14-a29c-34931a8eaac8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:43.613271 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff04640-4fd9-42cb-a68b-6347b29441ee None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:43.617262 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fec7fc-315a-4d7a-bda6-7ec5acaddd65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:43.617920 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fec7fc-315a-4d7a-bda6-7ec5acaddd65 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:43.618207 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fec7fc-315a-4d7a-bda6-7ec5acaddd65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:43.618489 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fec7fc-315a-4d7a-bda6-7ec5acaddd65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:43.629098 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fec7fc-315a-4d7a-bda6-7ec5acaddd65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:43.630552 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fec7fc-315a-4d7a-bda6-7ec5acaddd65 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:43.641786 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1226/2459] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:34:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:34:43.661175 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fec7fc-315a-4d7a-bda6-7ec5acaddd65 service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:43.662015 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0006b0b-4c67-4d14-a29c-34931a8eaac8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:43.662486 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-25fec7fc-315a-4d7a-bda6-7ec5acaddd65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:43.663731 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0006b0b-4c67-4d14-a29c-34931a8eaac8 service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:43.673036 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1234/2460] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:34:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:34:43.673749 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fec7fc-315a-4d7a-bda6-7ec5acaddd65 service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:43.677611 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110619d5-ab1f-41ca-992a-92c36fd28062 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:43.678337 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110619d5-ab1f-41ca-992a-92c36fd28062 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:43.679011 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110619d5-ab1f-41ca-992a-92c36fd28062 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:43.679011 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110619d5-ab1f-41ca-992a-92c36fd28062 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:43.680946 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-110619d5-ab1f-41ca-992a-92c36fd28062 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:43.693812 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110619d5-ab1f-41ca-992a-92c36fd28062 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:43.695257 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110619d5-ab1f-41ca-992a-92c36fd28062 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:43.706065 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1227/2461] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:34:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 07 06:34:44.101376 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0006b0b-4c67-4d14-a29c-34931a8eaac8 service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:44.102935 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d0006b0b-4c67-4d14-a29c-34931a8eaac8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:44.126695 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0006b0b-4c67-4d14-a29c-34931a8eaac8 service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:44.132881 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79b4cd0-75fd-4067-9c6d-c174a64215a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:44.133792 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b4cd0-75fd-4067-9c6d-c174a64215a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:44.134085 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b4cd0-75fd-4067-9c6d-c174a64215a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:44.138401 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b4cd0-75fd-4067-9c6d-c174a64215a0 admin admin] PATH_INFO: `/v3/projects/5c6ae4e865264b53829d40c5c2ef815b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:44.138401 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79b4cd0-75fd-4067-9c6d-c174a64215a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c6ae4e865264b53829d40c5c2ef815b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:44.138401 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79b4cd0-75fd-4067-9c6d-c174a64215a0 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:44.259636 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a79b4cd0-75fd-4067-9c6d-c174a64215a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c6ae4e865264b53829d40c5c2ef815b', 'request_id': 'req-a79b4cd0-75fd-4067-9c6d-c174a64215a0'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:44.266047 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a79b4cd0-75fd-4067-9c6d-c174a64215a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c6ae4e865264b53829d40c5c2ef815b', 'request_id': 'req-a79b4cd0-75fd-4067-9c6d-c174a64215a0'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:44.351213 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a79b4cd0-75fd-4067-9c6d-c174a64215a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c6ae4e865264b53829d40c5c2ef815b', 'request_id': 'req-a79b4cd0-75fd-4067-9c6d-c174a64215a0'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:44.362878 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a79b4cd0-75fd-4067-9c6d-c174a64215a0 admin admin] The token cache is being invalidate because project 5c6ae4e865264b53829d40c5c2ef815b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:34:44.363254 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a79b4cd0-75fd-4067-9c6d-c174a64215a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:44.363925 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a79b4cd0-75fd-4067-9c6d-c174a64215a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:44.365724 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1235/2462] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:34:44 2022] DELETE /identity/v3/projects/5c6ae4e865264b53829d40c5c2ef815b => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:34:44.369827 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110619d5-ab1f-41ca-992a-92c36fd28062 service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:44.380303 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110619d5-ab1f-41ca-992a-92c36fd28062 service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:44.438018 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba4378-7f9d-4601-a8aa-b5dbc046951d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:44.438911 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba4378-7f9d-4601-a8aa-b5dbc046951d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:44.439201 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba4378-7f9d-4601-a8aa-b5dbc046951d admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:44.439475 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba4378-7f9d-4601-a8aa-b5dbc046951d admin admin] PATH_INFO: `/v3/users/5f93f51d75c548bba99d94ca8e9fcf94` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:44.440687 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ba4378-7f9d-4601-a8aa-b5dbc046951d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f93f51d75c548bba99d94ca8e9fcf94)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:44.442648 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ba4378-7f9d-4601-a8aa-b5dbc046951d admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:44.581619 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-a9ba4378-7f9d-4601-a8aa-b5dbc046951d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f93f51d75c548bba99d94ca8e9fcf94'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:44.582264 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-a9ba4378-7f9d-4601-a8aa-b5dbc046951d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f93f51d75c548bba99d94ca8e9fcf94'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:44.641292 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-a9ba4378-7f9d-4601-a8aa-b5dbc046951d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f93f51d75c548bba99d94ca8e9fcf94'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:44.641888 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-a9ba4378-7f9d-4601-a8aa-b5dbc046951d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f93f51d75c548bba99d94ca8e9fcf94'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:44.654504 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-a9ba4378-7f9d-4601-a8aa-b5dbc046951d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f93f51d75c548bba99d94ca8e9fcf94'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:44.666536 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1228/2463] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:34:44 2022] DELETE /identity/v3/users/5f93f51d75c548bba99d94ca8e9fcf94 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:34:45.135269 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79b4cd0-75fd-4067-9c6d-c174a64215a0 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:45.136814 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a79b4cd0-75fd-4067-9c6d-c174a64215a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:45.149835 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79b4cd0-75fd-4067-9c6d-c174a64215a0 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:45.219085 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f4be68-d261-4041-bff8-2ac13863f530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:45.220136 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4be68-d261-4041-bff8-2ac13863f530 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:45.220542 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4be68-d261-4041-bff8-2ac13863f530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:45.220823 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4be68-d261-4041-bff8-2ac13863f530 admin admin] PATH_INFO: `/v3/projects/014c57bae5f643eb809abce0ecf87749` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:45.222135 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f4be68-d261-4041-bff8-2ac13863f530 admin admin] RBAC: Authorizing `identity:delete_project(project_id=014c57bae5f643eb809abce0ecf87749)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:45.224777 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f4be68-d261-4041-bff8-2ac13863f530 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:45.464440 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba4378-7f9d-4601-a8aa-b5dbc046951d admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:45.465924 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a9ba4378-7f9d-4601-a8aa-b5dbc046951d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:45.486033 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba4378-7f9d-4601-a8aa-b5dbc046951d admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:45.491432 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de6e5a3-0376-46d8-aa97-26d020f7c227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:45.492438 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6e5a3-0376-46d8-aa97-26d020f7c227 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:45.492790 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6e5a3-0376-46d8-aa97-26d020f7c227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:45.493129 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6e5a3-0376-46d8-aa97-26d020f7c227 admin admin] PATH_INFO: `/v3/users/2de8ec9a1caa4ede86c6145dd22ef0ec` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:45.494522 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de6e5a3-0376-46d8-aa97-26d020f7c227 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2de8ec9a1caa4ede86c6145dd22ef0ec)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:45.496793 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de6e5a3-0376-46d8-aa97-26d020f7c227 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:45.655716 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-25f4be68-d261-4041-bff8-2ac13863f530 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '014c57bae5f643eb809abce0ecf87749', 'request_id': 'req-25f4be68-d261-4041-bff8-2ac13863f530'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:45.665066 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-25f4be68-d261-4041-bff8-2ac13863f530 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '014c57bae5f643eb809abce0ecf87749', 'request_id': 'req-25f4be68-d261-4041-bff8-2ac13863f530'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:45.757066 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-25f4be68-d261-4041-bff8-2ac13863f530 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '014c57bae5f643eb809abce0ecf87749', 'request_id': 'req-25f4be68-d261-4041-bff8-2ac13863f530'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:45.769670 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-25f4be68-d261-4041-bff8-2ac13863f530 admin admin] The token cache is being invalidate because project 014c57bae5f643eb809abce0ecf87749 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:34:45.770010 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-25f4be68-d261-4041-bff8-2ac13863f530 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:45.770637 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-25f4be68-d261-4041-bff8-2ac13863f530 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:45.772624 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1236/2464] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:34:45 2022] DELETE /identity/v3/projects/014c57bae5f643eb809abce0ecf87749 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:34:45.778135 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96643d59-2756-4c9c-be26-bd5e0bd1f227 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:45.778545 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96643d59-2756-4c9c-be26-bd5e0bd1f227 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:45.778927 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96643d59-2756-4c9c-be26-bd5e0bd1f227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:45.797463 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-1de6e5a3-0376-46d8-aa97-26d020f7c227 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2de8ec9a1caa4ede86c6145dd22ef0ec'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:45.798506 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-1de6e5a3-0376-46d8-aa97-26d020f7c227 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2de8ec9a1caa4ede86c6145dd22ef0ec'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:45.803892 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-96643d59-2756-4c9c-be26-bd5e0bd1f227 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:34:45.805527 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-96643d59-2756-4c9c-be26-bd5e0bd1f227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:45.859576 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-1de6e5a3-0376-46d8-aa97-26d020f7c227 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2de8ec9a1caa4ede86c6145dd22ef0ec'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:45.860249 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-1de6e5a3-0376-46d8-aa97-26d020f7c227 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2de8ec9a1caa4ede86c6145dd22ef0ec'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:45.878079 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-1de6e5a3-0376-46d8-aa97-26d020f7c227 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2de8ec9a1caa4ede86c6145dd22ef0ec'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:45.890244 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1237/2465] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:34:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:34:45.898993 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c95db-0d17-4fba-9c21-a2312e01808b None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:45.899289 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c95db-0d17-4fba-9c21-a2312e01808b None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:45.899577 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c95db-0d17-4fba-9c21-a2312e01808b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:45.924033 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1229/2466] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:34:45 2022] DELETE /identity/v3/users/2de8ec9a1caa4ede86c6145dd22ef0ec => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:34:45.928262 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-199c95db-0d17-4fba-9c21-a2312e01808b None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:34:45.928907 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07648f0c-d6d9-4ed7-ac4e-41c3a9af9630 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:45.929210 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07648f0c-d6d9-4ed7-ac4e-41c3a9af9630 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:45.929709 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-199c95db-0d17-4fba-9c21-a2312e01808b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:45.930863 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07648f0c-d6d9-4ed7-ac4e-41c3a9af9630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:45.969511 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-07648f0c-d6d9-4ed7-ac4e-41c3a9af9630 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:34:45.970765 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-07648f0c-d6d9-4ed7-ac4e-41c3a9af9630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:46.004128 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1238/2467] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:34:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:34:46.005127 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c95db-0d17-4fba-9c21-a2312e01808b None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:46.015863 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c95db-0d17-4fba-9c21-a2312e01808b None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:46.020999 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f172b985-26f7-4b34-adda-2ea1cd4c21ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:46.021732 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f172b985-26f7-4b34-adda-2ea1cd4c21ad admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:46.022069 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f172b985-26f7-4b34-adda-2ea1cd4c21ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:46.022350 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f172b985-26f7-4b34-adda-2ea1cd4c21ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:46.023085 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f172b985-26f7-4b34-adda-2ea1cd4c21ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:34:46.023391 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f172b985-26f7-4b34-adda-2ea1cd4c21ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:46.025011 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f172b985-26f7-4b34-adda-2ea1cd4c21ad admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:46.038242 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1239/2468] 10.222.0.24 () {58 vars in 1152 bytes} [Thu Apr 7 06:34:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:34:46.042816 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f172b985-26f7-4b34-adda-2ea1cd4c21ad admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:46.050010 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1230/2469] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:34:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:34:46.061233 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07648f0c-d6d9-4ed7-ac4e-41c3a9af9630 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:46.062945 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-07648f0c-d6d9-4ed7-ac4e-41c3a9af9630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:46.063569 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f172b985-26f7-4b34-adda-2ea1cd4c21ad admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:46.069079 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec24ae-9989-45b4-885a-f0eaf699e69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:46.070586 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec24ae-9989-45b4-885a-f0eaf699e69c admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:46.070586 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec24ae-9989-45b4-885a-f0eaf699e69c admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:46.070586 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec24ae-9989-45b4-885a-f0eaf699e69c admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:46.071024 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec24ae-9989-45b4-885a-f0eaf699e69c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:46.073059 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec24ae-9989-45b4-885a-f0eaf699e69c admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:46.157533 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07648f0c-d6d9-4ed7-ac4e-41c3a9af9630 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:46.162133 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f3d806-b7a5-4f5c-b664-c243855bc3f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:46.163036 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3d806-b7a5-4f5c-b664-c243855bc3f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:46.163265 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3d806-b7a5-4f5c-b664-c243855bc3f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:46.163653 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3d806-b7a5-4f5c-b664-c243855bc3f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:46.175642 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f3d806-b7a5-4f5c-b664-c243855bc3f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:46.177973 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f3d806-b7a5-4f5c-b664-c243855bc3f1 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:46.190150 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1231/2470] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:34:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 07 06:34:46.230311 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1240/2471] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:34:46 2022] POST /identity/v3/projects => generated 377 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:34:46.232667 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f3d806-b7a5-4f5c-b664-c243855bc3f1 service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:46.242847 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f3d806-b7a5-4f5c-b664-c243855bc3f1 service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:46.302682 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e315e6-1165-46e2-aa5e-5f8cf0119754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:46.303384 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e315e6-1165-46e2-aa5e-5f8cf0119754 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:46.303675 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e315e6-1165-46e2-aa5e-5f8cf0119754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:46.308310 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e315e6-1165-46e2-aa5e-5f8cf0119754 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:46.308310 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e315e6-1165-46e2-aa5e-5f8cf0119754 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:46.308310 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e315e6-1165-46e2-aa5e-5f8cf0119754 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:46.392756 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1232/2472] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:34:46 2022] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:34:46.396870 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec24ae-9989-45b4-885a-f0eaf699e69c admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:46.409177 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec24ae-9989-45b4-885a-f0eaf699e69c admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:46.420073 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e079351c-e64c-4484-9aab-14c805adae0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:46.420073 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e079351c-e64c-4484-9aab-14c805adae0a admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:46.420073 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e079351c-e64c-4484-9aab-14c805adae0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:46.420073 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e079351c-e64c-4484-9aab-14c805adae0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:46.420449 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e079351c-e64c-4484-9aab-14c805adae0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:46.420449 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e079351c-e64c-4484-9aab-14c805adae0a admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:46.432521 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1241/2473] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:34:46.436419 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e315e6-1165-46e2-aa5e-5f8cf0119754 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:46.446766 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e315e6-1165-46e2-aa5e-5f8cf0119754 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:46.452078 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad574fd-e1b6-4588-a419-0a943c17c4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:46.452733 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad574fd-e1b6-4588-a419-0a943c17c4c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:46.453014 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad574fd-e1b6-4588-a419-0a943c17c4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:46.453290 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad574fd-e1b6-4588-a419-0a943c17c4c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:46.454091 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad574fd-e1b6-4588-a419-0a943c17c4c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:46.455811 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad574fd-e1b6-4588-a419-0a943c17c4c4 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:46.467843 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1233/2474] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:34:46.472037 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e079351c-e64c-4484-9aab-14c805adae0a admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:46.482192 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e079351c-e64c-4484-9aab-14c805adae0a admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:46.489245 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a8b373-a364-4bb2-8aa8-673e6984dc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:46.490616 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a8b373-a364-4bb2-8aa8-673e6984dc20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:46.490905 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a8b373-a364-4bb2-8aa8-673e6984dc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:46.491334 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a8b373-a364-4bb2-8aa8-673e6984dc20 admin admin] PATH_INFO: `/v3/projects/f1e0bc4a32b14e069e409de15a94390a/users/c2cba139ac234e688acbdd54ffb1aa98/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:46.513982 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a8b373-a364-4bb2-8aa8-673e6984dc20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1e0bc4a32b14e069e409de15a94390a, user_id=c2cba139ac234e688acbdd54ffb1aa98, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:46.517167 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a8b373-a364-4bb2-8aa8-673e6984dc20 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:46.594327 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1242/2475] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:34:46 2022] PUT /identity/v3/projects/f1e0bc4a32b14e069e409de15a94390a/users/c2cba139ac234e688acbdd54ffb1aa98/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:34:46.662000 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec6444-af70-41fe-943e-303331d77aeb None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:46.662212 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec6444-af70-41fe-943e-303331d77aeb None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:46.662482 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec6444-af70-41fe-943e-303331d77aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:46.689569 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-2eec6444-af70-41fe-943e-303331d77aeb None None] MFA Rules not processed for user `c2cba139ac234e688acbdd54ffb1aa98`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:34:46.690882 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-2eec6444-af70-41fe-943e-303331d77aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:46.742289 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a8b373-a364-4bb2-8aa8-673e6984dc20 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:46.744162 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b0a8b373-a364-4bb2-8aa8-673e6984dc20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:46.784942 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1234/2476] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:34:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:34:46.789456 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eec6444-af70-41fe-943e-303331d77aeb None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:46.835515 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a8b373-a364-4bb2-8aa8-673e6984dc20 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:46.840583 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697d00a-e8b3-4c81-95f0-387783fecb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:46.841502 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697d00a-e8b3-4c81-95f0-387783fecb80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:46.841786 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697d00a-e8b3-4c81-95f0-387783fecb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:46.842059 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697d00a-e8b3-4c81-95f0-387783fecb80 admin admin] PATH_INFO: `/v3/projects/f9342c5b18aa4785bda52c5f540d6d3d` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:46.843286 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b697d00a-e8b3-4c81-95f0-387783fecb80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9342c5b18aa4785bda52c5f540d6d3d)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:46.845217 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b697d00a-e8b3-4c81-95f0-387783fecb80 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:46.859815 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eec6444-af70-41fe-943e-303331d77aeb None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:46.865063 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74683d82-adcc-427e-8156-526d550a9999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:46.865924 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74683d82-adcc-427e-8156-526d550a9999 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:46.866211 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74683d82-adcc-427e-8156-526d550a9999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:46.866478 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74683d82-adcc-427e-8156-526d550a9999 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:46.867175 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74683d82-adcc-427e-8156-526d550a9999 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:46.869114 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74683d82-adcc-427e-8156-526d550a9999 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:47.003925 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1235/2477] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:34:46 2022] POST /identity/v3/projects => generated 375 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:34:47.007508 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74683d82-adcc-427e-8156-526d550a9999 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:47.025765 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b697d00a-e8b3-4c81-95f0-387783fecb80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9342c5b18aa4785bda52c5f540d6d3d', 'request_id': 'req-b697d00a-e8b3-4c81-95f0-387783fecb80'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:47.034085 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b697d00a-e8b3-4c81-95f0-387783fecb80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9342c5b18aa4785bda52c5f540d6d3d', 'request_id': 'req-b697d00a-e8b3-4c81-95f0-387783fecb80'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:47.077744 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74683d82-adcc-427e-8156-526d550a9999 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:47.084719 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41b7f7b-6d2c-4c5b-a021-37b6645917e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:47.085410 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b7f7b-6d2c-4c5b-a021-37b6645917e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:47.085695 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b7f7b-6d2c-4c5b-a021-37b6645917e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:47.085972 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b7f7b-6d2c-4c5b-a021-37b6645917e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:47.086675 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41b7f7b-6d2c-4c5b-a021-37b6645917e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:47.088411 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b697d00a-e8b3-4c81-95f0-387783fecb80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9342c5b18aa4785bda52c5f540d6d3d', 'request_id': 'req-b697d00a-e8b3-4c81-95f0-387783fecb80'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:47.091415 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41b7f7b-6d2c-4c5b-a021-37b6645917e2 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:47.105194 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b697d00a-e8b3-4c81-95f0-387783fecb80 admin admin] The token cache is being invalidate because project f9342c5b18aa4785bda52c5f540d6d3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:34:47.105194 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b697d00a-e8b3-4c81-95f0-387783fecb80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:47.105194 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b697d00a-e8b3-4c81-95f0-387783fecb80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:47.106497 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1243/2478] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:34:46 2022] DELETE /identity/v3/projects/f9342c5b18aa4785bda52c5f540d6d3d => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:34:47.111803 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dfa427-e48c-43da-8ac0-eb5c1cd1d301 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:47.112265 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dfa427-e48c-43da-8ac0-eb5c1cd1d301 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:47.112388 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dfa427-e48c-43da-8ac0-eb5c1cd1d301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:47.147455 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-50dfa427-e48c-43da-8ac0-eb5c1cd1d301 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:34:47.149023 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-50dfa427-e48c-43da-8ac0-eb5c1cd1d301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:47.158357 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1244/2479] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:34:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:34:47.165436 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1236/2480] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:34:47 2022] POST /identity/v3/users => generated 288 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:34:47.167116 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816c8f4-8fa4-4b5e-8522-1d507c308c73 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:47.174990 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816c8f4-8fa4-4b5e-8522-1d507c308c73 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:47.174990 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816c8f4-8fa4-4b5e-8522-1d507c308c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:47.177667 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41b7f7b-6d2c-4c5b-a021-37b6645917e2 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:47.179565 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b41b7f7b-6d2c-4c5b-a021-37b6645917e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:47.190346 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-4816c8f4-8fa4-4b5e-8522-1d507c308c73 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:34:47.191861 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-4816c8f4-8fa4-4b5e-8522-1d507c308c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:47.197256 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41b7f7b-6d2c-4c5b-a021-37b6645917e2 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:47.204050 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1245/2481] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:34:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:34:47.207356 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4816c8f4-8fa4-4b5e-8522-1d507c308c73 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:47.207509 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d25fb-739d-4c18-afeb-62071c67ab28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:47.208322 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d25fb-739d-4c18-afeb-62071c67ab28 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:47.208719 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d25fb-739d-4c18-afeb-62071c67ab28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:47.209104 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d25fb-739d-4c18-afeb-62071c67ab28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:47.209958 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19d25fb-739d-4c18-afeb-62071c67ab28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:47.211770 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19d25fb-739d-4c18-afeb-62071c67ab28 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:47.222886 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4816c8f4-8fa4-4b5e-8522-1d507c308c73 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:47.223535 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1237/2482] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 07 06:34:47.227218 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d25fb-739d-4c18-afeb-62071c67ab28 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:47.236881 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7018922c-83f2-448d-8b25-d091f8fa7ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:47.237552 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018922c-83f2-448d-8b25-d091f8fa7ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:47.237842 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018922c-83f2-448d-8b25-d091f8fa7ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:47.238114 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018922c-83f2-448d-8b25-d091f8fa7ce2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:47.238705 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d25fb-739d-4c18-afeb-62071c67ab28 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:47.240379 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7018922c-83f2-448d-8b25-d091f8fa7ce2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:34:47.242277 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7018922c-83f2-448d-8b25-d091f8fa7ce2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:47.244145 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7018922c-83f2-448d-8b25-d091f8fa7ce2 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:47.244320 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf107a-2ae3-4a8f-a08d-22ab60a395ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:47.245301 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf107a-2ae3-4a8f-a08d-22ab60a395ae admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:47.245681 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf107a-2ae3-4a8f-a08d-22ab60a395ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:47.245973 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf107a-2ae3-4a8f-a08d-22ab60a395ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:47.247267 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bf107a-2ae3-4a8f-a08d-22ab60a395ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:47.248900 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bf107a-2ae3-4a8f-a08d-22ab60a395ae admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:47.259278 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1246/2483] 10.222.0.24 () {58 vars in 1152 bytes} [Thu Apr 7 06:34:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:34:47.264611 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7018922c-83f2-448d-8b25-d091f8fa7ce2 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:47.265813 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1238/2484] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:34:47.271179 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf107a-2ae3-4a8f-a08d-22ab60a395ae admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:47.282876 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7018922c-83f2-448d-8b25-d091f8fa7ce2 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:47.295677 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf107a-2ae3-4a8f-a08d-22ab60a395ae admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:47.299968 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ce00e-d5da-475c-9a73-6902ea1ceb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:47.300653 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ce00e-d5da-475c-9a73-6902ea1ceb08 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:47.300941 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ce00e-d5da-475c-9a73-6902ea1ceb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:47.301378 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ce00e-d5da-475c-9a73-6902ea1ceb08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:47.302091 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090ce00e-d5da-475c-9a73-6902ea1ceb08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:47.305879 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090ce00e-d5da-475c-9a73-6902ea1ceb08 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:47.307952 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0717746-a7a3-466e-a8b2-10affd8e3a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:47.309380 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0717746-a7a3-466e-a8b2-10affd8e3a0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:47.309674 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0717746-a7a3-466e-a8b2-10affd8e3a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:47.309955 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0717746-a7a3-466e-a8b2-10affd8e3a0d admin admin] PATH_INFO: `/v3/projects/be066481521447e888b6e4e2c3fcce2c/users/9df8faa77c0d4af9b31b7fc700756736/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:47.339575 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0717746-a7a3-466e-a8b2-10affd8e3a0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=be066481521447e888b6e4e2c3fcce2c, user_id=9df8faa77c0d4af9b31b7fc700756736, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:47.342916 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0717746-a7a3-466e-a8b2-10affd8e3a0d admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:47.406004 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1247/2485] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:34:47 2022] POST /identity/v3/projects => generated 385 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:34:47.410083 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ce00e-d5da-475c-9a73-6902ea1ceb08 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:47.471676 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ce00e-d5da-475c-9a73-6902ea1ceb08 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:47.475444 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1239/2486] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:34:47 2022] PUT /identity/v3/projects/be066481521447e888b6e4e2c3fcce2c/users/9df8faa77c0d4af9b31b7fc700756736/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:34:47.486024 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa998c-1c17-4212-be08-c066c99bb048 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:47.486317 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa998c-1c17-4212-be08-c066c99bb048 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:47.486598 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa998c-1c17-4212-be08-c066c99bb048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:47.516524 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-4daa998c-1c17-4212-be08-c066c99bb048 None None] MFA Rules not processed for user `9df8faa77c0d4af9b31b7fc700756736`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:34:47.517978 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-4daa998c-1c17-4212-be08-c066c99bb048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:47.566408 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdfd5d7-cf10-4020-82d8-03ac23f0d945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:47.567311 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdfd5d7-cf10-4020-82d8-03ac23f0d945 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:47.567596 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdfd5d7-cf10-4020-82d8-03ac23f0d945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:47.567903 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdfd5d7-cf10-4020-82d8-03ac23f0d945 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:47.568608 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdfd5d7-cf10-4020-82d8-03ac23f0d945 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:47.571983 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdfd5d7-cf10-4020-82d8-03ac23f0d945 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:47.608787 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1240/2487] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:34:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:34:47.612891 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa998c-1c17-4212-be08-c066c99bb048 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:47.623304 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa998c-1c17-4212-be08-c066c99bb048 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:47.627940 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9c941f-3eda-4bd1-b181-f6f4e1a1970d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:47.628577 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c941f-3eda-4bd1-b181-f6f4e1a1970d admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:47.628858 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c941f-3eda-4bd1-b181-f6f4e1a1970d admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:47.629128 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c941f-3eda-4bd1-b181-f6f4e1a1970d admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:47.629809 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9c941f-3eda-4bd1-b181-f6f4e1a1970d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:47.631692 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9c941f-3eda-4bd1-b181-f6f4e1a1970d admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:47.743534 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1248/2488] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:34:47 2022] POST /identity/v3/users => generated 293 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:34:47.743534 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdfd5d7-cf10-4020-82d8-03ac23f0d945 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:47.749910 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdfd5d7-cf10-4020-82d8-03ac23f0d945 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:47.754657 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405ef13-7074-49dc-9fb8-3ff2320f5627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:47.755339 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405ef13-7074-49dc-9fb8-3ff2320f5627 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:47.755619 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405ef13-7074-49dc-9fb8-3ff2320f5627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:47.755921 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405ef13-7074-49dc-9fb8-3ff2320f5627 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:47.756657 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a405ef13-7074-49dc-9fb8-3ff2320f5627 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:47.758250 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a405ef13-7074-49dc-9fb8-3ff2320f5627 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:47.769606 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1249/2489] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 07 06:34:47.776431 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405ef13-7074-49dc-9fb8-3ff2320f5627 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:47.779945 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1241/2490] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:34:47 2022] POST /identity/v3/projects => generated 377 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:34:47.783267 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9c941f-3eda-4bd1-b181-f6f4e1a1970d admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:47.787240 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405ef13-7074-49dc-9fb8-3ff2320f5627 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:47.851165 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f70049c-15b1-4b49-8321-bf80a9284fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:47.851927 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70049c-15b1-4b49-8321-bf80a9284fa0 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:47.852323 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70049c-15b1-4b49-8321-bf80a9284fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:47.852699 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70049c-15b1-4b49-8321-bf80a9284fa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:47.860312 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f70049c-15b1-4b49-8321-bf80a9284fa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:47.860312 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f70049c-15b1-4b49-8321-bf80a9284fa0 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:47.870555 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1250/2491] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:34:47.872101 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9c941f-3eda-4bd1-b181-f6f4e1a1970d admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:47.874576 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f70049c-15b1-4b49-8321-bf80a9284fa0 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:47.877988 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9534abbb-3b79-414a-923a-4ad6fb08516d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:47.878687 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534abbb-3b79-414a-923a-4ad6fb08516d admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:47.878978 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534abbb-3b79-414a-923a-4ad6fb08516d admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:47.879256 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534abbb-3b79-414a-923a-4ad6fb08516d admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:47.879992 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9534abbb-3b79-414a-923a-4ad6fb08516d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:47.881970 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9534abbb-3b79-414a-923a-4ad6fb08516d admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:47.886611 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f70049c-15b1-4b49-8321-bf80a9284fa0 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:47.897819 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520ec4bc-1260-42ee-a86f-86218e605648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:47.898732 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ec4bc-1260-42ee-a86f-86218e605648 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:47.899015 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ec4bc-1260-42ee-a86f-86218e605648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:47.899346 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ec4bc-1260-42ee-a86f-86218e605648 admin admin] PATH_INFO: `/v3/projects/586714ef655b4590811d3599a6507135/users/7e3dc3998aea4cd2b221ecddc4534b40/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:47.918643 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520ec4bc-1260-42ee-a86f-86218e605648 admin admin] RBAC: Authorizing `identity:create_grant(project_id=586714ef655b4590811d3599a6507135, user_id=7e3dc3998aea4cd2b221ecddc4534b40, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:47.921766 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520ec4bc-1260-42ee-a86f-86218e605648 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:47.963606 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1242/2492] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:34:47 2022] POST /identity/v3/users => generated 295 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:34:47.968313 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9534abbb-3b79-414a-923a-4ad6fb08516d admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:47.984582 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1251/2493] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:34:47 2022] PUT /identity/v3/projects/586714ef655b4590811d3599a6507135/users/7e3dc3998aea4cd2b221ecddc4534b40/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:34:47.995519 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a992dd6-4f9d-4c65-9bbd-63deab12e3de None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:47.995998 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a992dd6-4f9d-4c65-9bbd-63deab12e3de None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:47.996629 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9534abbb-3b79-414a-923a-4ad6fb08516d admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:47.996847 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a992dd6-4f9d-4c65-9bbd-63deab12e3de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:48.030932 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-0a992dd6-4f9d-4c65-9bbd-63deab12e3de None None] MFA Rules not processed for user `7e3dc3998aea4cd2b221ecddc4534b40`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:34:48.032584 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-0a992dd6-4f9d-4c65-9bbd-63deab12e3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:48.076428 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f78d8d-04a0-4d6f-af59-52def973a45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:48.077112 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f78d8d-04a0-4d6f-af59-52def973a45a admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:48.077400 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f78d8d-04a0-4d6f-af59-52def973a45a admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:48.077681 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f78d8d-04a0-4d6f-af59-52def973a45a admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:48.078416 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f78d8d-04a0-4d6f-af59-52def973a45a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:48.080040 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f78d8d-04a0-4d6f-af59-52def973a45a admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:48.090292 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1243/2494] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 07 06:34:48.094477 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f78d8d-04a0-4d6f-af59-52def973a45a admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:48.104032 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f78d8d-04a0-4d6f-af59-52def973a45a admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:48.107361 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1252/2495] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:34:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:34:48.108885 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a9f01e-444b-4f82-95f4-05cec282f618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:48.109846 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9f01e-444b-4f82-95f4-05cec282f618 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:48.110106 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9f01e-444b-4f82-95f4-05cec282f618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:48.110379 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9f01e-444b-4f82-95f4-05cec282f618 admin admin] PATH_INFO: `/v3/projects/e6435b4059a84266887a17913c393a04/users/715fce2a07d24d8a993335c35a525b75/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:48.112066 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a992dd6-4f9d-4c65-9bbd-63deab12e3de None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:48.123200 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a992dd6-4f9d-4c65-9bbd-63deab12e3de None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:48.128352 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a9f01e-444b-4f82-95f4-05cec282f618 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6435b4059a84266887a17913c393a04, user_id=715fce2a07d24d8a993335c35a525b75, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:48.128502 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c458c9-3ef1-498e-8028-be79070c380f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:48.129023 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c458c9-3ef1-498e-8028-be79070c380f admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:48.129306 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c458c9-3ef1-498e-8028-be79070c380f admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:48.129583 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c458c9-3ef1-498e-8028-be79070c380f admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:48.130271 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c458c9-3ef1-498e-8028-be79070c380f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:48.131025 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a9f01e-444b-4f82-95f4-05cec282f618 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:48.132313 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c458c9-3ef1-498e-8028-be79070c380f admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:48.323366 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1244/2496] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:34:48 2022] PUT /identity/v3/projects/e6435b4059a84266887a17913c393a04/users/715fce2a07d24d8a993335c35a525b75/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:34:48.323719 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1253/2497] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:34:48 2022] POST /identity/v3/projects => generated 387 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:34:48.327717 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a9f01e-444b-4f82-95f4-05cec282f618 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:48.327963 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c458c9-3ef1-498e-8028-be79070c380f admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:48.329312 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-41a9f01e-444b-4f82-95f4-05cec282f618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:48.389444 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c458c9-3ef1-498e-8028-be79070c380f admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:48.391798 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a9f01e-444b-4f82-95f4-05cec282f618 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:48.394140 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a560813-4322-48f3-816d-3c2ad50d5a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:48.394808 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a560813-4322-48f3-816d-3c2ad50d5a66 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:48.395120 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a560813-4322-48f3-816d-3c2ad50d5a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:48.395390 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a560813-4322-48f3-816d-3c2ad50d5a66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:48.396155 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a560813-4322-48f3-816d-3c2ad50d5a66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:48.396937 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8334d4f9-528a-40c4-a69e-25243ddaded0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:48.397728 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a560813-4322-48f3-816d-3c2ad50d5a66 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:48.398098 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8334d4f9-528a-40c4-a69e-25243ddaded0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:48.398482 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8334d4f9-528a-40c4-a69e-25243ddaded0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:48.398859 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8334d4f9-528a-40c4-a69e-25243ddaded0 admin admin] PATH_INFO: `/v3/users/eb071251b5b74ab8b03e312de3bc945e` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:48.400102 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8334d4f9-528a-40c4-a69e-25243ddaded0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb071251b5b74ab8b03e312de3bc945e)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:48.402017 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8334d4f9-528a-40c4-a69e-25243ddaded0 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:48.407761 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1254/2498] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:34:48.408515 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a560813-4322-48f3-816d-3c2ad50d5a66 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:48.417776 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a560813-4322-48f3-816d-3c2ad50d5a66 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:48.422884 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f63704-723b-4a14-a812-0d5f21d287ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:48.423528 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f63704-723b-4a14-a812-0d5f21d287ae admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:48.423844 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f63704-723b-4a14-a812-0d5f21d287ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:48.424124 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f63704-723b-4a14-a812-0d5f21d287ae admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:48.424850 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f63704-723b-4a14-a812-0d5f21d287ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:48.426730 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f63704-723b-4a14-a812-0d5f21d287ae admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:48.676749 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1255/2499] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:34:48 2022] POST /identity/v3/users => generated 300 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:34:48.677574 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f63704-723b-4a14-a812-0d5f21d287ae admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:48.687628 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f63704-723b-4a14-a812-0d5f21d287ae admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:48.692267 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede5d94-793f-4e30-b603-9b299452c565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:48.693153 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede5d94-793f-4e30-b603-9b299452c565 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:48.693441 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede5d94-793f-4e30-b603-9b299452c565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:48.693717 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede5d94-793f-4e30-b603-9b299452c565 admin admin] PATH_INFO: `/v3/projects/e6435b4059a84266887a17913c393a04/users/715fce2a07d24d8a993335c35a525b75/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:48.695675 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede5d94-793f-4e30-b603-9b299452c565 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6435b4059a84266887a17913c393a04, user_id=715fce2a07d24d8a993335c35a525b75, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:48.698413 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede5d94-793f-4e30-b603-9b299452c565 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:48.709656 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1256/2500] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:34:48 2022] PUT /identity/v3/projects/e6435b4059a84266887a17913c393a04/users/715fce2a07d24d8a993335c35a525b75/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:34:48.710236 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede5d94-793f-4e30-b603-9b299452c565 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:48.719687 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-8334d4f9-528a-40c4-a69e-25243ddaded0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb071251b5b74ab8b03e312de3bc945e'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:48.720541 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-8334d4f9-528a-40c4-a69e-25243ddaded0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb071251b5b74ab8b03e312de3bc945e'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:48.768740 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede5d94-793f-4e30-b603-9b299452c565 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:48.773435 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c244cf63-8d91-4573-a424-5c30067d60e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:48.774120 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244cf63-8d91-4573-a424-5c30067d60e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:48.774401 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244cf63-8d91-4573-a424-5c30067d60e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:48.774700 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244cf63-8d91-4573-a424-5c30067d60e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:48.775417 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c244cf63-8d91-4573-a424-5c30067d60e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:48.777108 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c244cf63-8d91-4573-a424-5c30067d60e3 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:48.783789 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-8334d4f9-528a-40c4-a69e-25243ddaded0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb071251b5b74ab8b03e312de3bc945e'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:48.784419 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-8334d4f9-528a-40c4-a69e-25243ddaded0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb071251b5b74ab8b03e312de3bc945e'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:48.787435 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1257/2501] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:34:48.788841 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6547e147-ed27-4bdf-83e5-eba4d26dc4dd None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:48.789138 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6547e147-ed27-4bdf-83e5-eba4d26dc4dd None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:48.789434 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6547e147-ed27-4bdf-83e5-eba4d26dc4dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:48.800610 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-8334d4f9-528a-40c4-a69e-25243ddaded0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb071251b5b74ab8b03e312de3bc945e'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:48.812748 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1245/2502] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:34:48 2022] DELETE /identity/v3/users/eb071251b5b74ab8b03e312de3bc945e => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:34:48.816133 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8334d4f9-528a-40c4-a69e-25243ddaded0 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:48.816133 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-8334d4f9-528a-40c4-a69e-25243ddaded0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:48.816914 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-6547e147-ed27-4bdf-83e5-eba4d26dc4dd None None] MFA Rules not processed for user `715fce2a07d24d8a993335c35a525b75`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:34:48.818226 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-6547e147-ed27-4bdf-83e5-eba4d26dc4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:48.883564 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8334d4f9-528a-40c4-a69e-25243ddaded0 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:48.888778 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d5ab2-7d1b-4814-a307-de8332c847d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:48.889677 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d5ab2-7d1b-4814-a307-de8332c847d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:48.889972 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d5ab2-7d1b-4814-a307-de8332c847d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:48.890287 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d5ab2-7d1b-4814-a307-de8332c847d7 admin admin] PATH_INFO: `/v3/projects/9e8ad3738ad44b629049e10c58cf27ad/users/3c0d82c9e9a64d48a2a82b508ec9242f/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:48.891835 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1258/2503] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:34:48 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:34:48.904600 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6547e147-ed27-4bdf-83e5-eba4d26dc4dd None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:48.905778 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-6547e147-ed27-4bdf-83e5-eba4d26dc4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:48.906429 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5d5ab2-7d1b-4814-a307-de8332c847d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e8ad3738ad44b629049e10c58cf27ad, user_id=3c0d82c9e9a64d48a2a82b508ec9242f, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:48.909096 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5d5ab2-7d1b-4814-a307-de8332c847d7 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:48.960929 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6547e147-ed27-4bdf-83e5-eba4d26dc4dd None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:48.964604 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9175236-b98e-45c2-b66a-2b0a33cb138f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:48.966625 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9175236-b98e-45c2-b66a-2b0a33cb138f service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:48.966924 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9175236-b98e-45c2-b66a-2b0a33cb138f service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:48.967205 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9175236-b98e-45c2-b66a-2b0a33cb138f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:48.969327 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e9175236-b98e-45c2-b66a-2b0a33cb138f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:48.986011 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1246/2504] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:34:48 2022] PUT /identity/v3/projects/9e8ad3738ad44b629049e10c58cf27ad/users/3c0d82c9e9a64d48a2a82b508ec9242f/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:34:48.990322 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d5ab2-7d1b-4814-a307-de8332c847d7 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:49.029097 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9175236-b98e-45c2-b66a-2b0a33cb138f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:49.030534 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9175236-b98e-45c2-b66a-2b0a33cb138f service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:49.042280 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1259/2505] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:34:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 07 06:34:49.042993 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9175236-b98e-45c2-b66a-2b0a33cb138f service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:49.044963 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e9175236-b98e-45c2-b66a-2b0a33cb138f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:49.058762 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d5ab2-7d1b-4814-a307-de8332c847d7 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:49.060845 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9175236-b98e-45c2-b66a-2b0a33cb138f service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:49.064349 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5de0e6-8084-413f-b173-0f161ad8eadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:49.065133 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5de0e6-8084-413f-b173-0f161ad8eadb admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:49.065415 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5de0e6-8084-413f-b173-0f161ad8eadb admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:49.065758 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5de0e6-8084-413f-b173-0f161ad8eadb admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:49.066159 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a872b0-d16e-403d-9d93-47127aacecff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:49.066414 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5de0e6-8084-413f-b173-0f161ad8eadb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:49.067146 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a872b0-d16e-403d-9d93-47127aacecff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:49.067321 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a872b0-d16e-403d-9d93-47127aacecff admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:49.067586 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a872b0-d16e-403d-9d93-47127aacecff admin admin] PATH_INFO: `/v3/projects/15de816e94a54017b0b809f20d84b492` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:49.068106 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5de0e6-8084-413f-b173-0f161ad8eadb admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:49.068997 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a872b0-d16e-403d-9d93-47127aacecff admin admin] RBAC: Authorizing `identity:delete_project(project_id=15de816e94a54017b0b809f20d84b492)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:49.070919 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a872b0-d16e-403d-9d93-47127aacecff admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:49.083334 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1247/2506] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 07 06:34:49.087310 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5de0e6-8084-413f-b173-0f161ad8eadb admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:49.104127 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5de0e6-8084-413f-b173-0f161ad8eadb admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:49.109813 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67e4092-17a2-490d-ac8b-2864d7868074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:49.111169 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e4092-17a2-490d-ac8b-2864d7868074 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:49.111513 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e4092-17a2-490d-ac8b-2864d7868074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:49.111816 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e4092-17a2-490d-ac8b-2864d7868074 admin admin] PATH_INFO: `/v3/projects/9e8ad3738ad44b629049e10c58cf27ad/users/3c0d82c9e9a64d48a2a82b508ec9242f/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:49.114004 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67e4092-17a2-490d-ac8b-2864d7868074 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e8ad3738ad44b629049e10c58cf27ad, user_id=3c0d82c9e9a64d48a2a82b508ec9242f, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:49.117076 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67e4092-17a2-490d-ac8b-2864d7868074 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:49.127841 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1248/2507] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:34:49 2022] PUT /identity/v3/projects/9e8ad3738ad44b629049e10c58cf27ad/users/3c0d82c9e9a64d48a2a82b508ec9242f/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:34:49.138040 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed11f9-be92-43cc-8add-5f5b23d3df1a None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:49.138336 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed11f9-be92-43cc-8add-5f5b23d3df1a None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:49.139674 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed11f9-be92-43cc-8add-5f5b23d3df1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:49.164840 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-92ed11f9-be92-43cc-8add-5f5b23d3df1a None None] MFA Rules not processed for user `3c0d82c9e9a64d48a2a82b508ec9242f`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:34:49.166045 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-92ed11f9-be92-43cc-8add-5f5b23d3df1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:49.176900 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-05a872b0-d16e-403d-9d93-47127aacecff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15de816e94a54017b0b809f20d84b492', 'request_id': 'req-05a872b0-d16e-403d-9d93-47127aacecff'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:49.183302 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-05a872b0-d16e-403d-9d93-47127aacecff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15de816e94a54017b0b809f20d84b492', 'request_id': 'req-05a872b0-d16e-403d-9d93-47127aacecff'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:49.234466 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1249/2508] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:34:49 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:34:49.243203 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-05a872b0-d16e-403d-9d93-47127aacecff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15de816e94a54017b0b809f20d84b492', 'request_id': 'req-05a872b0-d16e-403d-9d93-47127aacecff'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:49.246009 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ed11f9-be92-43cc-8add-5f5b23d3df1a None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:49.247508 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-92ed11f9-be92-43cc-8add-5f5b23d3df1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:49.254857 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-05a872b0-d16e-403d-9d93-47127aacecff admin admin] The token cache is being invalidate because project 15de816e94a54017b0b809f20d84b492 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:34:49.266235 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-05a872b0-d16e-403d-9d93-47127aacecff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:49.266235 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-05a872b0-d16e-403d-9d93-47127aacecff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:49.266235 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1260/2509] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:34:49 2022] DELETE /identity/v3/projects/15de816e94a54017b0b809f20d84b492 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:34:49.267480 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d584bce-b687-4d07-9a02-cb76e96eec6f None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:49.267798 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d584bce-b687-4d07-9a02-cb76e96eec6f None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:49.268084 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d584bce-b687-4d07-9a02-cb76e96eec6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:49.286971 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-5d584bce-b687-4d07-9a02-cb76e96eec6f None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:34:49.288207 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-5d584bce-b687-4d07-9a02-cb76e96eec6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:49.304448 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ed11f9-be92-43cc-8add-5f5b23d3df1a None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:49.308124 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac469c4-f092-4480-bb7b-9474b155dd5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:49.308780 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac469c4-f092-4480-bb7b-9474b155dd5c service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:49.309069 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac469c4-f092-4480-bb7b-9474b155dd5c service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:49.309348 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac469c4-f092-4480-bb7b-9474b155dd5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:49.311147 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-6ac469c4-f092-4480-bb7b-9474b155dd5c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:49.322620 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac469c4-f092-4480-bb7b-9474b155dd5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:49.324093 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac469c4-f092-4480-bb7b-9474b155dd5c service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:49.334152 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1250/2510] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:34:49 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 07 06:34:49.349237 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1261/2511] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:34:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:34:49.357095 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68992a-3c50-44ef-930e-61aaae67f0c9 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:49.357395 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68992a-3c50-44ef-930e-61aaae67f0c9 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:49.361323 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68992a-3c50-44ef-930e-61aaae67f0c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:49.367671 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d584bce-b687-4d07-9a02-cb76e96eec6f None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:49.369069 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-5d584bce-b687-4d07-9a02-cb76e96eec6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:49.375686 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-fe68992a-3c50-44ef-930e-61aaae67f0c9 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:34:49.376908 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-fe68992a-3c50-44ef-930e-61aaae67f0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:49.381084 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d584bce-b687-4d07-9a02-cb76e96eec6f None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:49.384859 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1251/2512] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:34:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:34:49.386336 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1401ac3b-9c19-4962-8fc4-2ed1aea8b9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:49.387727 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401ac3b-9c19-4962-8fc4-2ed1aea8b9af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:49.388045 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401ac3b-9c19-4962-8fc4-2ed1aea8b9af admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:49.388327 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401ac3b-9c19-4962-8fc4-2ed1aea8b9af admin admin] PATH_INFO: `/v3/users/7e3dc3998aea4cd2b221ecddc4534b40` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:49.389538 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1401ac3b-9c19-4962-8fc4-2ed1aea8b9af admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e3dc3998aea4cd2b221ecddc4534b40)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:49.389756 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68992a-3c50-44ef-930e-61aaae67f0c9 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:49.391455 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1401ac3b-9c19-4962-8fc4-2ed1aea8b9af admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:49.398552 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68992a-3c50-44ef-930e-61aaae67f0c9 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:49.403984 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1449c9-a785-48c0-ac14-25ee32944d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:49.407778 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1449c9-a785-48c0-ac14-25ee32944d24 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:49.407778 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1449c9-a785-48c0-ac14-25ee32944d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:49.407778 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1449c9-a785-48c0-ac14-25ee32944d24 admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:49.407778 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1449c9-a785-48c0-ac14-25ee32944d24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:34:49.407778 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1449c9-a785-48c0-ac14-25ee32944d24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:49.408203 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1449c9-a785-48c0-ac14-25ee32944d24 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:49.420310 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1252/2513] 10.222.0.24 () {58 vars in 1152 bytes} [Thu Apr 7 06:34:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:34:49.424582 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1449c9-a785-48c0-ac14-25ee32944d24 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:49.434483 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1449c9-a785-48c0-ac14-25ee32944d24 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:49.439381 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610cc68d-a48f-43d3-9464-262afcc361f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:49.440112 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610cc68d-a48f-43d3-9464-262afcc361f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:49.440401 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610cc68d-a48f-43d3-9464-262afcc361f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:49.440681 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610cc68d-a48f-43d3-9464-262afcc361f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:49.441440 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610cc68d-a48f-43d3-9464-262afcc361f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:49.443366 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610cc68d-a48f-43d3-9464-262afcc361f7 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:49.604055 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1253/2514] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:34:49 2022] POST /identity/v3/projects => generated 381 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:34:49.608859 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610cc68d-a48f-43d3-9464-262afcc361f7 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:49.668029 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-1401ac3b-9c19-4962-8fc4-2ed1aea8b9af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e3dc3998aea4cd2b221ecddc4534b40'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:49.677875 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610cc68d-a48f-43d3-9464-262afcc361f7 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:49.680192 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-1401ac3b-9c19-4962-8fc4-2ed1aea8b9af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e3dc3998aea4cd2b221ecddc4534b40'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:49.682740 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566c1d9a-6588-4f20-b2b5-a2185c9113a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:49.683551 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c1d9a-6588-4f20-b2b5-a2185c9113a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:49.683949 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c1d9a-6588-4f20-b2b5-a2185c9113a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:49.684250 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c1d9a-6588-4f20-b2b5-a2185c9113a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:49.688139 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566c1d9a-6588-4f20-b2b5-a2185c9113a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:49.688139 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566c1d9a-6588-4f20-b2b5-a2185c9113a6 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:49.739442 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-1401ac3b-9c19-4962-8fc4-2ed1aea8b9af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e3dc3998aea4cd2b221ecddc4534b40'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:49.740332 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-1401ac3b-9c19-4962-8fc4-2ed1aea8b9af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e3dc3998aea4cd2b221ecddc4534b40'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:49.740942 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-1401ac3b-9c19-4962-8fc4-2ed1aea8b9af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e3dc3998aea4cd2b221ecddc4534b40'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:49.753661 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1262/2515] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:34:49 2022] DELETE /identity/v3/users/7e3dc3998aea4cd2b221ecddc4534b40 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:34:49.758565 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4060278-3ae9-4239-9961-d0d5156f1bba None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:49.759047 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4060278-3ae9-4239-9961-d0d5156f1bba None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:49.759464 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4060278-3ae9-4239-9961-d0d5156f1bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:49.759839 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1254/2516] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:34:49 2022] POST /identity/v3/users => generated 291 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:34:49.764181 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566c1d9a-6588-4f20-b2b5-a2185c9113a6 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:49.765882 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-566c1d9a-6588-4f20-b2b5-a2185c9113a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:49.779996 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-a4060278-3ae9-4239-9961-d0d5156f1bba None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:34:49.781329 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a4060278-3ae9-4239-9961-d0d5156f1bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:49.784423 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566c1d9a-6588-4f20-b2b5-a2185c9113a6 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:49.846811 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f8076-6f1e-44cd-bfbb-34d3450dcab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:49.847491 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f8076-6f1e-44cd-bfbb-34d3450dcab3 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:49.847810 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f8076-6f1e-44cd-bfbb-34d3450dcab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:49.848097 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f8076-6f1e-44cd-bfbb-34d3450dcab3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:49.848831 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6f8076-6f1e-44cd-bfbb-34d3450dcab3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:49.849299 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1263/2517] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:34:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:34:49.850441 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6f8076-6f1e-44cd-bfbb-34d3450dcab3 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:49.860879 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4060278-3ae9-4239-9961-d0d5156f1bba None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:49.865276 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1255/2518] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:34:49 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:34:49.865421 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a4060278-3ae9-4239-9961-d0d5156f1bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:49.866465 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f8076-6f1e-44cd-bfbb-34d3450dcab3 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:49.877541 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f8076-6f1e-44cd-bfbb-34d3450dcab3 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:49.882847 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1214c083-b348-4fca-8377-f107d955ef87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:49.883591 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1214c083-b348-4fca-8377-f107d955ef87 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:49.883988 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1214c083-b348-4fca-8377-f107d955ef87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:49.884341 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1214c083-b348-4fca-8377-f107d955ef87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:49.885145 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1214c083-b348-4fca-8377-f107d955ef87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:49.887564 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1214c083-b348-4fca-8377-f107d955ef87 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:49.898386 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1256/2519] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:34:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:34:49.903864 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1214c083-b348-4fca-8377-f107d955ef87 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:49.914097 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1214c083-b348-4fca-8377-f107d955ef87 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:49.919964 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09c522b-268a-4a1b-9372-10357a3b8053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:49.920962 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c522b-268a-4a1b-9372-10357a3b8053 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:49.921333 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c522b-268a-4a1b-9372-10357a3b8053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:49.921681 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c522b-268a-4a1b-9372-10357a3b8053 admin admin] PATH_INFO: `/v3/projects/653329d427de48649de60897b1f9d05b/users/468235c07abc4df28dba80e0c1fcfa8f/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:49.925033 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4060278-3ae9-4239-9961-d0d5156f1bba None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:49.929261 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3c42a2-448a-4264-b96f-a767509d4923 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:49.929915 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c42a2-448a-4264-b96f-a767509d4923 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:49.930202 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c42a2-448a-4264-b96f-a767509d4923 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:49.930482 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c42a2-448a-4264-b96f-a767509d4923 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:49.936715 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09c522b-268a-4a1b-9372-10357a3b8053 admin admin] RBAC: Authorizing `identity:create_grant(project_id=653329d427de48649de60897b1f9d05b, user_id=468235c07abc4df28dba80e0c1fcfa8f, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:49.939607 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09c522b-268a-4a1b-9372-10357a3b8053 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:49.939983 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3c42a2-448a-4264-b96f-a767509d4923 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:49.941397 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3c42a2-448a-4264-b96f-a767509d4923 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:49.951375 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1264/2520] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:34:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 07 06:34:50.037529 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1257/2521] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:34:49 2022] PUT /identity/v3/projects/653329d427de48649de60897b1f9d05b/users/468235c07abc4df28dba80e0c1fcfa8f/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:34:50.048208 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7a46c-bb46-4863-9419-77518104e0e7 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:50.048504 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7a46c-bb46-4863-9419-77518104e0e7 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:50.048786 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7a46c-bb46-4863-9419-77518104e0e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:50.073859 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-e4b7a46c-bb46-4863-9419-77518104e0e7 None None] MFA Rules not processed for user `468235c07abc4df28dba80e0c1fcfa8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:34:50.075663 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e4b7a46c-bb46-4863-9419-77518104e0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:50.140524 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1265/2522] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:34:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:34:50.144841 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09c522b-268a-4a1b-9372-10357a3b8053 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:50.213924 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09c522b-268a-4a1b-9372-10357a3b8053 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:50.219263 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb52f0d-ae9d-43a7-a7b8-789da7d23c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:50.224158 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb52f0d-ae9d-43a7-a7b8-789da7d23c10 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:50.224158 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb52f0d-ae9d-43a7-a7b8-789da7d23c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:50.224158 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb52f0d-ae9d-43a7-a7b8-789da7d23c10 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:50.224158 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb52f0d-ae9d-43a7-a7b8-789da7d23c10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:50.224158 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb52f0d-ae9d-43a7-a7b8-789da7d23c10 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:50.306742 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1258/2523] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:34:50 2022] POST /identity/v3/projects => generated 377 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:34:50.311339 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b7a46c-bb46-4863-9419-77518104e0e7 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:50.322255 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b7a46c-bb46-4863-9419-77518104e0e7 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:50.346979 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb52f0d-ae9d-43a7-a7b8-789da7d23c10 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:50.348712 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-6cb52f0d-ae9d-43a7-a7b8-789da7d23c10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:50.382716 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d098a879-b55a-4457-8ee9-2bec4284f865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:50.384827 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098a879-b55a-4457-8ee9-2bec4284f865 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:50.384827 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098a879-b55a-4457-8ee9-2bec4284f865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:50.384827 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098a879-b55a-4457-8ee9-2bec4284f865 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:50.384827 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d098a879-b55a-4457-8ee9-2bec4284f865 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:50.386611 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d098a879-b55a-4457-8ee9-2bec4284f865 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:50.415623 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb52f0d-ae9d-43a7-a7b8-789da7d23c10 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:50.420427 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c48a5ab-ea97-4a15-9299-2ccb7ca1bf82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:50.421338 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c48a5ab-ea97-4a15-9299-2ccb7ca1bf82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:50.421621 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c48a5ab-ea97-4a15-9299-2ccb7ca1bf82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:50.421895 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c48a5ab-ea97-4a15-9299-2ccb7ca1bf82 admin admin] PATH_INFO: `/v3/projects/586714ef655b4590811d3599a6507135` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:50.423087 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c48a5ab-ea97-4a15-9299-2ccb7ca1bf82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=586714ef655b4590811d3599a6507135)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:50.425101 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c48a5ab-ea97-4a15-9299-2ccb7ca1bf82 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:50.465610 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1266/2524] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:34:50 2022] POST /identity/v3/users => generated 295 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:34:50.468989 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d098a879-b55a-4457-8ee9-2bec4284f865 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:50.478288 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d098a879-b55a-4457-8ee9-2bec4284f865 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:50.482865 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed34356-f52f-4c06-962b-9efd1de0fabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:50.483498 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed34356-f52f-4c06-962b-9efd1de0fabe admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:50.483822 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed34356-f52f-4c06-962b-9efd1de0fabe admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:50.484106 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed34356-f52f-4c06-962b-9efd1de0fabe admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:50.484820 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed34356-f52f-4c06-962b-9efd1de0fabe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:50.486480 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed34356-f52f-4c06-962b-9efd1de0fabe admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:50.496981 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1267/2525] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:34:50 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 07 06:34:50.500910 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed34356-f52f-4c06-962b-9efd1de0fabe admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:50.510010 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed34356-f52f-4c06-962b-9efd1de0fabe admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:50.515212 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86fdba-ef93-4591-9602-a0cbc55a0a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:50.516142 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86fdba-ef93-4591-9602-a0cbc55a0a84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:50.516428 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86fdba-ef93-4591-9602-a0cbc55a0a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:50.516709 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86fdba-ef93-4591-9602-a0cbc55a0a84 admin admin] PATH_INFO: `/v3/projects/1fcf67646cf94d77abc12ce532b20d2a/users/35ea54fd09ca4471833a1892e7f9210c/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:50.530652 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e86fdba-ef93-4591-9602-a0cbc55a0a84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fcf67646cf94d77abc12ce532b20d2a, user_id=35ea54fd09ca4471833a1892e7f9210c, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:50.533318 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e86fdba-ef93-4591-9602-a0cbc55a0a84 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:50.608716 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1268/2526] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:34:50 2022] PUT /identity/v3/projects/1fcf67646cf94d77abc12ce532b20d2a/users/35ea54fd09ca4471833a1892e7f9210c/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:34:50.612832 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86fdba-ef93-4591-9602-a0cbc55a0a84 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:50.616511 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-0c48a5ab-ea97-4a15-9299-2ccb7ca1bf82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '586714ef655b4590811d3599a6507135', 'request_id': 'req-0c48a5ab-ea97-4a15-9299-2ccb7ca1bf82'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:50.622620 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-0c48a5ab-ea97-4a15-9299-2ccb7ca1bf82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '586714ef655b4590811d3599a6507135', 'request_id': 'req-0c48a5ab-ea97-4a15-9299-2ccb7ca1bf82'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:50.676161 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86fdba-ef93-4591-9602-a0cbc55a0a84 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:50.687755 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-0c48a5ab-ea97-4a15-9299-2ccb7ca1bf82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '586714ef655b4590811d3599a6507135', 'request_id': 'req-0c48a5ab-ea97-4a15-9299-2ccb7ca1bf82'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:50.699147 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-0c48a5ab-ea97-4a15-9299-2ccb7ca1bf82 admin admin] The token cache is being invalidate because project 586714ef655b4590811d3599a6507135 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:34:50.699430 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-0c48a5ab-ea97-4a15-9299-2ccb7ca1bf82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:50.700077 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-0c48a5ab-ea97-4a15-9299-2ccb7ca1bf82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:50.701847 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1259/2527] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:34:50 2022] DELETE /identity/v3/projects/586714ef655b4590811d3599a6507135 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:34:50.705519 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c48a5ab-ea97-4a15-9299-2ccb7ca1bf82 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:50.706873 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-0c48a5ab-ea97-4a15-9299-2ccb7ca1bf82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:50.731144 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc5ff2-6496-4aae-b858-8a53497d03e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:50.731781 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc5ff2-6496-4aae-b858-8a53497d03e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:50.732052 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc5ff2-6496-4aae-b858-8a53497d03e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:50.732333 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc5ff2-6496-4aae-b858-8a53497d03e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:50.733059 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dc5ff2-6496-4aae-b858-8a53497d03e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:50.734695 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dc5ff2-6496-4aae-b858-8a53497d03e3 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:50.744719 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1269/2528] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:34:50 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 07 06:34:50.749510 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc5ff2-6496-4aae-b858-8a53497d03e3 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:50.751158 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-11dc5ff2-6496-4aae-b858-8a53497d03e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:50.763186 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc5ff2-6496-4aae-b858-8a53497d03e3 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:50.768102 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2732c225-e8ea-4abf-8580-9fd8cd96875e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:50.768992 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732c225-e8ea-4abf-8580-9fd8cd96875e admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:50.769294 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732c225-e8ea-4abf-8580-9fd8cd96875e admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:50.769620 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732c225-e8ea-4abf-8580-9fd8cd96875e admin admin] PATH_INFO: `/v3/projects/1fcf67646cf94d77abc12ce532b20d2a/users/35ea54fd09ca4471833a1892e7f9210c/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:50.771610 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2732c225-e8ea-4abf-8580-9fd8cd96875e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fcf67646cf94d77abc12ce532b20d2a, user_id=35ea54fd09ca4471833a1892e7f9210c, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:50.773650 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c48a5ab-ea97-4a15-9299-2ccb7ca1bf82 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:50.774432 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2732c225-e8ea-4abf-8580-9fd8cd96875e admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:50.778384 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a78c83-60af-4b82-85c7-c876d9698b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:50.779260 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a78c83-60af-4b82-85c7-c876d9698b4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:50.779543 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a78c83-60af-4b82-85c7-c876d9698b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:50.779854 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a78c83-60af-4b82-85c7-c876d9698b4d admin admin] PATH_INFO: `/v3/users/3c0d82c9e9a64d48a2a82b508ec9242f` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:50.781049 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a78c83-60af-4b82-85c7-c876d9698b4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c0d82c9e9a64d48a2a82b508ec9242f)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:50.782972 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a78c83-60af-4b82-85c7-c876d9698b4d admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:50.784970 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1270/2529] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:34:50 2022] PUT /identity/v3/projects/1fcf67646cf94d77abc12ce532b20d2a/users/35ea54fd09ca4471833a1892e7f9210c/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:34:50.795507 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb7a8ff-48b5-4efe-81cb-dca4e0328eea None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:50.796077 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb7a8ff-48b5-4efe-81cb-dca4e0328eea None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:50.796358 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb7a8ff-48b5-4efe-81cb-dca4e0328eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:50.822174 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-6eb7a8ff-48b5-4efe-81cb-dca4e0328eea None None] MFA Rules not processed for user `35ea54fd09ca4471833a1892e7f9210c`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:34:50.823378 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-6eb7a8ff-48b5-4efe-81cb-dca4e0328eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:50.892312 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1271/2530] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:34:50 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:34:50.903369 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb7a8ff-48b5-4efe-81cb-dca4e0328eea None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:50.904717 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-6eb7a8ff-48b5-4efe-81cb-dca4e0328eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:50.958878 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb7a8ff-48b5-4efe-81cb-dca4e0328eea None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:50.962507 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114f2952-93a9-47dd-9512-4c53ba03fbe3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:50.963149 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f2952-93a9-47dd-9512-4c53ba03fbe3 service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:50.963434 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f2952-93a9-47dd-9512-4c53ba03fbe3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:50.963709 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f2952-93a9-47dd-9512-4c53ba03fbe3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:50.974082 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114f2952-93a9-47dd-9512-4c53ba03fbe3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:50.975514 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114f2952-93a9-47dd-9512-4c53ba03fbe3 service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:50.985369 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1272/2531] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:34:50 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 07 06:34:51.015560 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-20a78c83-60af-4b82-85c7-c876d9698b4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c0d82c9e9a64d48a2a82b508ec9242f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:51.016242 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-20a78c83-60af-4b82-85c7-c876d9698b4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c0d82c9e9a64d48a2a82b508ec9242f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:51.087757 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-20a78c83-60af-4b82-85c7-c876d9698b4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c0d82c9e9a64d48a2a82b508ec9242f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:51.088399 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-20a78c83-60af-4b82-85c7-c876d9698b4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c0d82c9e9a64d48a2a82b508ec9242f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:51.101330 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-20a78c83-60af-4b82-85c7-c876d9698b4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c0d82c9e9a64d48a2a82b508ec9242f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:51.113939 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1260/2532] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:34:50 2022] DELETE /identity/v3/users/3c0d82c9e9a64d48a2a82b508ec9242f => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:34:51.203529 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114f2952-93a9-47dd-9512-4c53ba03fbe3 service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:51.212003 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114f2952-93a9-47dd-9512-4c53ba03fbe3 service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:51.259387 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0d998-ddc1-41c9-b9a5-d5bc4a746993 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:51.260007 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0d998-ddc1-41c9-b9a5-d5bc4a746993 service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:51.260290 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0d998-ddc1-41c9-b9a5-d5bc4a746993 service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:51.260565 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0d998-ddc1-41c9-b9a5-d5bc4a746993 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:51.262357 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-3ba0d998-ddc1-41c9-b9a5-d5bc4a746993 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:51.322866 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba0d998-ddc1-41c9-b9a5-d5bc4a746993 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:51.324368 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba0d998-ddc1-41c9-b9a5-d5bc4a746993 service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:51.333996 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1273/2533] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:34:51 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:34:51.586907 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a78c83-60af-4b82-85c7-c876d9698b4d admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:51.588367 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-20a78c83-60af-4b82-85c7-c876d9698b4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:51.655116 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a78c83-60af-4b82-85c7-c876d9698b4d admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:51.659649 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b53583-4652-4c60-8331-c958b28ab609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:51.660542 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b53583-4652-4c60-8331-c958b28ab609 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:51.660823 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b53583-4652-4c60-8331-c958b28ab609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:51.661097 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b53583-4652-4c60-8331-c958b28ab609 admin admin] PATH_INFO: `/v3/projects/9e8ad3738ad44b629049e10c58cf27ad` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:51.662262 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b53583-4652-4c60-8331-c958b28ab609 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e8ad3738ad44b629049e10c58cf27ad)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:51.664305 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b53583-4652-4c60-8331-c958b28ab609 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:51.825402 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-28b53583-4652-4c60-8331-c958b28ab609 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e8ad3738ad44b629049e10c58cf27ad', 'request_id': 'req-28b53583-4652-4c60-8331-c958b28ab609'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:51.828049 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-28b53583-4652-4c60-8331-c958b28ab609 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e8ad3738ad44b629049e10c58cf27ad', 'request_id': 'req-28b53583-4652-4c60-8331-c958b28ab609'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:51.922536 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-28b53583-4652-4c60-8331-c958b28ab609 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e8ad3738ad44b629049e10c58cf27ad', 'request_id': 'req-28b53583-4652-4c60-8331-c958b28ab609'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:51.934932 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-28b53583-4652-4c60-8331-c958b28ab609 admin admin] The token cache is being invalidate because project 9e8ad3738ad44b629049e10c58cf27ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:34:51.935226 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-28b53583-4652-4c60-8331-c958b28ab609 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:51.935895 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-28b53583-4652-4c60-8331-c958b28ab609 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:51.937421 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1261/2534] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:34:51 2022] DELETE /identity/v3/projects/9e8ad3738ad44b629049e10c58cf27ad => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:34:51.942202 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495b65e-9f43-418d-aea8-3769a8edfa0a None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:51.942673 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495b65e-9f43-418d-aea8-3769a8edfa0a None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:51.942769 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495b65e-9f43-418d-aea8-3769a8edfa0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:51.960823 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-2495b65e-9f43-418d-aea8-3769a8edfa0a None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:34:51.962180 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-2495b65e-9f43-418d-aea8-3769a8edfa0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:52.022034 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1274/2535] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:34:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:34:52.030895 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7dd5c-001e-4706-9a3e-98276caef88b None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:52.031208 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7dd5c-001e-4706-9a3e-98276caef88b None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:52.031487 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7dd5c-001e-4706-9a3e-98276caef88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:52.049210 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-79e7dd5c-001e-4706-9a3e-98276caef88b None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:34:52.050410 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-79e7dd5c-001e-4706-9a3e-98276caef88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:52.058321 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1262/2536] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:34:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:34:52.062762 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2495b65e-9f43-418d-aea8-3769a8edfa0a None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:52.072246 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2495b65e-9f43-418d-aea8-3769a8edfa0a None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:52.077448 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21457912-b320-4125-882f-2b31526796a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:52.078098 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21457912-b320-4125-882f-2b31526796a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:52.078381 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21457912-b320-4125-882f-2b31526796a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:52.078653 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21457912-b320-4125-882f-2b31526796a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:52.079373 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21457912-b320-4125-882f-2b31526796a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:34:52.080113 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21457912-b320-4125-882f-2b31526796a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:52.081699 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21457912-b320-4125-882f-2b31526796a8 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:52.093107 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1275/2537] 10.222.0.24 () {58 vars in 1152 bytes} [Thu Apr 7 06:34:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:34:52.097533 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7dd5c-001e-4706-9a3e-98276caef88b None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:52.106537 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7dd5c-001e-4706-9a3e-98276caef88b None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:52.111165 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36e043-4fac-4a64-9999-12fdae7cca67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:52.111835 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36e043-4fac-4a64-9999-12fdae7cca67 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:52.112139 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36e043-4fac-4a64-9999-12fdae7cca67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:52.112396 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36e043-4fac-4a64-9999-12fdae7cca67 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:52.113085 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc36e043-4fac-4a64-9999-12fdae7cca67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:52.115293 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc36e043-4fac-4a64-9999-12fdae7cca67 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:52.238184 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1263/2538] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:34:52 2022] POST /identity/v3/projects => generated 385 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:34:52.250001 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21457912-b320-4125-882f-2b31526796a8 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:52.260401 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21457912-b320-4125-882f-2b31526796a8 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:52.313422 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36e043-4fac-4a64-9999-12fdae7cca67 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:52.315127 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-cc36e043-4fac-4a64-9999-12fdae7cca67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:52.319622 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff5410f-61c0-471c-9b14-ebbf20ccf6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:52.320337 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5410f-61c0-471c-9b14-ebbf20ccf6cc admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:52.320621 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5410f-61c0-471c-9b14-ebbf20ccf6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:52.320900 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5410f-61c0-471c-9b14-ebbf20ccf6cc admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:52.321666 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff5410f-61c0-471c-9b14-ebbf20ccf6cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:52.323582 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff5410f-61c0-471c-9b14-ebbf20ccf6cc admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:52.370184 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36e043-4fac-4a64-9999-12fdae7cca67 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:52.374673 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ff178-d0a3-4219-a4b0-78719344baac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:52.375305 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ff178-d0a3-4219-a4b0-78719344baac service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:52.375588 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ff178-d0a3-4219-a4b0-78719344baac service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:52.375894 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ff178-d0a3-4219-a4b0-78719344baac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:52.377679 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-da6ff178-d0a3-4219-a4b0-78719344baac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:52.431775 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1276/2539] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:34:52 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:34:52.434738 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff5410f-61c0-471c-9b14-ebbf20ccf6cc admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:52.436289 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6ff178-d0a3-4219-a4b0-78719344baac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:52.437795 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6ff178-d0a3-4219-a4b0-78719344baac service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:52.444271 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff5410f-61c0-471c-9b14-ebbf20ccf6cc admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:52.447146 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1264/2540] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:34:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 07 06:34:52.452486 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca93a95d-d901-42bc-9f97-4e5a567f5f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:52.452486 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93a95d-d901-42bc-9f97-4e5a567f5f07 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:52.452486 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93a95d-d901-42bc-9f97-4e5a567f5f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:52.452486 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93a95d-d901-42bc-9f97-4e5a567f5f07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:52.452898 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca93a95d-d901-42bc-9f97-4e5a567f5f07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:52.452898 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca93a95d-d901-42bc-9f97-4e5a567f5f07 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:52.465662 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1277/2541] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:34:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 07 06:34:52.466901 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ff178-d0a3-4219-a4b0-78719344baac service cinder] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:52.477931 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ff178-d0a3-4219-a4b0-78719344baac service cinder] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:52.483346 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f455d2-b6a7-47da-9e43-a576ebf1107f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:52.484069 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f455d2-b6a7-47da-9e43-a576ebf1107f admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:52.484405 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f455d2-b6a7-47da-9e43-a576ebf1107f admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:52.484686 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f455d2-b6a7-47da-9e43-a576ebf1107f admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:52.485409 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f455d2-b6a7-47da-9e43-a576ebf1107f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:52.487012 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f455d2-b6a7-47da-9e43-a576ebf1107f admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:52.497927 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1265/2542] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:34:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:34:52.502289 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca93a95d-d901-42bc-9f97-4e5a567f5f07 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:52.512744 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca93a95d-d901-42bc-9f97-4e5a567f5f07 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:52.518637 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30ace9-244e-44b0-9fff-11446f060c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:52.519625 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30ace9-244e-44b0-9fff-11446f060c40 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:52.524236 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30ace9-244e-44b0-9fff-11446f060c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:52.524236 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30ace9-244e-44b0-9fff-11446f060c40 admin admin] PATH_INFO: `/v3/projects/0845e6e91df54d95948c9c66c27766b4/users/8cc121825b8541408cb028b4c0dbe357/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:52.536088 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e30ace9-244e-44b0-9fff-11446f060c40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0845e6e91df54d95948c9c66c27766b4, user_id=8cc121825b8541408cb028b4c0dbe357, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:52.538762 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e30ace9-244e-44b0-9fff-11446f060c40 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:52.609070 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1278/2543] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:34:52 2022] PUT /identity/v3/projects/0845e6e91df54d95948c9c66c27766b4/users/8cc121825b8541408cb028b4c0dbe357/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:34:52.619580 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0941db-8016-489a-8c00-5045b8b0142d None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:52.619771 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0941db-8016-489a-8c00-5045b8b0142d None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:52.620079 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0941db-8016-489a-8c00-5045b8b0142d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:52.646372 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-cb0941db-8016-489a-8c00-5045b8b0142d None None] MFA Rules not processed for user `8cc121825b8541408cb028b4c0dbe357`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:34:52.647585 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-cb0941db-8016-489a-8c00-5045b8b0142d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:52.713741 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1266/2544] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:34:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:34:53.162400 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30ace9-244e-44b0-9fff-11446f060c40 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:53.165353 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-4e30ace9-244e-44b0-9fff-11446f060c40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:53.221183 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30ace9-244e-44b0-9fff-11446f060c40 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:53.224923 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0154b2b-ebbd-42bc-b513-f0fd1ba1c707 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:53.225561 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0154b2b-ebbd-42bc-b513-f0fd1ba1c707 service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:53.225852 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0154b2b-ebbd-42bc-b513-f0fd1ba1c707 service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:53.226129 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0154b2b-ebbd-42bc-b513-f0fd1ba1c707 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:53.236755 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0154b2b-ebbd-42bc-b513-f0fd1ba1c707 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:53.238470 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0154b2b-ebbd-42bc-b513-f0fd1ba1c707 service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:53.248630 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1279/2545] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:34:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:34:53.267855 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0941db-8016-489a-8c00-5045b8b0142d None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:53.336932 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0941db-8016-489a-8c00-5045b8b0142d None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:53.341565 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a25042-da2f-42f6-b534-f2509c35f9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:53.342464 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a25042-da2f-42f6-b534-f2509c35f9db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:53.342746 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a25042-da2f-42f6-b534-f2509c35f9db admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:53.343019 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a25042-da2f-42f6-b534-f2509c35f9db admin admin] PATH_INFO: `/v3/users/8cc121825b8541408cb028b4c0dbe357` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:53.344254 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a25042-da2f-42f6-b534-f2509c35f9db admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cc121825b8541408cb028b4c0dbe357)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:53.346165 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a25042-da2f-42f6-b534-f2509c35f9db admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:53.621623 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-51a25042-da2f-42f6-b534-f2509c35f9db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cc121825b8541408cb028b4c0dbe357'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:53.622278 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-51a25042-da2f-42f6-b534-f2509c35f9db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cc121825b8541408cb028b4c0dbe357'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:53.877265 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-51a25042-da2f-42f6-b534-f2509c35f9db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cc121825b8541408cb028b4c0dbe357'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:53.877973 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-51a25042-da2f-42f6-b534-f2509c35f9db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cc121825b8541408cb028b4c0dbe357'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:53.890067 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-51a25042-da2f-42f6-b534-f2509c35f9db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cc121825b8541408cb028b4c0dbe357'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:53.911562 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1267/2546] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:34:53 2022] DELETE /identity/v3/users/8cc121825b8541408cb028b4c0dbe357 => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:34:53.912702 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f0b3c-6472-4847-9773-6baca785e16f None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:53.912702 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f0b3c-6472-4847-9773-6baca785e16f None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:53.912702 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f0b3c-6472-4847-9773-6baca785e16f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:53.924707 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-f09f0b3c-6472-4847-9773-6baca785e16f None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:34:53.925904 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f09f0b3c-6472-4847-9773-6baca785e16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:53.982953 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1280/2547] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:34:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:34:53.997712 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a25042-da2f-42f6-b534-f2509c35f9db admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:53.999118 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-51a25042-da2f-42f6-b534-f2509c35f9db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:54.054697 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a25042-da2f-42f6-b534-f2509c35f9db admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:54.058344 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e8a467-08cd-4efe-8c94-0051f4e081a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:54.058998 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8a467-08cd-4efe-8c94-0051f4e081a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:54.059285 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8a467-08cd-4efe-8c94-0051f4e081a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:54.059591 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8a467-08cd-4efe-8c94-0051f4e081a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:54.068339 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e8a467-08cd-4efe-8c94-0051f4e081a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:54.069781 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e8a467-08cd-4efe-8c94-0051f4e081a9 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:54.079101 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1268/2548] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:34:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 07 06:34:54.576816 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09f0b3c-6472-4847-9773-6baca785e16f None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:54.578619 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f09f0b3c-6472-4847-9773-6baca785e16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:54.592702 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09f0b3c-6472-4847-9773-6baca785e16f None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:54.598841 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f6ac15-b2cd-4ea8-b74d-4b3e745eddb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:54.599314 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6ac15-b2cd-4ea8-b74d-4b3e745eddb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:54.599594 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6ac15-b2cd-4ea8-b74d-4b3e745eddb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:54.599965 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6ac15-b2cd-4ea8-b74d-4b3e745eddb1 admin admin] PATH_INFO: `/v3/projects/0845e6e91df54d95948c9c66c27766b4` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:54.601488 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f6ac15-b2cd-4ea8-b74d-4b3e745eddb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0845e6e91df54d95948c9c66c27766b4)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:54.603586 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f6ac15-b2cd-4ea8-b74d-4b3e745eddb1 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:54.626408 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e8a467-08cd-4efe-8c94-0051f4e081a9 service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:54.628026 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-64e8a467-08cd-4efe-8c94-0051f4e081a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:54.693830 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e8a467-08cd-4efe-8c94-0051f4e081a9 service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:54.697997 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b1343e-5d55-4e27-87c8-0aaa6968ca1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:54.698668 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1343e-5d55-4e27-87c8-0aaa6968ca1e service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:54.698960 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1343e-5d55-4e27-87c8-0aaa6968ca1e service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:54.699244 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1343e-5d55-4e27-87c8-0aaa6968ca1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:54.701769 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-97b1343e-5d55-4e27-87c8-0aaa6968ca1e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:54.739110 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-e2f6ac15-b2cd-4ea8-b74d-4b3e745eddb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0845e6e91df54d95948c9c66c27766b4', 'request_id': 'req-e2f6ac15-b2cd-4ea8-b74d-4b3e745eddb1'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:54.750667 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-e2f6ac15-b2cd-4ea8-b74d-4b3e745eddb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0845e6e91df54d95948c9c66c27766b4', 'request_id': 'req-e2f6ac15-b2cd-4ea8-b74d-4b3e745eddb1'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:54.800249 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b1343e-5d55-4e27-87c8-0aaa6968ca1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:54.800249 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b1343e-5d55-4e27-87c8-0aaa6968ca1e service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:54.807582 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1269/2549] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:34:54 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 07 06:34:54.848146 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-e2f6ac15-b2cd-4ea8-b74d-4b3e745eddb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0845e6e91df54d95948c9c66c27766b4', 'request_id': 'req-e2f6ac15-b2cd-4ea8-b74d-4b3e745eddb1'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:54.859228 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-e2f6ac15-b2cd-4ea8-b74d-4b3e745eddb1 admin admin] The token cache is being invalidate because project 0845e6e91df54d95948c9c66c27766b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:34:54.859554 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-e2f6ac15-b2cd-4ea8-b74d-4b3e745eddb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:54.860217 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-e2f6ac15-b2cd-4ea8-b74d-4b3e745eddb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:34:54.861774 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1281/2550] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:34:54 2022] DELETE /identity/v3/projects/0845e6e91df54d95948c9c66c27766b4 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:34:54.866848 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f76ec-c4af-4480-be83-d498854c8c72 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:54.867145 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f76ec-c4af-4480-be83-d498854c8c72 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:54.867427 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f76ec-c4af-4480-be83-d498854c8c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:54.884935 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-3b2f76ec-c4af-4480-be83-d498854c8c72 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:34:54.886133 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-3b2f76ec-c4af-4480-be83-d498854c8c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:54.943135 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1270/2551] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:34:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:34:54.951089 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09982b1-77ba-43c4-a84c-c8c8258df22e None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:54.951410 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09982b1-77ba-43c4-a84c-c8c8258df22e None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:54.951691 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09982b1-77ba-43c4-a84c-c8c8258df22e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:54.970294 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-f09982b1-77ba-43c4-a84c-c8c8258df22e None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:34:54.971479 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f09982b1-77ba-43c4-a84c-c8c8258df22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:54.979353 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1282/2552] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:34:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:34:54.984085 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2f76ec-c4af-4480-be83-d498854c8c72 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:54.993552 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2f76ec-c4af-4480-be83-d498854c8c72 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:54.998136 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e85b02-e1b9-45f0-b056-1fc920acd9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:55.000783 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e85b02-e1b9-45f0-b056-1fc920acd9d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:55.000783 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e85b02-e1b9-45f0-b056-1fc920acd9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:55.000783 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e85b02-e1b9-45f0-b056-1fc920acd9d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:55.000783 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e85b02-e1b9-45f0-b056-1fc920acd9d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:34:55.000783 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e85b02-e1b9-45f0-b056-1fc920acd9d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:55.002038 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e85b02-e1b9-45f0-b056-1fc920acd9d0 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:55.013192 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1271/2553] 10.222.0.24 () {58 vars in 1152 bytes} [Thu Apr 7 06:34:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:34:55.017259 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09982b1-77ba-43c4-a84c-c8c8258df22e None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:55.026663 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09982b1-77ba-43c4-a84c-c8c8258df22e None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:55.032439 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f104db-aa00-43e5-be66-d9df954d9c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:55.033115 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f104db-aa00-43e5-be66-d9df954d9c02 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:55.033404 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f104db-aa00-43e5-be66-d9df954d9c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:55.033683 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f104db-aa00-43e5-be66-d9df954d9c02 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:55.034396 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f104db-aa00-43e5-be66-d9df954d9c02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:55.036405 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f104db-aa00-43e5-be66-d9df954d9c02 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:55.169828 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1283/2554] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:34:55 2022] POST /identity/v3/projects => generated 375 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:34:55.173851 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e85b02-e1b9-45f0-b056-1fc920acd9d0 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:55.183928 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e85b02-e1b9-45f0-b056-1fc920acd9d0 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:55.242921 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790d51bf-bcf5-4e43-8e34-ba19bc2c3050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:55.243613 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d51bf-bcf5-4e43-8e34-ba19bc2c3050 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:55.244250 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d51bf-bcf5-4e43-8e34-ba19bc2c3050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:55.244561 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d51bf-bcf5-4e43-8e34-ba19bc2c3050 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:55.245314 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790d51bf-bcf5-4e43-8e34-ba19bc2c3050 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:55.247254 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790d51bf-bcf5-4e43-8e34-ba19bc2c3050 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:55.339234 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1272/2555] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:34:55 2022] POST /identity/v3/users => generated 288 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:34:55.343910 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f104db-aa00-43e5-be66-d9df954d9c02 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:55.354222 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f104db-aa00-43e5-be66-d9df954d9c02 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:55.358960 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e3d998-e3e4-4a9a-afba-4d5a7cf7b1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:55.359639 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e3d998-e3e4-4a9a-afba-4d5a7cf7b1cc admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:55.360336 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e3d998-e3e4-4a9a-afba-4d5a7cf7b1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:55.360336 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e3d998-e3e4-4a9a-afba-4d5a7cf7b1cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:55.360986 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e3d998-e3e4-4a9a-afba-4d5a7cf7b1cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:55.362559 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e3d998-e3e4-4a9a-afba-4d5a7cf7b1cc admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:55.373558 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1284/2556] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:34:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:34:55.377782 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790d51bf-bcf5-4e43-8e34-ba19bc2c3050 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:55.387985 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790d51bf-bcf5-4e43-8e34-ba19bc2c3050 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:55.394772 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe692c9e-841e-429f-9e27-fe1d550fd01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:55.394772 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe692c9e-841e-429f-9e27-fe1d550fd01c admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:55.394772 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe692c9e-841e-429f-9e27-fe1d550fd01c admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:55.394772 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe692c9e-841e-429f-9e27-fe1d550fd01c admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:55.395184 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe692c9e-841e-429f-9e27-fe1d550fd01c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:55.396180 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe692c9e-841e-429f-9e27-fe1d550fd01c admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:55.406508 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1273/2557] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:34:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:34:55.410659 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e3d998-e3e4-4a9a-afba-4d5a7cf7b1cc admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:55.420647 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e3d998-e3e4-4a9a-afba-4d5a7cf7b1cc admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:55.425327 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc7d10-fe0a-4a99-bf69-924938e94b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:55.426195 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc7d10-fe0a-4a99-bf69-924938e94b27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:55.426478 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc7d10-fe0a-4a99-bf69-924938e94b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:55.426752 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc7d10-fe0a-4a99-bf69-924938e94b27 admin admin] PATH_INFO: `/v3/projects/e291fb95263145a5a84c4d5d53021e3c/users/5952cf6c335f40128a78eb688e747eb6/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:55.441047 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bc7d10-fe0a-4a99-bf69-924938e94b27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e291fb95263145a5a84c4d5d53021e3c, user_id=5952cf6c335f40128a78eb688e747eb6, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:55.443688 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bc7d10-fe0a-4a99-bf69-924938e94b27 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:55.636837 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1285/2558] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:34:55 2022] PUT /identity/v3/projects/e291fb95263145a5a84c4d5d53021e3c/users/5952cf6c335f40128a78eb688e747eb6/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:34:55.648561 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d74ebf-57e8-4e42-a09a-6869cbaadde2 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:55.649029 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d74ebf-57e8-4e42-a09a-6869cbaadde2 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:55.649147 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d74ebf-57e8-4e42-a09a-6869cbaadde2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:55.675147 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-29d74ebf-57e8-4e42-a09a-6869cbaadde2 None None] MFA Rules not processed for user `5952cf6c335f40128a78eb688e747eb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:34:55.676379 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-29d74ebf-57e8-4e42-a09a-6869cbaadde2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:55.738356 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1274/2559] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:34:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:34:55.750003 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc7d10-fe0a-4a99-bf69-924938e94b27 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:34:55.755079 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-84bc7d10-fe0a-4a99-bf69-924938e94b27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:34:55.809451 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc7d10-fe0a-4a99-bf69-924938e94b27 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:34:55.813961 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09e2f95-823c-4c37-87e3-5072e1854fdc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:34:55.814653 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e2f95-823c-4c37-87e3-5072e1854fdc service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:34:55.818263 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e2f95-823c-4c37-87e3-5072e1854fdc service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:34:55.818263 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e2f95-823c-4c37-87e3-5072e1854fdc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:34:55.825892 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09e2f95-823c-4c37-87e3-5072e1854fdc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:34:55.828018 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09e2f95-823c-4c37-87e3-5072e1854fdc service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:34:55.837215 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1286/2560] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:34:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:35:02.377557 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d74ebf-57e8-4e42-a09a-6869cbaadde2 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:02.379023 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-29d74ebf-57e8-4e42-a09a-6869cbaadde2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:02.441312 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d74ebf-57e8-4e42-a09a-6869cbaadde2 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:02.446171 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c988ea9-3a6d-4aec-9e2d-c624015502ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:02.447044 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c988ea9-3a6d-4aec-9e2d-c624015502ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:02.447363 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c988ea9-3a6d-4aec-9e2d-c624015502ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:02.447628 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c988ea9-3a6d-4aec-9e2d-c624015502ae admin admin] PATH_INFO: `/v3/users/c2cba139ac234e688acbdd54ffb1aa98` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:02.448834 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c988ea9-3a6d-4aec-9e2d-c624015502ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2cba139ac234e688acbdd54ffb1aa98)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:02.450777 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c988ea9-3a6d-4aec-9e2d-c624015502ae admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:02.609689 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-3c988ea9-3a6d-4aec-9e2d-c624015502ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2cba139ac234e688acbdd54ffb1aa98'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:02.610387 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-3c988ea9-3a6d-4aec-9e2d-c624015502ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2cba139ac234e688acbdd54ffb1aa98'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:02.664698 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-3c988ea9-3a6d-4aec-9e2d-c624015502ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2cba139ac234e688acbdd54ffb1aa98'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:02.665313 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-3c988ea9-3a6d-4aec-9e2d-c624015502ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2cba139ac234e688acbdd54ffb1aa98'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:02.677413 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-3c988ea9-3a6d-4aec-9e2d-c624015502ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2cba139ac234e688acbdd54ffb1aa98'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:02.689341 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1275/2561] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:35:02 2022] DELETE /identity/v3/users/c2cba139ac234e688acbdd54ffb1aa98 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:35:02.694146 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9729ef-5ce1-41aa-815c-c2b7854150b4 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:02.694625 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9729ef-5ce1-41aa-815c-c2b7854150b4 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:02.694747 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9729ef-5ce1-41aa-815c-c2b7854150b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:02.711564 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-ef9729ef-5ce1-41aa-815c-c2b7854150b4 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:35:02.712771 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-ef9729ef-5ce1-41aa-815c-c2b7854150b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:02.769800 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1287/2562] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:35:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:35:02.780470 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c988ea9-3a6d-4aec-9e2d-c624015502ae admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:02.782535 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-3c988ea9-3a6d-4aec-9e2d-c624015502ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:02.838504 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c988ea9-3a6d-4aec-9e2d-c624015502ae admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:02.842274 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb3303-83e6-488e-a09a-c01e05d484ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:02.843633 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb3303-83e6-488e-a09a-c01e05d484ad service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:02.843955 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb3303-83e6-488e-a09a-c01e05d484ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:02.844234 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb3303-83e6-488e-a09a-c01e05d484ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:02.853137 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb3303-83e6-488e-a09a-c01e05d484ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:02.854633 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb3303-83e6-488e-a09a-c01e05d484ad service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:02.864309 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1276/2563] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:35:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:35:03.364092 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9729ef-5ce1-41aa-815c-c2b7854150b4 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:03.365805 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-ef9729ef-5ce1-41aa-815c-c2b7854150b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:03.381298 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9729ef-5ce1-41aa-815c-c2b7854150b4 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:03.387295 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c301d7-2e0e-493f-86a1-cb8264097331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:03.392683 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c301d7-2e0e-493f-86a1-cb8264097331 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:03.392683 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c301d7-2e0e-493f-86a1-cb8264097331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:03.392683 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c301d7-2e0e-493f-86a1-cb8264097331 admin admin] PATH_INFO: `/v3/projects/f1e0bc4a32b14e069e409de15a94390a` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:03.392683 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c301d7-2e0e-493f-86a1-cb8264097331 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1e0bc4a32b14e069e409de15a94390a)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:03.392683 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c301d7-2e0e-493f-86a1-cb8264097331 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:03.508340 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-83c301d7-2e0e-493f-86a1-cb8264097331 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1e0bc4a32b14e069e409de15a94390a', 'request_id': 'req-83c301d7-2e0e-493f-86a1-cb8264097331'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:03.514501 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-83c301d7-2e0e-493f-86a1-cb8264097331 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1e0bc4a32b14e069e409de15a94390a', 'request_id': 'req-83c301d7-2e0e-493f-86a1-cb8264097331'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:03.552940 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb3303-83e6-488e-a09a-c01e05d484ad service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:03.554333 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-6dbb3303-83e6-488e-a09a-c01e05d484ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:03.567668 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb3303-83e6-488e-a09a-c01e05d484ad service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:03.589790 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-83c301d7-2e0e-493f-86a1-cb8264097331 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1e0bc4a32b14e069e409de15a94390a', 'request_id': 'req-83c301d7-2e0e-493f-86a1-cb8264097331'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:03.601568 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-83c301d7-2e0e-493f-86a1-cb8264097331 admin admin] The token cache is being invalidate because project f1e0bc4a32b14e069e409de15a94390a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:35:03.601856 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-83c301d7-2e0e-493f-86a1-cb8264097331 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:03.602481 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-83c301d7-2e0e-493f-86a1-cb8264097331 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:03.604072 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1288/2564] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:35:03 2022] DELETE /identity/v3/projects/f1e0bc4a32b14e069e409de15a94390a => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:35:03.608024 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c301d7-2e0e-493f-86a1-cb8264097331 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:03.610431 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-83c301d7-2e0e-493f-86a1-cb8264097331 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:03.621952 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd525ace-e4a4-4943-8d4a-a6621fded26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:03.622834 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd525ace-e4a4-4943-8d4a-a6621fded26a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:03.623133 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd525ace-e4a4-4943-8d4a-a6621fded26a admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:03.623426 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd525ace-e4a4-4943-8d4a-a6621fded26a admin admin] PATH_INFO: `/v3/users/5952cf6c335f40128a78eb688e747eb6` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:03.625329 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd525ace-e4a4-4943-8d4a-a6621fded26a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5952cf6c335f40128a78eb688e747eb6)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:03.627258 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd525ace-e4a4-4943-8d4a-a6621fded26a admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:03.691308 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c301d7-2e0e-493f-86a1-cb8264097331 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:03.695946 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e02641-08e1-4ce6-ba8a-2fc5b5260441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:03.696818 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e02641-08e1-4ce6-ba8a-2fc5b5260441 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:03.697103 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e02641-08e1-4ce6-ba8a-2fc5b5260441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:03.697376 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e02641-08e1-4ce6-ba8a-2fc5b5260441 admin admin] PATH_INFO: `/v3/users/9df8faa77c0d4af9b31b7fc700756736` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:03.698647 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e02641-08e1-4ce6-ba8a-2fc5b5260441 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9df8faa77c0d4af9b31b7fc700756736)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:03.700638 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e02641-08e1-4ce6-ba8a-2fc5b5260441 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:03.825274 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-bd525ace-e4a4-4943-8d4a-a6621fded26a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5952cf6c335f40128a78eb688e747eb6'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:03.825884 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-bd525ace-e4a4-4943-8d4a-a6621fded26a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5952cf6c335f40128a78eb688e747eb6'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:03.899069 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-bd525ace-e4a4-4943-8d4a-a6621fded26a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5952cf6c335f40128a78eb688e747eb6'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:03.899716 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-bd525ace-e4a4-4943-8d4a-a6621fded26a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5952cf6c335f40128a78eb688e747eb6'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:03.912663 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-bd525ace-e4a4-4943-8d4a-a6621fded26a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5952cf6c335f40128a78eb688e747eb6'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:03.913504 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-06e02641-08e1-4ce6-ba8a-2fc5b5260441 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9df8faa77c0d4af9b31b7fc700756736'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:03.929210 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-06e02641-08e1-4ce6-ba8a-2fc5b5260441 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9df8faa77c0d4af9b31b7fc700756736'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:03.931019 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1277/2565] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:35:03 2022] DELETE /identity/v3/users/5952cf6c335f40128a78eb688e747eb6 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:35:03.935448 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93935e1c-74e8-478d-a918-01c20dc9d0c9 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:03.935736 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93935e1c-74e8-478d-a918-01c20dc9d0c9 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:03.936042 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93935e1c-74e8-478d-a918-01c20dc9d0c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:03.953654 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-93935e1c-74e8-478d-a918-01c20dc9d0c9 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:35:03.954925 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-93935e1c-74e8-478d-a918-01c20dc9d0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:04.002066 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-06e02641-08e1-4ce6-ba8a-2fc5b5260441 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9df8faa77c0d4af9b31b7fc700756736'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:04.002691 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-06e02641-08e1-4ce6-ba8a-2fc5b5260441 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9df8faa77c0d4af9b31b7fc700756736'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:04.003304 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-06e02641-08e1-4ce6-ba8a-2fc5b5260441 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9df8faa77c0d4af9b31b7fc700756736'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:04.012053 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1278/2566] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:35:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:35:04.016658 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1289/2567] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:35:03 2022] DELETE /identity/v3/users/9df8faa77c0d4af9b31b7fc700756736 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:35:04.025014 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93935e1c-74e8-478d-a918-01c20dc9d0c9 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:04.026376 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-93935e1c-74e8-478d-a918-01c20dc9d0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:04.085148 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93935e1c-74e8-478d-a918-01c20dc9d0c9 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:04.133295 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d1534c-a3fb-4510-9ad9-c2d23bf3b1b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:04.133946 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d1534c-a3fb-4510-9ad9-c2d23bf3b1b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:04.134231 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d1534c-a3fb-4510-9ad9-c2d23bf3b1b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:04.134503 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d1534c-a3fb-4510-9ad9-c2d23bf3b1b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:04.191015 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d1534c-a3fb-4510-9ad9-c2d23bf3b1b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:04.192543 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d1534c-a3fb-4510-9ad9-c2d23bf3b1b8 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:04.201855 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1279/2568] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:35:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:35:04.460695 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e02641-08e1-4ce6-ba8a-2fc5b5260441 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:04.462222 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-06e02641-08e1-4ce6-ba8a-2fc5b5260441 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:04.478017 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e02641-08e1-4ce6-ba8a-2fc5b5260441 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:04.483195 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115a1c3-55ab-4968-9bed-2914a4fbb64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:04.484302 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115a1c3-55ab-4968-9bed-2914a4fbb64b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:04.484938 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115a1c3-55ab-4968-9bed-2914a4fbb64b admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:04.484938 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115a1c3-55ab-4968-9bed-2914a4fbb64b admin admin] PATH_INFO: `/v3/projects/be066481521447e888b6e4e2c3fcce2c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:04.487416 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3115a1c3-55ab-4968-9bed-2914a4fbb64b admin admin] RBAC: Authorizing `identity:delete_project(project_id=be066481521447e888b6e4e2c3fcce2c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:04.489493 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3115a1c3-55ab-4968-9bed-2914a4fbb64b admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:04.603632 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3115a1c3-55ab-4968-9bed-2914a4fbb64b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be066481521447e888b6e4e2c3fcce2c', 'request_id': 'req-3115a1c3-55ab-4968-9bed-2914a4fbb64b'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:04.609713 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3115a1c3-55ab-4968-9bed-2914a4fbb64b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be066481521447e888b6e4e2c3fcce2c', 'request_id': 'req-3115a1c3-55ab-4968-9bed-2914a4fbb64b'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:04.666909 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d1534c-a3fb-4510-9ad9-c2d23bf3b1b8 service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:04.670099 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-76d1534c-a3fb-4510-9ad9-c2d23bf3b1b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:04.686235 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d1534c-a3fb-4510-9ad9-c2d23bf3b1b8 service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:04.693790 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3115a1c3-55ab-4968-9bed-2914a4fbb64b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be066481521447e888b6e4e2c3fcce2c', 'request_id': 'req-3115a1c3-55ab-4968-9bed-2914a4fbb64b'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:04.713882 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3115a1c3-55ab-4968-9bed-2914a4fbb64b admin admin] The token cache is being invalidate because project be066481521447e888b6e4e2c3fcce2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:35:04.716197 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3115a1c3-55ab-4968-9bed-2914a4fbb64b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:04.718422 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3115a1c3-55ab-4968-9bed-2914a4fbb64b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:04.723379 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1290/2569] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:35:04 2022] DELETE /identity/v3/projects/be066481521447e888b6e4e2c3fcce2c => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:35:04.728552 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115a1c3-55ab-4968-9bed-2914a4fbb64b admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:04.732128 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-3115a1c3-55ab-4968-9bed-2914a4fbb64b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:04.810351 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562ee30-5e82-4f60-b5e6-abae2da5d74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:04.812451 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562ee30-5e82-4f60-b5e6-abae2da5d74f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:04.812949 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562ee30-5e82-4f60-b5e6-abae2da5d74f admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:04.813428 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562ee30-5e82-4f60-b5e6-abae2da5d74f admin admin] PATH_INFO: `/v3/projects/e291fb95263145a5a84c4d5d53021e3c` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:04.815102 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c562ee30-5e82-4f60-b5e6-abae2da5d74f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e291fb95263145a5a84c4d5d53021e3c)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:04.818745 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c562ee30-5e82-4f60-b5e6-abae2da5d74f admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:04.822004 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115a1c3-55ab-4968-9bed-2914a4fbb64b admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:04.828287 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f4678-127f-402e-9f55-741a93d39fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:04.829460 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f4678-127f-402e-9f55-741a93d39fb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:04.829950 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f4678-127f-402e-9f55-741a93d39fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:04.830460 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f4678-127f-402e-9f55-741a93d39fb0 admin admin] PATH_INFO: `/v3/users/715fce2a07d24d8a993335c35a525b75` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:04.832041 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8f4678-127f-402e-9f55-741a93d39fb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=715fce2a07d24d8a993335c35a525b75)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:04.835545 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8f4678-127f-402e-9f55-741a93d39fb0 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:05.026689 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-4f8f4678-127f-402e-9f55-741a93d39fb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '715fce2a07d24d8a993335c35a525b75'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:05.026914 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-c562ee30-5e82-4f60-b5e6-abae2da5d74f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e291fb95263145a5a84c4d5d53021e3c', 'request_id': 'req-c562ee30-5e82-4f60-b5e6-abae2da5d74f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:05.032142 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-c562ee30-5e82-4f60-b5e6-abae2da5d74f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e291fb95263145a5a84c4d5d53021e3c', 'request_id': 'req-c562ee30-5e82-4f60-b5e6-abae2da5d74f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:05.038478 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-4f8f4678-127f-402e-9f55-741a93d39fb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '715fce2a07d24d8a993335c35a525b75'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:05.104715 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-c562ee30-5e82-4f60-b5e6-abae2da5d74f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e291fb95263145a5a84c4d5d53021e3c', 'request_id': 'req-c562ee30-5e82-4f60-b5e6-abae2da5d74f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:05.116681 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-c562ee30-5e82-4f60-b5e6-abae2da5d74f admin admin] The token cache is being invalidate because project e291fb95263145a5a84c4d5d53021e3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:35:05.117002 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-c562ee30-5e82-4f60-b5e6-abae2da5d74f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:05.117649 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-c562ee30-5e82-4f60-b5e6-abae2da5d74f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:05.119168 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1280/2570] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:35:04 2022] DELETE /identity/v3/projects/e291fb95263145a5a84c4d5d53021e3c => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:35:05.119950 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562ee30-5e82-4f60-b5e6-abae2da5d74f admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:05.121260 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-c562ee30-5e82-4f60-b5e6-abae2da5d74f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:05.183330 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562ee30-5e82-4f60-b5e6-abae2da5d74f admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:05.188124 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f0596d-0261-4492-b843-e02957345953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:05.189035 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0596d-0261-4492-b843-e02957345953 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:05.189326 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0596d-0261-4492-b843-e02957345953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:05.189620 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0596d-0261-4492-b843-e02957345953 admin admin] PATH_INFO: `/v3/users/468235c07abc4df28dba80e0c1fcfa8f` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:05.190828 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f0596d-0261-4492-b843-e02957345953 admin admin] RBAC: Authorizing `identity:delete_user(user_id=468235c07abc4df28dba80e0c1fcfa8f)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:05.192772 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f0596d-0261-4492-b843-e02957345953 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:05.196338 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-4f8f4678-127f-402e-9f55-741a93d39fb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '715fce2a07d24d8a993335c35a525b75'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:05.196967 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-4f8f4678-127f-402e-9f55-741a93d39fb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '715fce2a07d24d8a993335c35a525b75'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:05.197590 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-4f8f4678-127f-402e-9f55-741a93d39fb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '715fce2a07d24d8a993335c35a525b75'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:05.210901 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1291/2571] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:35:04 2022] DELETE /identity/v3/users/715fce2a07d24d8a993335c35a525b75 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:35:05.212228 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185a405-90c6-4380-9252-1eb2e4f586ef None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:05.212519 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185a405-90c6-4380-9252-1eb2e4f586ef None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:05.212797 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185a405-90c6-4380-9252-1eb2e4f586ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:05.234300 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-9185a405-90c6-4380-9252-1eb2e4f586ef None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:35:05.235507 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-9185a405-90c6-4380-9252-1eb2e4f586ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:05.294907 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1292/2572] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:35:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:35:05.303420 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27749c43-ecbd-4da9-89fc-f50a33d62a9e None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:05.303710 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27749c43-ecbd-4da9-89fc-f50a33d62a9e None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:05.304021 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27749c43-ecbd-4da9-89fc-f50a33d62a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:05.321399 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-27749c43-ecbd-4da9-89fc-f50a33d62a9e None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:35:05.322574 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-27749c43-ecbd-4da9-89fc-f50a33d62a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:05.330293 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1293/2573] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:35:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:35:05.334327 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27749c43-ecbd-4da9-89fc-f50a33d62a9e None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:05.343300 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27749c43-ecbd-4da9-89fc-f50a33d62a9e None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:05.347899 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d05607-5d06-43a5-b274-5653ac435267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:05.348521 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d05607-5d06-43a5-b274-5653ac435267 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:05.348802 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d05607-5d06-43a5-b274-5653ac435267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:05.349074 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d05607-5d06-43a5-b274-5653ac435267 admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:05.349813 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d05607-5d06-43a5-b274-5653ac435267 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:35:05.350114 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d05607-5d06-43a5-b274-5653ac435267 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:05.351669 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d05607-5d06-43a5-b274-5653ac435267 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:05.363174 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1294/2574] 10.222.0.24 () {58 vars in 1152 bytes} [Thu Apr 7 06:35:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:35:05.367682 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d05607-5d06-43a5-b274-5653ac435267 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:05.377083 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d05607-5d06-43a5-b274-5653ac435267 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:05.381958 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d7834-8916-420c-a71f-c0332574ff22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:05.382578 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d7834-8916-420c-a71f-c0332574ff22 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:05.382879 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d7834-8916-420c-a71f-c0332574ff22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:05.383143 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d7834-8916-420c-a71f-c0332574ff22 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:05.383847 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871d7834-8916-420c-a71f-c0332574ff22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:05.385704 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871d7834-8916-420c-a71f-c0332574ff22 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:05.440521 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-93f0596d-0261-4492-b843-e02957345953 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '468235c07abc4df28dba80e0c1fcfa8f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:05.441181 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-93f0596d-0261-4492-b843-e02957345953 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '468235c07abc4df28dba80e0c1fcfa8f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:05.568519 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-93f0596d-0261-4492-b843-e02957345953 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '468235c07abc4df28dba80e0c1fcfa8f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:05.569169 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-93f0596d-0261-4492-b843-e02957345953 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '468235c07abc4df28dba80e0c1fcfa8f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:05.578233 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1295/2575] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:35:05 2022] POST /identity/v3/projects => generated 371 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:35:05.582547 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d7834-8916-420c-a71f-c0332574ff22 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:05.582959 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-93f0596d-0261-4492-b843-e02957345953 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '468235c07abc4df28dba80e0c1fcfa8f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:05.585073 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-871d7834-8916-420c-a71f-c0332574ff22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:05.599440 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1281/2576] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:35:05 2022] DELETE /identity/v3/users/468235c07abc4df28dba80e0c1fcfa8f => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:35:05.603704 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aeb079-a6f9-4da1-ae1b-11c221bdfa85 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:05.604095 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aeb079-a6f9-4da1-ae1b-11c221bdfa85 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:05.604335 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aeb079-a6f9-4da1-ae1b-11c221bdfa85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:05.625393 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-c7aeb079-a6f9-4da1-ae1b-11c221bdfa85 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:35:05.626644 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-c7aeb079-a6f9-4da1-ae1b-11c221bdfa85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:05.663083 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d7834-8916-420c-a71f-c0332574ff22 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:05.694663 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1282/2577] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:35:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:35:05.694663 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aeb079-a6f9-4da1-ae1b-11c221bdfa85 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:05.701538 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-c7aeb079-a6f9-4da1-ae1b-11c221bdfa85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:05.715097 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aeb079-a6f9-4da1-ae1b-11c221bdfa85 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:05.720538 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db729ee9-c8df-43d0-9263-94cf934dabb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:05.721475 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db729ee9-c8df-43d0-9263-94cf934dabb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:05.721764 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db729ee9-c8df-43d0-9263-94cf934dabb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:05.722034 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db729ee9-c8df-43d0-9263-94cf934dabb9 admin admin] PATH_INFO: `/v3/projects/e6435b4059a84266887a17913c393a04` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:05.723223 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db729ee9-c8df-43d0-9263-94cf934dabb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6435b4059a84266887a17913c393a04)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:05.725179 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db729ee9-c8df-43d0-9263-94cf934dabb9 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:05.736821 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d765de-a404-404d-827b-723507d067d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:05.737526 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d765de-a404-404d-827b-723507d067d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:05.737813 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d765de-a404-404d-827b-723507d067d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:05.738090 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d765de-a404-404d-827b-723507d067d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:05.738814 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d765de-a404-404d-827b-723507d067d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:05.741040 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d765de-a404-404d-827b-723507d067d5 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:05.835602 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-db729ee9-c8df-43d0-9263-94cf934dabb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6435b4059a84266887a17913c393a04', 'request_id': 'req-db729ee9-c8df-43d0-9263-94cf934dabb9'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:05.840832 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-db729ee9-c8df-43d0-9263-94cf934dabb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6435b4059a84266887a17913c393a04', 'request_id': 'req-db729ee9-c8df-43d0-9263-94cf934dabb9'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:05.853986 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1296/2578] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:35:05 2022] POST /identity/v3/users => generated 286 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:35:05.854958 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d765de-a404-404d-827b-723507d067d5 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:05.856735 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-91d765de-a404-404d-827b-723507d067d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:05.911631 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d765de-a404-404d-827b-723507d067d5 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:05.916969 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-db729ee9-c8df-43d0-9263-94cf934dabb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6435b4059a84266887a17913c393a04', 'request_id': 'req-db729ee9-c8df-43d0-9263-94cf934dabb9'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:05.929149 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-db729ee9-c8df-43d0-9263-94cf934dabb9 admin admin] The token cache is being invalidate because project e6435b4059a84266887a17913c393a04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:35:05.929467 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-db729ee9-c8df-43d0-9263-94cf934dabb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:05.930114 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-db729ee9-c8df-43d0-9263-94cf934dabb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:05.931651 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1283/2579] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:35:05 2022] DELETE /identity/v3/projects/e6435b4059a84266887a17913c393a04 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:35:05.932443 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db729ee9-c8df-43d0-9263-94cf934dabb9 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:05.933788 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-db729ee9-c8df-43d0-9263-94cf934dabb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:05.960901 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3dc987-4b9d-4b73-970a-26dc049aab73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:05.961475 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3dc987-4b9d-4b73-970a-26dc049aab73 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:05.961762 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3dc987-4b9d-4b73-970a-26dc049aab73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:05.962040 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3dc987-4b9d-4b73-970a-26dc049aab73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:05.964049 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-fc3dc987-4b9d-4b73-970a-26dc049aab73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:05.999431 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db729ee9-c8df-43d0-9263-94cf934dabb9 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:06.004277 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40413e28-affe-4abd-8c26-8d8c172abb44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:06.004949 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40413e28-affe-4abd-8c26-8d8c172abb44 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:06.005254 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40413e28-affe-4abd-8c26-8d8c172abb44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:06.005534 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40413e28-affe-4abd-8c26-8d8c172abb44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:06.006266 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40413e28-affe-4abd-8c26-8d8c172abb44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:06.007881 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40413e28-affe-4abd-8c26-8d8c172abb44 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:06.018025 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1284/2580] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:35:05 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:35:06.019379 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2d52b-d021-4eee-8908-36bfeab0ee57 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:06.019683 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2d52b-d021-4eee-8908-36bfeab0ee57 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:06.019990 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2d52b-d021-4eee-8908-36bfeab0ee57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:06.024965 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3dc987-4b9d-4b73-970a-26dc049aab73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:06.026401 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3dc987-4b9d-4b73-970a-26dc049aab73 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:06.036782 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1297/2581] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:35:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:35:06.037362 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-4cd2d52b-d021-4eee-8908-36bfeab0ee57 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:35:06.037761 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3dc987-4b9d-4b73-970a-26dc049aab73 service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:06.038609 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-4cd2d52b-d021-4eee-8908-36bfeab0ee57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:06.048319 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1285/2582] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:35:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:35:06.048753 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3dc987-4b9d-4b73-970a-26dc049aab73 service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:06.054504 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed4054-089f-48af-8a7a-6946a16edc48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:06.054946 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed4054-089f-48af-8a7a-6946a16edc48 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:06.055356 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed4054-089f-48af-8a7a-6946a16edc48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:06.055638 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed4054-089f-48af-8a7a-6946a16edc48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:06.055858 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926bd42c-4df5-430a-9e3a-c01a30d39f3b None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:06.056153 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926bd42c-4df5-430a-9e3a-c01a30d39f3b None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:06.056413 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ed4054-089f-48af-8a7a-6946a16edc48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:06.056515 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926bd42c-4df5-430a-9e3a-c01a30d39f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:06.058027 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ed4054-089f-48af-8a7a-6946a16edc48 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:06.068656 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1298/2583] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:35:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:35:06.072789 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed4054-089f-48af-8a7a-6946a16edc48 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:06.074956 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-926bd42c-4df5-430a-9e3a-c01a30d39f3b None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:35:06.076190 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-926bd42c-4df5-430a-9e3a-c01a30d39f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:06.082928 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed4054-089f-48af-8a7a-6946a16edc48 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:06.087019 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1286/2584] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:35:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:35:06.087670 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f3f88-58c8-4e34-9d97-fe977ee66a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:06.088583 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f3f88-58c8-4e34-9d97-fe977ee66a14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:06.093429 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f3f88-58c8-4e34-9d97-fe977ee66a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:06.093429 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f3f88-58c8-4e34-9d97-fe977ee66a14 admin admin] PATH_INFO: `/v3/projects/d3946fbd031341ca950bf041519dbc35/users/0ee743c4f7784ca39dfa5d2d9b4cc3cc/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:06.097440 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926bd42c-4df5-430a-9e3a-c01a30d39f3b None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:06.105636 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387f3f88-58c8-4e34-9d97-fe977ee66a14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3946fbd031341ca950bf041519dbc35, user_id=0ee743c4f7784ca39dfa5d2d9b4cc3cc, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:06.108313 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387f3f88-58c8-4e34-9d97-fe977ee66a14 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:06.110465 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926bd42c-4df5-430a-9e3a-c01a30d39f3b None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:06.115906 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71c5eac-ca19-460f-a583-19ce4f0dc1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:06.116579 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c5eac-ca19-460f-a583-19ce4f0dc1c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:06.116868 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c5eac-ca19-460f-a583-19ce4f0dc1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:06.117157 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c5eac-ca19-460f-a583-19ce4f0dc1c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:06.117888 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71c5eac-ca19-460f-a583-19ce4f0dc1c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:35:06.118198 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71c5eac-ca19-460f-a583-19ce4f0dc1c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:06.119967 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71c5eac-ca19-460f-a583-19ce4f0dc1c6 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:06.132316 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1287/2585] 10.222.0.24 () {58 vars in 1152 bytes} [Thu Apr 7 06:35:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:35:06.136471 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71c5eac-ca19-460f-a583-19ce4f0dc1c6 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:06.146188 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71c5eac-ca19-460f-a583-19ce4f0dc1c6 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:06.150844 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147de228-8a9c-4381-acaf-ce5aa93c86c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:06.151477 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147de228-8a9c-4381-acaf-ce5aa93c86c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:06.151801 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147de228-8a9c-4381-acaf-ce5aa93c86c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:06.152083 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147de228-8a9c-4381-acaf-ce5aa93c86c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:06.152780 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147de228-8a9c-4381-acaf-ce5aa93c86c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:06.154674 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147de228-8a9c-4381-acaf-ce5aa93c86c3 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:06.231139 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1299/2586] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:35:06 2022] PUT /identity/v3/projects/d3946fbd031341ca950bf041519dbc35/users/0ee743c4f7784ca39dfa5d2d9b4cc3cc/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:35:06.242228 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4c0a7-0148-4594-9719-fae2b99bd575 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:06.242518 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4c0a7-0148-4594-9719-fae2b99bd575 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:06.242793 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4c0a7-0148-4594-9719-fae2b99bd575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:06.269134 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-24c4c0a7-0148-4594-9719-fae2b99bd575 None None] MFA Rules not processed for user `0ee743c4f7784ca39dfa5d2d9b4cc3cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:35:06.273100 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-24c4c0a7-0148-4594-9719-fae2b99bd575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:06.315603 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1288/2587] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:35:06 2022] POST /identity/v3/projects => generated 371 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:35:06.316970 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147de228-8a9c-4381-acaf-ce5aa93c86c3 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:06.340994 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1300/2588] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:35:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:35:06.354394 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c4c0a7-0148-4594-9719-fae2b99bd575 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:06.356559 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-24c4c0a7-0148-4594-9719-fae2b99bd575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:06.383289 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147de228-8a9c-4381-acaf-ce5aa93c86c3 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:06.390210 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a2d9a9-674a-49bb-a48b-ef8d1565c932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:06.391667 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2d9a9-674a-49bb-a48b-ef8d1565c932 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:06.391992 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2d9a9-674a-49bb-a48b-ef8d1565c932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:06.392271 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2d9a9-674a-49bb-a48b-ef8d1565c932 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:06.392971 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a2d9a9-674a-49bb-a48b-ef8d1565c932 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:06.394919 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a2d9a9-674a-49bb-a48b-ef8d1565c932 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:06.417521 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c4c0a7-0148-4594-9719-fae2b99bd575 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:06.490097 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1289/2589] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:35:06 2022] POST /identity/v3/users => generated 286 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:35:06.490097 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a2d9a9-674a-49bb-a48b-ef8d1565c932 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:06.495188 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-c3a2d9a9-674a-49bb-a48b-ef8d1565c932 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:06.509841 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a2d9a9-674a-49bb-a48b-ef8d1565c932 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:06.515595 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0299ab-39b7-431f-8f4d-98ea3b3edfaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:06.516409 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0299ab-39b7-431f-8f4d-98ea3b3edfaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:06.516986 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0299ab-39b7-431f-8f4d-98ea3b3edfaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:06.517220 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0299ab-39b7-431f-8f4d-98ea3b3edfaa admin admin] PATH_INFO: `/v3/projects/653329d427de48649de60897b1f9d05b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:06.518460 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0299ab-39b7-431f-8f4d-98ea3b3edfaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=653329d427de48649de60897b1f9d05b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:06.520474 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0299ab-39b7-431f-8f4d-98ea3b3edfaa admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:06.597121 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd21d1b-83f1-4b71-86bc-d0e8b702b091 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:06.597787 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd21d1b-83f1-4b71-86bc-d0e8b702b091 service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:06.598077 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd21d1b-83f1-4b71-86bc-d0e8b702b091 service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:06.598357 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd21d1b-83f1-4b71-86bc-d0e8b702b091 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:06.658211 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd21d1b-83f1-4b71-86bc-d0e8b702b091 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:06.660126 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd21d1b-83f1-4b71-86bc-d0e8b702b091 service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:06.662139 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-3b0299ab-39b7-431f-8f4d-98ea3b3edfaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '653329d427de48649de60897b1f9d05b', 'request_id': 'req-3b0299ab-39b7-431f-8f4d-98ea3b3edfaa'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:06.667507 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-3b0299ab-39b7-431f-8f4d-98ea3b3edfaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '653329d427de48649de60897b1f9d05b', 'request_id': 'req-3b0299ab-39b7-431f-8f4d-98ea3b3edfaa'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:06.671104 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1301/2590] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:35:06 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:35:06.672019 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd21d1b-83f1-4b71-86bc-d0e8b702b091 service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:06.684207 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd21d1b-83f1-4b71-86bc-d0e8b702b091 service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:06.739540 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-3b0299ab-39b7-431f-8f4d-98ea3b3edfaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '653329d427de48649de60897b1f9d05b', 'request_id': 'req-3b0299ab-39b7-431f-8f4d-98ea3b3edfaa'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:06.740867 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f8fcb-6c1a-446e-8cfd-9c0d4f5a8c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:06.741644 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f8fcb-6c1a-446e-8cfd-9c0d4f5a8c3e admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:06.741944 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f8fcb-6c1a-446e-8cfd-9c0d4f5a8c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:06.742224 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f8fcb-6c1a-446e-8cfd-9c0d4f5a8c3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:06.742955 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8f8fcb-6c1a-446e-8cfd-9c0d4f5a8c3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:06.744590 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8f8fcb-6c1a-446e-8cfd-9c0d4f5a8c3e admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:06.751101 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-3b0299ab-39b7-431f-8f4d-98ea3b3edfaa admin admin] The token cache is being invalidate because project 653329d427de48649de60897b1f9d05b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:35:06.751394 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-3b0299ab-39b7-431f-8f4d-98ea3b3edfaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:06.752089 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-3b0299ab-39b7-431f-8f4d-98ea3b3edfaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:06.753638 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1290/2591] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:35:06 2022] DELETE /identity/v3/projects/653329d427de48649de60897b1f9d05b => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:35:06.754831 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1302/2592] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:35:06 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:35:06.757447 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f8fcb-6c1a-446e-8cfd-9c0d4f5a8c3e admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:06.759335 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-ec8f8fcb-6c1a-446e-8cfd-9c0d4f5a8c3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:06.759974 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0299ab-39b7-431f-8f4d-98ea3b3edfaa admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:06.761307 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-3b0299ab-39b7-431f-8f4d-98ea3b3edfaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:06.773633 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0299ab-39b7-431f-8f4d-98ea3b3edfaa admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:06.773970 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f8fcb-6c1a-446e-8cfd-9c0d4f5a8c3e admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:06.778344 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f984ed-ab8b-4b93-869f-1599ca9c03d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:06.778901 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8ebd05-6fad-412a-ae6f-9f8a0c43d87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:06.779212 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f984ed-ab8b-4b93-869f-1599ca9c03d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:06.779499 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f984ed-ab8b-4b93-869f-1599ca9c03d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:06.779804 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f984ed-ab8b-4b93-869f-1599ca9c03d6 admin admin] PATH_INFO: `/v3/users/0ee743c4f7784ca39dfa5d2d9b4cc3cc` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:06.780057 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ebd05-6fad-412a-ae6f-9f8a0c43d87b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:06.780410 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ebd05-6fad-412a-ae6f-9f8a0c43d87b admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:06.780757 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ebd05-6fad-412a-ae6f-9f8a0c43d87b admin admin] PATH_INFO: `/v3/users/35ea54fd09ca4471833a1892e7f9210c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:06.781005 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f984ed-ab8b-4b93-869f-1599ca9c03d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ee743c4f7784ca39dfa5d2d9b4cc3cc)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:06.782636 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8ebd05-6fad-412a-ae6f-9f8a0c43d87b admin admin] RBAC: Authorizing `identity:delete_user(user_id=35ea54fd09ca4471833a1892e7f9210c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:06.783448 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f984ed-ab8b-4b93-869f-1599ca9c03d6 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:06.784940 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8ebd05-6fad-412a-ae6f-9f8a0c43d87b admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:07.060819 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-34f984ed-ab8b-4b93-869f-1599ca9c03d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ee743c4f7784ca39dfa5d2d9b4cc3cc'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:07.061472 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-34f984ed-ab8b-4b93-869f-1599ca9c03d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ee743c4f7784ca39dfa5d2d9b4cc3cc'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:07.084574 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-db8ebd05-6fad-412a-ae6f-9f8a0c43d87b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35ea54fd09ca4471833a1892e7f9210c'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:07.096639 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-db8ebd05-6fad-412a-ae6f-9f8a0c43d87b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35ea54fd09ca4471833a1892e7f9210c'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:07.133545 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-34f984ed-ab8b-4b93-869f-1599ca9c03d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ee743c4f7784ca39dfa5d2d9b4cc3cc'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:07.134169 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-34f984ed-ab8b-4b93-869f-1599ca9c03d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ee743c4f7784ca39dfa5d2d9b4cc3cc'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:07.147078 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-34f984ed-ab8b-4b93-869f-1599ca9c03d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ee743c4f7784ca39dfa5d2d9b4cc3cc'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:07.159705 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1291/2593] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:35:06 2022] DELETE /identity/v3/users/0ee743c4f7784ca39dfa5d2d9b4cc3cc => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:35:07.160684 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f984ed-ab8b-4b93-869f-1599ca9c03d6 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:07.161971 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-34f984ed-ab8b-4b93-869f-1599ca9c03d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:07.196400 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-db8ebd05-6fad-412a-ae6f-9f8a0c43d87b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35ea54fd09ca4471833a1892e7f9210c'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:07.197082 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-db8ebd05-6fad-412a-ae6f-9f8a0c43d87b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35ea54fd09ca4471833a1892e7f9210c'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:07.200800 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-db8ebd05-6fad-412a-ae6f-9f8a0c43d87b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35ea54fd09ca4471833a1892e7f9210c'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:07.212500 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1303/2594] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:35:06 2022] DELETE /identity/v3/users/35ea54fd09ca4471833a1892e7f9210c => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:35:07.213987 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abffb0ed-4a02-47fe-b4b8-1d9b31c57b56 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:07.214417 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abffb0ed-4a02-47fe-b4b8-1d9b31c57b56 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:07.214843 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abffb0ed-4a02-47fe-b4b8-1d9b31c57b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:07.231873 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f984ed-ab8b-4b93-869f-1599ca9c03d6 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:07.255424 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-abffb0ed-4a02-47fe-b4b8-1d9b31c57b56 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:35:07.257312 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-abffb0ed-4a02-47fe-b4b8-1d9b31c57b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:07.297827 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855cb104-f92b-4379-bf8b-d3a192c859aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:07.298632 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855cb104-f92b-4379-bf8b-d3a192c859aa admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:07.298920 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855cb104-f92b-4379-bf8b-d3a192c859aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:07.299192 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855cb104-f92b-4379-bf8b-d3a192c859aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:07.299953 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855cb104-f92b-4379-bf8b-d3a192c859aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:07.301584 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855cb104-f92b-4379-bf8b-d3a192c859aa admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:07.312508 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1292/2595] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:35:07 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:35:07.316382 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855cb104-f92b-4379-bf8b-d3a192c859aa admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:07.318305 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-855cb104-f92b-4379-bf8b-d3a192c859aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:07.331803 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855cb104-f92b-4379-bf8b-d3a192c859aa admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:07.336832 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604d9803-c3ac-4063-aa0e-ab7ec44bd1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:07.337951 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d9803-c3ac-4063-aa0e-ab7ec44bd1dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:07.340893 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d9803-c3ac-4063-aa0e-ab7ec44bd1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:07.340893 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d9803-c3ac-4063-aa0e-ab7ec44bd1dc admin admin] PATH_INFO: `/v3/projects/de406c5600e64bac8ca23f958b70d280/users/998880a3fc5a4980853c1c21dd834b92/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:07.341478 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1304/2596] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:35:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:35:07.351278 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abffb0ed-4a02-47fe-b4b8-1d9b31c57b56 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:07.352844 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-abffb0ed-4a02-47fe-b4b8-1d9b31c57b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:07.364627 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604d9803-c3ac-4063-aa0e-ab7ec44bd1dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=de406c5600e64bac8ca23f958b70d280, user_id=998880a3fc5a4980853c1c21dd834b92, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:07.368047 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604d9803-c3ac-4063-aa0e-ab7ec44bd1dc admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:07.408048 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abffb0ed-4a02-47fe-b4b8-1d9b31c57b56 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:07.411616 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be211a5-8bb3-4a7b-8083-2ffc01e72768 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:07.412301 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be211a5-8bb3-4a7b-8083-2ffc01e72768 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:07.412610 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be211a5-8bb3-4a7b-8083-2ffc01e72768 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:07.412900 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be211a5-8bb3-4a7b-8083-2ffc01e72768 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:07.421795 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be211a5-8bb3-4a7b-8083-2ffc01e72768 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:07.423313 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be211a5-8bb3-4a7b-8083-2ffc01e72768 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:07.432837 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1305/2597] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:35:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 07 06:35:07.501543 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1293/2598] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:35:07 2022] PUT /identity/v3/projects/de406c5600e64bac8ca23f958b70d280/users/998880a3fc5a4980853c1c21dd834b92/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:35:07.511929 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb464cb-79f8-476f-a145-14dd5898fa70 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:07.512226 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb464cb-79f8-476f-a145-14dd5898fa70 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:07.512508 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb464cb-79f8-476f-a145-14dd5898fa70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:07.544005 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-3fb464cb-79f8-476f-a145-14dd5898fa70 None None] MFA Rules not processed for user `998880a3fc5a4980853c1c21dd834b92`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:35:07.545280 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-3fb464cb-79f8-476f-a145-14dd5898fa70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:07.615431 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1306/2599] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:35:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:35:07.628120 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604d9803-c3ac-4063-aa0e-ab7ec44bd1dc admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:07.629398 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-604d9803-c3ac-4063-aa0e-ab7ec44bd1dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:07.704204 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604d9803-c3ac-4063-aa0e-ab7ec44bd1dc admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:07.707961 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ab306-0850-465b-adf2-a96825232c73 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca88debdfcc4a9d918e3b0138a9add1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:07.708614 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ab306-0850-465b-adf2-a96825232c73 service glance] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:07.708903 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ab306-0850-465b-adf2-a96825232c73 service glance] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:07.709184 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ab306-0850-465b-adf2-a96825232c73 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:07.717667 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834ab306-0850-465b-adf2-a96825232c73 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:07.719690 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834ab306-0850-465b-adf2-a96825232c73 service glance] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:07.728741 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1294/2600] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:35:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:35:07.798360 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb464cb-79f8-476f-a145-14dd5898fa70 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:07.803996 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-3fb464cb-79f8-476f-a145-14dd5898fa70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:07.878731 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ab306-0850-465b-adf2-a96825232c73 service glance] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:07.880580 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-834ab306-0850-465b-adf2-a96825232c73 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:07.881517 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb464cb-79f8-476f-a145-14dd5898fa70 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:07.886928 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896be231-ab47-46db-b45c-68f0ff028ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:07.887935 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896be231-ab47-46db-b45c-68f0ff028ece admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:07.888291 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896be231-ab47-46db-b45c-68f0ff028ece admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:07.888638 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896be231-ab47-46db-b45c-68f0ff028ece admin admin] PATH_INFO: `/v3/projects/1fcf67646cf94d77abc12ce532b20d2a` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:07.890413 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896be231-ab47-46db-b45c-68f0ff028ece admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fcf67646cf94d77abc12ce532b20d2a)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:07.893587 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896be231-ab47-46db-b45c-68f0ff028ece admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:07.913186 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ab306-0850-465b-adf2-a96825232c73 service glance] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:07.925594 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aff55d2-a306-4553-ba0f-d7249ce24f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:07.926528 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff55d2-a306-4553-ba0f-d7249ce24f94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:07.926811 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff55d2-a306-4553-ba0f-d7249ce24f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:07.927086 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff55d2-a306-4553-ba0f-d7249ce24f94 admin admin] PATH_INFO: `/v3/projects/d3946fbd031341ca950bf041519dbc35` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:07.928313 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aff55d2-a306-4553-ba0f-d7249ce24f94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3946fbd031341ca950bf041519dbc35)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:07.930239 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aff55d2-a306-4553-ba0f-d7249ce24f94 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:08.025840 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-896be231-ab47-46db-b45c-68f0ff028ece admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fcf67646cf94d77abc12ce532b20d2a', 'request_id': 'req-896be231-ab47-46db-b45c-68f0ff028ece'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:08.032482 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-896be231-ab47-46db-b45c-68f0ff028ece admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fcf67646cf94d77abc12ce532b20d2a', 'request_id': 'req-896be231-ab47-46db-b45c-68f0ff028ece'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:08.032698 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-5aff55d2-a306-4553-ba0f-d7249ce24f94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3946fbd031341ca950bf041519dbc35', 'request_id': 'req-5aff55d2-a306-4553-ba0f-d7249ce24f94'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:08.038999 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-5aff55d2-a306-4553-ba0f-d7249ce24f94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3946fbd031341ca950bf041519dbc35', 'request_id': 'req-5aff55d2-a306-4553-ba0f-d7249ce24f94'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:08.110683 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-896be231-ab47-46db-b45c-68f0ff028ece admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fcf67646cf94d77abc12ce532b20d2a', 'request_id': 'req-896be231-ab47-46db-b45c-68f0ff028ece'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:08.121075 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-896be231-ab47-46db-b45c-68f0ff028ece admin admin] The token cache is being invalidate because project 1fcf67646cf94d77abc12ce532b20d2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:35:08.121366 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-896be231-ab47-46db-b45c-68f0ff028ece admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:08.121994 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-896be231-ab47-46db-b45c-68f0ff028ece admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:08.123486 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1307/2601] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:35:07 2022] DELETE /identity/v3/projects/1fcf67646cf94d77abc12ce532b20d2a => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:35:08.129509 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123fa19e-0947-4c5b-a5bb-78a751510899 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:08.129794 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123fa19e-0947-4c5b-a5bb-78a751510899 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:08.130069 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123fa19e-0947-4c5b-a5bb-78a751510899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:08.147766 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-123fa19e-0947-4c5b-a5bb-78a751510899 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:35:08.148958 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-123fa19e-0947-4c5b-a5bb-78a751510899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:08.201979 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-5aff55d2-a306-4553-ba0f-d7249ce24f94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3946fbd031341ca950bf041519dbc35', 'request_id': 'req-5aff55d2-a306-4553-ba0f-d7249ce24f94'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:08.204822 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1308/2602] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:35:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:35:08.214219 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76aa4c3-3716-4932-bf56-33e355cf6dc1 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:08.214511 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76aa4c3-3716-4932-bf56-33e355cf6dc1 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:08.214787 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76aa4c3-3716-4932-bf56-33e355cf6dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:08.225420 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-5aff55d2-a306-4553-ba0f-d7249ce24f94 admin admin] The token cache is being invalidate because project d3946fbd031341ca950bf041519dbc35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:35:08.225709 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-5aff55d2-a306-4553-ba0f-d7249ce24f94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:08.226379 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-5aff55d2-a306-4553-ba0f-d7249ce24f94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:08.227974 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1295/2603] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:35:07 2022] DELETE /identity/v3/projects/d3946fbd031341ca950bf041519dbc35 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:35:08.232796 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde29c5-6862-4085-8354-2f6e5494815b None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:08.232955 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-d76aa4c3-3716-4932-bf56-33e355cf6dc1 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:35:08.233086 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde29c5-6862-4085-8354-2f6e5494815b None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:08.233360 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde29c5-6862-4085-8354-2f6e5494815b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:08.233988 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d76aa4c3-3716-4932-bf56-33e355cf6dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:08.243920 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1309/2604] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:35:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:35:08.247989 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76aa4c3-3716-4932-bf56-33e355cf6dc1 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:08.252705 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-dcde29c5-6862-4085-8354-2f6e5494815b None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:35:08.253885 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-dcde29c5-6862-4085-8354-2f6e5494815b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:08.257232 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76aa4c3-3716-4932-bf56-33e355cf6dc1 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:08.261858 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe4bf50-f580-46a3-aa3c-f3c09054e3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:08.261999 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1296/2605] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:35:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:35:08.262619 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4bf50-f580-46a3-aa3c-f3c09054e3ad admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:08.262907 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4bf50-f580-46a3-aa3c-f3c09054e3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:08.263190 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4bf50-f580-46a3-aa3c-f3c09054e3ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:08.263935 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe4bf50-f580-46a3-aa3c-f3c09054e3ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:35:08.264241 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe4bf50-f580-46a3-aa3c-f3c09054e3ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:08.265826 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe4bf50-f580-46a3-aa3c-f3c09054e3ad admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:08.269952 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b2773-51ed-420e-ada1-83a19f85706c None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:08.270245 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b2773-51ed-420e-ada1-83a19f85706c None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:08.270576 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b2773-51ed-420e-ada1-83a19f85706c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:08.279783 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1310/2606] 10.222.0.24 () {58 vars in 1152 bytes} [Thu Apr 7 06:35:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:35:08.282145 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe4bf50-f580-46a3-aa3c-f3c09054e3ad admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:08.288872 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-f98b2773-51ed-420e-ada1-83a19f85706c None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:35:08.290058 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-f98b2773-51ed-420e-ada1-83a19f85706c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:08.291417 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe4bf50-f580-46a3-aa3c-f3c09054e3ad admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:08.296347 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bcb44f-a842-4912-9561-decb4597cf18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:08.297847 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bcb44f-a842-4912-9561-decb4597cf18 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:08.297847 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bcb44f-a842-4912-9561-decb4597cf18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:08.297847 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bcb44f-a842-4912-9561-decb4597cf18 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:08.306318 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1297/2607] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:35:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:35:08.306734 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bcb44f-a842-4912-9561-decb4597cf18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:08.306734 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bcb44f-a842-4912-9561-decb4597cf18 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:08.308121 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b2773-51ed-420e-ada1-83a19f85706c None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:08.319802 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b2773-51ed-420e-ada1-83a19f85706c None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:08.324657 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258fe64-444b-4425-ae1d-a5b4f44d13bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:08.325319 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258fe64-444b-4425-ae1d-a5b4f44d13bb admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:08.325608 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258fe64-444b-4425-ae1d-a5b4f44d13bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:08.325898 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258fe64-444b-4425-ae1d-a5b4f44d13bb admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:08.326613 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f258fe64-444b-4425-ae1d-a5b4f44d13bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:35:08.326922 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f258fe64-444b-4425-ae1d-a5b4f44d13bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:08.329199 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f258fe64-444b-4425-ae1d-a5b4f44d13bb admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:08.344538 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1298/2608] 10.222.0.24 () {58 vars in 1152 bytes} [Thu Apr 7 06:35:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:35:08.348950 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258fe64-444b-4425-ae1d-a5b4f44d13bb admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:08.363624 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258fe64-444b-4425-ae1d-a5b4f44d13bb admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:08.376883 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ede09-513b-493e-988d-572d3767141a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:08.376883 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ede09-513b-493e-988d-572d3767141a admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:08.376883 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ede09-513b-493e-988d-572d3767141a admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:08.376883 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ede09-513b-493e-988d-572d3767141a admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:08.377254 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8ede09-513b-493e-988d-572d3767141a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:08.377254 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8ede09-513b-493e-988d-572d3767141a admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:08.431834 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1311/2609] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:35:08 2022] POST /identity/v3/projects => generated 375 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:35:08.435887 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bcb44f-a842-4912-9561-decb4597cf18 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:08.494128 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bcb44f-a842-4912-9561-decb4597cf18 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:08.499066 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed4662a-0d19-43ff-8d5c-07ba39d8f5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:08.499806 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4662a-0d19-43ff-8d5c-07ba39d8f5a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:08.500057 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4662a-0d19-43ff-8d5c-07ba39d8f5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:08.500892 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4662a-0d19-43ff-8d5c-07ba39d8f5a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:08.501591 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed4662a-0d19-43ff-8d5c-07ba39d8f5a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:08.505631 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1299/2610] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:35:08 2022] POST /identity/v3/projects => generated 373 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:35:08.505799 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed4662a-0d19-43ff-8d5c-07ba39d8f5a0 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:08.506816 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ede09-513b-493e-988d-572d3767141a admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:08.617829 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ede09-513b-493e-988d-572d3767141a admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:08.622507 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af86c3-0931-4f3d-bc95-1aca6ae7a8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:08.623183 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af86c3-0931-4f3d-bc95-1aca6ae7a8a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:08.623471 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af86c3-0931-4f3d-bc95-1aca6ae7a8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:08.623769 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af86c3-0931-4f3d-bc95-1aca6ae7a8a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:08.624471 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af86c3-0931-4f3d-bc95-1aca6ae7a8a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:08.627161 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af86c3-0931-4f3d-bc95-1aca6ae7a8a0 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:08.682304 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1312/2611] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:35:08 2022] POST /identity/v3/users => generated 288 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:35:08.686341 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed4662a-0d19-43ff-8d5c-07ba39d8f5a0 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:08.696346 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed4662a-0d19-43ff-8d5c-07ba39d8f5a0 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:08.701357 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1300/2612] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:35:08 2022] POST /identity/v3/users => generated 287 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:35:08.701487 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac9b47-2179-444d-8dd1-ebac0d5b104e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:08.701590 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac9b47-2179-444d-8dd1-ebac0d5b104e admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:08.701831 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac9b47-2179-444d-8dd1-ebac0d5b104e admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:08.702161 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac9b47-2179-444d-8dd1-ebac0d5b104e admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:08.702826 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac9b47-2179-444d-8dd1-ebac0d5b104e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:08.704650 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac9b47-2179-444d-8dd1-ebac0d5b104e admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:08.705448 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af86c3-0931-4f3d-bc95-1aca6ae7a8a0 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:08.714920 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1313/2613] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:35:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 07 06:35:08.718179 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af86c3-0931-4f3d-bc95-1aca6ae7a8a0 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:08.720842 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac9b47-2179-444d-8dd1-ebac0d5b104e admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:08.723850 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0969eb-fd65-4243-851d-489a88302e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:08.724540 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0969eb-fd65-4243-851d-489a88302e31 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:08.725003 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0969eb-fd65-4243-851d-489a88302e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:08.725124 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0969eb-fd65-4243-851d-489a88302e31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:08.725823 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0969eb-fd65-4243-851d-489a88302e31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:08.727444 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0969eb-fd65-4243-851d-489a88302e31 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:08.731721 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac9b47-2179-444d-8dd1-ebac0d5b104e admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:08.737991 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a908c3-beab-4e87-8c38-6e68d1610cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:08.738870 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a908c3-beab-4e87-8c38-6e68d1610cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:08.739001 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1301/2614] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:35:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:35:08.739155 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a908c3-beab-4e87-8c38-6e68d1610cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:08.739432 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a908c3-beab-4e87-8c38-6e68d1610cf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:08.740436 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a908c3-beab-4e87-8c38-6e68d1610cf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:08.742038 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a908c3-beab-4e87-8c38-6e68d1610cf1 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:08.745098 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0969eb-fd65-4243-851d-489a88302e31 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:08.753752 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1314/2615] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:35:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 07 06:35:08.757806 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a908c3-beab-4e87-8c38-6e68d1610cf1 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:08.758971 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0969eb-fd65-4243-851d-489a88302e31 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:08.766626 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c828010-3d5b-45b0-9f7d-b9b6822fa1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:08.767784 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c828010-3d5b-45b0-9f7d-b9b6822fa1d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:08.767784 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c828010-3d5b-45b0-9f7d-b9b6822fa1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:08.774061 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c828010-3d5b-45b0-9f7d-b9b6822fa1d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:08.774061 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c828010-3d5b-45b0-9f7d-b9b6822fa1d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:08.774061 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c828010-3d5b-45b0-9f7d-b9b6822fa1d5 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:08.774843 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a908c3-beab-4e87-8c38-6e68d1610cf1 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:08.779243 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a8ad87-02bb-420d-8e68-96462160ff8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:08.780162 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8ad87-02bb-420d-8e68-96462160ff8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:08.780452 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8ad87-02bb-420d-8e68-96462160ff8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:08.784032 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1302/2616] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:35:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:35:08.784179 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8ad87-02bb-420d-8e68-96462160ff8d admin admin] PATH_INFO: `/v3/projects/41113bd6a2de44fb84e7159b2c0e38fb/users/cf458dc1d39f498994b525fdacbe0763/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:08.784994 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c828010-3d5b-45b0-9f7d-b9b6822fa1d5 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:08.794378 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c828010-3d5b-45b0-9f7d-b9b6822fa1d5 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:08.798702 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a8ad87-02bb-420d-8e68-96462160ff8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=41113bd6a2de44fb84e7159b2c0e38fb, user_id=cf458dc1d39f498994b525fdacbe0763, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:08.799457 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7862d3ee-a10c-42aa-9bf8-a67c55938274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:08.800352 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7862d3ee-a10c-42aa-9bf8-a67c55938274 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:08.800632 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7862d3ee-a10c-42aa-9bf8-a67c55938274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:08.800904 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7862d3ee-a10c-42aa-9bf8-a67c55938274 admin admin] PATH_INFO: `/v3/projects/d64b8dfa4dd84e508cf00877bb731d5d/users/e2d08dc831cf4e8f8b55061799a5d8e4/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:08.801563 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a8ad87-02bb-420d-8e68-96462160ff8d admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:08.902972 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1315/2617] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:35:08 2022] PUT /identity/v3/projects/41113bd6a2de44fb84e7159b2c0e38fb/users/cf458dc1d39f498994b525fdacbe0763/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:35:08.914529 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b2721-5dee-42dc-bbb5-950c812854ca None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:08.914829 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b2721-5dee-42dc-bbb5-950c812854ca None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:08.915357 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b2721-5dee-42dc-bbb5-950c812854ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:08.943287 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-053b2721-5dee-42dc-bbb5-950c812854ca None None] MFA Rules not processed for user `cf458dc1d39f498994b525fdacbe0763`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:35:08.944684 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-053b2721-5dee-42dc-bbb5-950c812854ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:08.947067 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7862d3ee-a10c-42aa-9bf8-a67c55938274 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d64b8dfa4dd84e508cf00877bb731d5d, user_id=e2d08dc831cf4e8f8b55061799a5d8e4, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:08.949737 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7862d3ee-a10c-42aa-9bf8-a67c55938274 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:09.010499 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1316/2618] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:35:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:35:09.017826 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b2721-5dee-42dc-bbb5-950c812854ca None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:09.018574 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1303/2619] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:35:08 2022] PUT /identity/v3/projects/d64b8dfa4dd84e508cf00877bb731d5d/users/e2d08dc831cf4e8f8b55061799a5d8e4/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:35:09.019505 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-053b2721-5dee-42dc-bbb5-950c812854ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:09.034201 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d32bf7-5c7a-428b-956b-ae38b97a1828 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:09.034495 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d32bf7-5c7a-428b-956b-ae38b97a1828 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:09.034777 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d32bf7-5c7a-428b-956b-ae38b97a1828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:09.062462 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-91d32bf7-5c7a-428b-956b-ae38b97a1828 None None] MFA Rules not processed for user `e2d08dc831cf4e8f8b55061799a5d8e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:35:09.063778 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-91d32bf7-5c7a-428b-956b-ae38b97a1828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:09.076328 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b2721-5dee-42dc-bbb5-950c812854ca None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:09.125692 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76899553-08c7-47dd-bc38-10330a77e493 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca88debdfcc4a9d918e3b0138a9add1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:09.126344 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76899553-08c7-47dd-bc38-10330a77e493 service glance] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:09.126661 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76899553-08c7-47dd-bc38-10330a77e493 service glance] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:09.126935 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76899553-08c7-47dd-bc38-10330a77e493 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:09.130424 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1304/2620] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:35:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:35:09.141341 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d32bf7-5c7a-428b-956b-ae38b97a1828 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:09.142655 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-91d32bf7-5c7a-428b-956b-ae38b97a1828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:09.183405 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76899553-08c7-47dd-bc38-10330a77e493 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:09.184913 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76899553-08c7-47dd-bc38-10330a77e493 service glance] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:09.193777 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1317/2621] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:35:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:35:09.198515 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d32bf7-5c7a-428b-956b-ae38b97a1828 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:09.202080 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd78b4a8-6c02-465a-a529-37dcc295b9d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:09.202717 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd78b4a8-6c02-465a-a529-37dcc295b9d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:09.202998 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd78b4a8-6c02-465a-a529-37dcc295b9d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:09.203265 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd78b4a8-6c02-465a-a529-37dcc295b9d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:09.221081 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd78b4a8-6c02-465a-a529-37dcc295b9d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:09.222677 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd78b4a8-6c02-465a-a529-37dcc295b9d7 service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:09.233437 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1305/2622] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:35:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 07 06:35:11.097311 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a7319-0f5e-495b-b265-f046bf8b8d33 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:11.097796 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a7319-0f5e-495b-b265-f046bf8b8d33 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:11.097910 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a7319-0f5e-495b-b265-f046bf8b8d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:11.114568 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-d82a7319-0f5e-495b-b265-f046bf8b8d33 None None] MFA Rules not processed for user `e2d08dc831cf4e8f8b55061799a5d8e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:35:11.116274 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d82a7319-0f5e-495b-b265-f046bf8b8d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:11.123439 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1318/2623] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:35:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:35:36.969512 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd78b4a8-6c02-465a-a529-37dcc295b9d7 service cinder] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:37.031576 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd78b4a8-6c02-465a-a529-37dcc295b9d7 service cinder] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:37.036621 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5c2d2-3745-45b8-baef-6554d640de68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:37.037648 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5c2d2-3745-45b8-baef-6554d640de68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:37.037936 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5c2d2-3745-45b8-baef-6554d640de68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:37.038210 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5c2d2-3745-45b8-baef-6554d640de68 admin admin] PATH_INFO: `/v3/users/cf458dc1d39f498994b525fdacbe0763` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:37.039430 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b5c2d2-3745-45b8-baef-6554d640de68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf458dc1d39f498994b525fdacbe0763)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:37.041364 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b5c2d2-3745-45b8-baef-6554d640de68 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:37.255471 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-b4b5c2d2-3745-45b8-baef-6554d640de68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf458dc1d39f498994b525fdacbe0763'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:37.256199 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-b4b5c2d2-3745-45b8-baef-6554d640de68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf458dc1d39f498994b525fdacbe0763'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:37.378534 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-b4b5c2d2-3745-45b8-baef-6554d640de68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf458dc1d39f498994b525fdacbe0763'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:37.379178 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-b4b5c2d2-3745-45b8-baef-6554d640de68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf458dc1d39f498994b525fdacbe0763'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:37.392013 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-b4b5c2d2-3745-45b8-baef-6554d640de68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf458dc1d39f498994b525fdacbe0763'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:37.404289 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1306/2624] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:35:36 2022] DELETE /identity/v3/users/cf458dc1d39f498994b525fdacbe0763 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:35:37.408754 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312fa981-5249-444e-a888-075fe66f002a None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:37.409315 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312fa981-5249-444e-a888-075fe66f002a None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:37.409315 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312fa981-5249-444e-a888-075fe66f002a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:37.427902 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-312fa981-5249-444e-a888-075fe66f002a None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:35:37.429213 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-312fa981-5249-444e-a888-075fe66f002a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:37.485763 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1319/2625] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:35:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:35:37.496487 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5c2d2-3745-45b8-baef-6554d640de68 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:37.497973 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b4b5c2d2-3745-45b8-baef-6554d640de68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:37.553006 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5c2d2-3745-45b8-baef-6554d640de68 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:37.560625 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a77e9-5c20-4b12-b4ef-6bb6bf8376fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:37.560625 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a77e9-5c20-4b12-b4ef-6bb6bf8376fa service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:37.560625 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a77e9-5c20-4b12-b4ef-6bb6bf8376fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:37.560625 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a77e9-5c20-4b12-b4ef-6bb6bf8376fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:37.566782 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6a77e9-5c20-4b12-b4ef-6bb6bf8376fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:37.568380 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6a77e9-5c20-4b12-b4ef-6bb6bf8376fa service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:37.577667 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1307/2626] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:35:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:35:38.008753 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312fa981-5249-444e-a888-075fe66f002a None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:38.010956 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-312fa981-5249-444e-a888-075fe66f002a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:38.024307 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312fa981-5249-444e-a888-075fe66f002a None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:38.030504 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43efb3b1-fd6b-40b6-8510-621003316ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:38.036677 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efb3b1-fd6b-40b6-8510-621003316ea2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:38.036677 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efb3b1-fd6b-40b6-8510-621003316ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:38.036677 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efb3b1-fd6b-40b6-8510-621003316ea2 admin admin] PATH_INFO: `/v3/projects/41113bd6a2de44fb84e7159b2c0e38fb` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:38.036677 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43efb3b1-fd6b-40b6-8510-621003316ea2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41113bd6a2de44fb84e7159b2c0e38fb)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:38.036677 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43efb3b1-fd6b-40b6-8510-621003316ea2 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:38.156445 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-43efb3b1-fd6b-40b6-8510-621003316ea2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41113bd6a2de44fb84e7159b2c0e38fb', 'request_id': 'req-43efb3b1-fd6b-40b6-8510-621003316ea2'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:38.163539 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-43efb3b1-fd6b-40b6-8510-621003316ea2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41113bd6a2de44fb84e7159b2c0e38fb', 'request_id': 'req-43efb3b1-fd6b-40b6-8510-621003316ea2'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:38.269917 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-43efb3b1-fd6b-40b6-8510-621003316ea2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41113bd6a2de44fb84e7159b2c0e38fb', 'request_id': 'req-43efb3b1-fd6b-40b6-8510-621003316ea2'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:38.281414 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-43efb3b1-fd6b-40b6-8510-621003316ea2 admin admin] The token cache is being invalidate because project 41113bd6a2de44fb84e7159b2c0e38fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:35:38.281840 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-43efb3b1-fd6b-40b6-8510-621003316ea2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:38.286385 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-43efb3b1-fd6b-40b6-8510-621003316ea2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:38.293708 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1320/2627] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:35:38 2022] DELETE /identity/v3/projects/41113bd6a2de44fb84e7159b2c0e38fb => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:35:38.298182 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0d21f-545f-478f-8922-54ffb263a709 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:38.298625 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0d21f-545f-478f-8922-54ffb263a709 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:38.298850 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0d21f-545f-478f-8922-54ffb263a709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:38.316853 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-a8f0d21f-545f-478f-8922-54ffb263a709 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:35:38.318518 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a8f0d21f-545f-478f-8922-54ffb263a709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:38.377012 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1308/2628] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:35:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:35:38.385005 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d12292-3ecb-4056-a230-e0889a072033 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:38.385357 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d12292-3ecb-4056-a230-e0889a072033 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:38.385714 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d12292-3ecb-4056-a230-e0889a072033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:38.404715 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-e5d12292-3ecb-4056-a230-e0889a072033 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:35:38.405903 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e5d12292-3ecb-4056-a230-e0889a072033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:38.414005 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1321/2629] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:35:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:35:38.418308 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0d21f-545f-478f-8922-54ffb263a709 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:38.428566 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0d21f-545f-478f-8922-54ffb263a709 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:38.433238 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46065b8c-8080-4006-871a-688a60707a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:38.433897 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46065b8c-8080-4006-871a-688a60707a0e admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:38.434179 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46065b8c-8080-4006-871a-688a60707a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:38.434477 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46065b8c-8080-4006-871a-688a60707a0e admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:38.435208 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46065b8c-8080-4006-871a-688a60707a0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:35:38.435511 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46065b8c-8080-4006-871a-688a60707a0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:38.437142 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46065b8c-8080-4006-871a-688a60707a0e admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:38.449531 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1309/2630] 10.222.0.24 () {58 vars in 1152 bytes} [Thu Apr 7 06:35:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:35:38.453984 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d12292-3ecb-4056-a230-e0889a072033 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:38.463679 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d12292-3ecb-4056-a230-e0889a072033 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:38.468583 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db9f641-48ad-4ac6-8a27-0d90719f787d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:38.469242 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9f641-48ad-4ac6-8a27-0d90719f787d admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:38.469525 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9f641-48ad-4ac6-8a27-0d90719f787d admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:38.469798 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9f641-48ad-4ac6-8a27-0d90719f787d admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:38.470511 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db9f641-48ad-4ac6-8a27-0d90719f787d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:38.472531 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db9f641-48ad-4ac6-8a27-0d90719f787d admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:38.558836 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1322/2631] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:35:38 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:35:38.563227 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46065b8c-8080-4006-871a-688a60707a0e admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:38.564090 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db9f641-48ad-4ac6-8a27-0d90719f787d admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:38.566199 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-1db9f641-48ad-4ac6-8a27-0d90719f787d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:38.573594 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46065b8c-8080-4006-871a-688a60707a0e admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:38.627820 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd54ee-163d-4ad9-a057-aaddcb9825f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:38.628061 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db9f641-48ad-4ac6-8a27-0d90719f787d admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:38.628496 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd54ee-163d-4ad9-a057-aaddcb9825f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:38.628788 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd54ee-163d-4ad9-a057-aaddcb9825f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:38.629066 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd54ee-163d-4ad9-a057-aaddcb9825f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:38.630348 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdd54ee-163d-4ad9-a057-aaddcb9825f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:38.632288 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdd54ee-163d-4ad9-a057-aaddcb9825f8 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:38.633392 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c40644e-1ae4-4068-be09-71ce0da40bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:38.634223 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c40644e-1ae4-4068-be09-71ce0da40bef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:38.634506 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c40644e-1ae4-4068-be09-71ce0da40bef admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:38.634778 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c40644e-1ae4-4068-be09-71ce0da40bef admin admin] PATH_INFO: `/v3/users/815860efc3ca437497bf0722ad539e02` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:38.636006 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c40644e-1ae4-4068-be09-71ce0da40bef admin admin] RBAC: Authorizing `identity:delete_user(user_id=815860efc3ca437497bf0722ad539e02)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:38.637903 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c40644e-1ae4-4068-be09-71ce0da40bef admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:38.741921 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1310/2632] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:35:38 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:35:38.750979 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd54ee-163d-4ad9-a057-aaddcb9825f8 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:38.761705 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd54ee-163d-4ad9-a057-aaddcb9825f8 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:38.766713 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b90876b-213d-4097-927a-77bbacd97e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:38.767496 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b90876b-213d-4097-927a-77bbacd97e10 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:38.767837 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b90876b-213d-4097-927a-77bbacd97e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:38.768119 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b90876b-213d-4097-927a-77bbacd97e10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:38.768849 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b90876b-213d-4097-927a-77bbacd97e10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:38.770470 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b90876b-213d-4097-927a-77bbacd97e10 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:38.782134 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1311/2633] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:35:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 07 06:35:38.786945 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b90876b-213d-4097-927a-77bbacd97e10 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:38.796269 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b90876b-213d-4097-927a-77bbacd97e10 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:38.800858 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d871fc-6cc2-4f1d-97a7-e020c9b1322c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:38.802064 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d871fc-6cc2-4f1d-97a7-e020c9b1322c admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:38.802351 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d871fc-6cc2-4f1d-97a7-e020c9b1322c admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:38.802623 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d871fc-6cc2-4f1d-97a7-e020c9b1322c admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:38.803346 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d871fc-6cc2-4f1d-97a7-e020c9b1322c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:38.804945 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d871fc-6cc2-4f1d-97a7-e020c9b1322c admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:38.815779 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1312/2634] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:35:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 07 06:35:38.818892 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d871fc-6cc2-4f1d-97a7-e020c9b1322c admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:38.828674 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d871fc-6cc2-4f1d-97a7-e020c9b1322c admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:38.833230 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e3f9ee-7d0b-4584-a0ef-8f75fcb4c774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:38.834079 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3f9ee-7d0b-4584-a0ef-8f75fcb4c774 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:38.834370 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3f9ee-7d0b-4584-a0ef-8f75fcb4c774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:38.834659 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3f9ee-7d0b-4584-a0ef-8f75fcb4c774 admin admin] PATH_INFO: `/v3/projects/2fe2f83523034bb1af1533a61411028a/users/c1ebae4eee294f3e81f8e9e0cd1c09f9/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:38.849452 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e3f9ee-7d0b-4584-a0ef-8f75fcb4c774 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fe2f83523034bb1af1533a61411028a, user_id=c1ebae4eee294f3e81f8e9e0cd1c09f9, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:38.852149 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e3f9ee-7d0b-4584-a0ef-8f75fcb4c774 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:38.890298 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6c40644e-1ae4-4068-be09-71ce0da40bef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '815860efc3ca437497bf0722ad539e02'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:38.901468 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6c40644e-1ae4-4068-be09-71ce0da40bef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '815860efc3ca437497bf0722ad539e02'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:38.955416 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1313/2635] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:35:38 2022] PUT /identity/v3/projects/2fe2f83523034bb1af1533a61411028a/users/c1ebae4eee294f3e81f8e9e0cd1c09f9/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:35:38.966081 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d175e0a-49f2-40fe-aca9-1d4b9372e92b None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:38.966369 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d175e0a-49f2-40fe-aca9-1d4b9372e92b None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:38.966647 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d175e0a-49f2-40fe-aca9-1d4b9372e92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:38.990948 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6c40644e-1ae4-4068-be09-71ce0da40bef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '815860efc3ca437497bf0722ad539e02'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:38.991597 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6c40644e-1ae4-4068-be09-71ce0da40bef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '815860efc3ca437497bf0722ad539e02'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:38.992255 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6c40644e-1ae4-4068-be09-71ce0da40bef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '815860efc3ca437497bf0722ad539e02'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:38.994021 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-7d175e0a-49f2-40fe-aca9-1d4b9372e92b None None] MFA Rules not processed for user `c1ebae4eee294f3e81f8e9e0cd1c09f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:35:38.995221 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-7d175e0a-49f2-40fe-aca9-1d4b9372e92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:39.004589 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1323/2636] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:35:38 2022] DELETE /identity/v3/users/815860efc3ca437497bf0722ad539e02 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:35:39.009044 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251f080-8982-4138-b9eb-e244aeab664c None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:39.009334 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251f080-8982-4138-b9eb-e244aeab664c None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:39.009610 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251f080-8982-4138-b9eb-e244aeab664c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:39.025406 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-4251f080-8982-4138-b9eb-e244aeab664c None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:35:39.026580 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-4251f080-8982-4138-b9eb-e244aeab664c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:39.057811 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1314/2637] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:35:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:35:39.068703 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d175e0a-49f2-40fe-aca9-1d4b9372e92b None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:39.070180 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-7d175e0a-49f2-40fe-aca9-1d4b9372e92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:39.088364 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1324/2638] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:35:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:35:39.094849 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251f080-8982-4138-b9eb-e244aeab664c None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:39.096239 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-4251f080-8982-4138-b9eb-e244aeab664c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:39.127529 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d175e0a-49f2-40fe-aca9-1d4b9372e92b None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:39.151646 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251f080-8982-4138-b9eb-e244aeab664c None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:39.155349 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad19471-8e35-4804-b71b-4ce2f9f655b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:39.156030 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad19471-8e35-4804-b71b-4ce2f9f655b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:39.156317 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad19471-8e35-4804-b71b-4ce2f9f655b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:39.156592 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad19471-8e35-4804-b71b-4ce2f9f655b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:39.166191 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad19471-8e35-4804-b71b-4ce2f9f655b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:39.167612 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad19471-8e35-4804-b71b-4ce2f9f655b9 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:39.177032 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1325/2639] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:35:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:35:39.179914 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd9fa7-9171-4074-9dea-ead661a7362f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:39.180607 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd9fa7-9171-4074-9dea-ead661a7362f service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:39.180895 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd9fa7-9171-4074-9dea-ead661a7362f service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:39.181173 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd9fa7-9171-4074-9dea-ead661a7362f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:39.236240 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd9fa7-9171-4074-9dea-ead661a7362f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:39.237691 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd9fa7-9171-4074-9dea-ead661a7362f service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:39.246705 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1315/2640] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:35:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 07 06:35:39.597498 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad19471-8e35-4804-b71b-4ce2f9f655b9 service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:39.598968 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-5ad19471-8e35-4804-b71b-4ce2f9f655b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:39.612749 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad19471-8e35-4804-b71b-4ce2f9f655b9 service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:39.617920 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8bd48-2053-4247-8bec-f15f91562c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:39.618909 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8bd48-2053-4247-8bec-f15f91562c79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:39.619207 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8bd48-2053-4247-8bec-f15f91562c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:39.619486 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8bd48-2053-4247-8bec-f15f91562c79 admin admin] PATH_INFO: `/v3/projects/5eb854cd45db49a599036bad33e0edd1` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:39.620845 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e8bd48-2053-4247-8bec-f15f91562c79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5eb854cd45db49a599036bad33e0edd1)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:39.626106 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e8bd48-2053-4247-8bec-f15f91562c79 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:39.725634 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a5e8bd48-2053-4247-8bec-f15f91562c79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5eb854cd45db49a599036bad33e0edd1', 'request_id': 'req-a5e8bd48-2053-4247-8bec-f15f91562c79'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:39.731609 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a5e8bd48-2053-4247-8bec-f15f91562c79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5eb854cd45db49a599036bad33e0edd1', 'request_id': 'req-a5e8bd48-2053-4247-8bec-f15f91562c79'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:39.811822 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a5e8bd48-2053-4247-8bec-f15f91562c79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5eb854cd45db49a599036bad33e0edd1', 'request_id': 'req-a5e8bd48-2053-4247-8bec-f15f91562c79'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:39.823456 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a5e8bd48-2053-4247-8bec-f15f91562c79 admin admin] The token cache is being invalidate because project 5eb854cd45db49a599036bad33e0edd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:35:39.823765 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a5e8bd48-2053-4247-8bec-f15f91562c79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:39.826042 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a5e8bd48-2053-4247-8bec-f15f91562c79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:39.827869 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1326/2641] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:35:39 2022] DELETE /identity/v3/projects/5eb854cd45db49a599036bad33e0edd1 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:35:39.831564 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd9fa7-9171-4074-9dea-ead661a7362f service cinder] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:39.845900 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd9fa7-9171-4074-9dea-ead661a7362f service cinder] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:39.903968 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7746aa80-d794-4c0b-a5f9-fceeef78fd42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:39.905241 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746aa80-d794-4c0b-a5f9-fceeef78fd42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:39.905692 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746aa80-d794-4c0b-a5f9-fceeef78fd42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:39.906104 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746aa80-d794-4c0b-a5f9-fceeef78fd42 admin admin] PATH_INFO: `/v3/users/e80d3961964b4847aa12d3f6e9adb96a` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:39.907866 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7746aa80-d794-4c0b-a5f9-fceeef78fd42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e80d3961964b4847aa12d3f6e9adb96a)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:39.909946 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7746aa80-d794-4c0b-a5f9-fceeef78fd42 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:40.141557 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7746aa80-d794-4c0b-a5f9-fceeef78fd42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e80d3961964b4847aa12d3f6e9adb96a'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:40.142119 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7746aa80-d794-4c0b-a5f9-fceeef78fd42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e80d3961964b4847aa12d3f6e9adb96a'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:40.229926 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7746aa80-d794-4c0b-a5f9-fceeef78fd42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e80d3961964b4847aa12d3f6e9adb96a'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:40.230552 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7746aa80-d794-4c0b-a5f9-fceeef78fd42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e80d3961964b4847aa12d3f6e9adb96a'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:40.245118 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7746aa80-d794-4c0b-a5f9-fceeef78fd42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e80d3961964b4847aa12d3f6e9adb96a'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:40.257666 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1316/2642] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:35:39 2022] DELETE /identity/v3/users/e80d3961964b4847aa12d3f6e9adb96a => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:35:40.631569 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8bd48-2053-4247-8bec-f15f91562c79 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:40.633009 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a5e8bd48-2053-4247-8bec-f15f91562c79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:40.646635 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8bd48-2053-4247-8bec-f15f91562c79 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:40.701259 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3006def6-725b-47a9-b2dd-a2a603bfdf00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:40.702112 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006def6-725b-47a9-b2dd-a2a603bfdf00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:40.702398 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006def6-725b-47a9-b2dd-a2a603bfdf00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:40.702676 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006def6-725b-47a9-b2dd-a2a603bfdf00 admin admin] PATH_INFO: `/v3/projects/17388aa054d04a94838b0e9da713924a` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:40.703875 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3006def6-725b-47a9-b2dd-a2a603bfdf00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17388aa054d04a94838b0e9da713924a)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:40.705764 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3006def6-725b-47a9-b2dd-a2a603bfdf00 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:40.811632 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3006def6-725b-47a9-b2dd-a2a603bfdf00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17388aa054d04a94838b0e9da713924a', 'request_id': 'req-3006def6-725b-47a9-b2dd-a2a603bfdf00'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:40.818334 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3006def6-725b-47a9-b2dd-a2a603bfdf00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17388aa054d04a94838b0e9da713924a', 'request_id': 'req-3006def6-725b-47a9-b2dd-a2a603bfdf00'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:40.903187 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3006def6-725b-47a9-b2dd-a2a603bfdf00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17388aa054d04a94838b0e9da713924a', 'request_id': 'req-3006def6-725b-47a9-b2dd-a2a603bfdf00'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:40.914598 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3006def6-725b-47a9-b2dd-a2a603bfdf00 admin admin] The token cache is being invalidate because project 17388aa054d04a94838b0e9da713924a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:35:40.914598 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3006def6-725b-47a9-b2dd-a2a603bfdf00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:40.914963 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3006def6-725b-47a9-b2dd-a2a603bfdf00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:40.916524 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1327/2643] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:35:40 2022] DELETE /identity/v3/projects/17388aa054d04a94838b0e9da713924a => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:35:40.924511 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c298e9e-c24a-439e-b67f-c8c32a2aa1dc None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:40.924962 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c298e9e-c24a-439e-b67f-c8c32a2aa1dc None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:40.925072 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c298e9e-c24a-439e-b67f-c8c32a2aa1dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:40.943071 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-2c298e9e-c24a-439e-b67f-c8c32a2aa1dc None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:35:40.947062 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-2c298e9e-c24a-439e-b67f-c8c32a2aa1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:41.002955 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1317/2644] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:35:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:35:41.011417 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a916011-d7b8-4d69-ab65-4cd6be795bcf None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:41.011715 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a916011-d7b8-4d69-ab65-4cd6be795bcf None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:41.012026 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a916011-d7b8-4d69-ab65-4cd6be795bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:41.029766 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-3a916011-d7b8-4d69-ab65-4cd6be795bcf None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:35:41.030953 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-3a916011-d7b8-4d69-ab65-4cd6be795bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:41.039706 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1328/2645] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:35:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:35:41.043797 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c298e9e-c24a-439e-b67f-c8c32a2aa1dc None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:41.053737 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c298e9e-c24a-439e-b67f-c8c32a2aa1dc None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:41.058429 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1e5e1-fbfb-4f01-8dba-cba026b45a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:41.059088 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1e5e1-fbfb-4f01-8dba-cba026b45a8f admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:41.066338 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1e5e1-fbfb-4f01-8dba-cba026b45a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:41.066338 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1e5e1-fbfb-4f01-8dba-cba026b45a8f admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:41.066338 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc1e5e1-fbfb-4f01-8dba-cba026b45a8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:35:41.066338 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc1e5e1-fbfb-4f01-8dba-cba026b45a8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:41.066338 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc1e5e1-fbfb-4f01-8dba-cba026b45a8f admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:41.073831 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1318/2646] 10.222.0.24 () {58 vars in 1152 bytes} [Thu Apr 7 06:35:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:35:41.078271 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a916011-d7b8-4d69-ab65-4cd6be795bcf None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:41.087671 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a916011-d7b8-4d69-ab65-4cd6be795bcf None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:41.092741 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be708c0-407a-4f21-81ed-4c46fadfda74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:41.093415 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be708c0-407a-4f21-81ed-4c46fadfda74 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:41.095399 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be708c0-407a-4f21-81ed-4c46fadfda74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:41.095399 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be708c0-407a-4f21-81ed-4c46fadfda74 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:41.095399 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be708c0-407a-4f21-81ed-4c46fadfda74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:41.096804 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be708c0-407a-4f21-81ed-4c46fadfda74 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:41.197525 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1329/2647] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:35:41 2022] POST /identity/v3/projects => generated 363 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:35:41.207051 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1e5e1-fbfb-4f01-8dba-cba026b45a8f admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:41.216870 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1e5e1-fbfb-4f01-8dba-cba026b45a8f admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:41.272498 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb6815-059b-4290-98a7-432117420e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:41.273168 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb6815-059b-4290-98a7-432117420e63 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:41.273457 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb6815-059b-4290-98a7-432117420e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:41.273731 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb6815-059b-4290-98a7-432117420e63 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:41.274431 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbb6815-059b-4290-98a7-432117420e63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:41.276392 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbb6815-059b-4290-98a7-432117420e63 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:41.372732 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1319/2648] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:35:41 2022] POST /identity/v3/users => generated 282 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:35:41.376807 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be708c0-407a-4f21-81ed-4c46fadfda74 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:41.387075 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be708c0-407a-4f21-81ed-4c46fadfda74 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:41.391910 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a781c29-35c5-4bd0-87c9-0ba9b0c10ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:41.392561 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a781c29-35c5-4bd0-87c9-0ba9b0c10ebc admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:41.392844 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a781c29-35c5-4bd0-87c9-0ba9b0c10ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:41.393116 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a781c29-35c5-4bd0-87c9-0ba9b0c10ebc admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:41.393839 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a781c29-35c5-4bd0-87c9-0ba9b0c10ebc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:41.396065 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a781c29-35c5-4bd0-87c9-0ba9b0c10ebc admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:41.406467 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1330/2649] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:35:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:35:41.410410 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb6815-059b-4290-98a7-432117420e63 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:41.420818 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb6815-059b-4290-98a7-432117420e63 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:41.425433 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7389021-88ef-47c8-b2f8-a26d1d264fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:41.426186 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7389021-88ef-47c8-b2f8-a26d1d264fc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:41.426436 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7389021-88ef-47c8-b2f8-a26d1d264fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:41.426718 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7389021-88ef-47c8-b2f8-a26d1d264fc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:41.427446 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7389021-88ef-47c8-b2f8-a26d1d264fc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:41.429071 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7389021-88ef-47c8-b2f8-a26d1d264fc4 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:41.438957 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1320/2650] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:35:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:35:41.442998 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a781c29-35c5-4bd0-87c9-0ba9b0c10ebc admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:41.452787 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a781c29-35c5-4bd0-87c9-0ba9b0c10ebc admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:41.458102 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e48e44-42b8-4c79-9deb-8c0e8fbeab29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:41.458699 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e48e44-42b8-4c79-9deb-8c0e8fbeab29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:41.458985 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e48e44-42b8-4c79-9deb-8c0e8fbeab29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:41.459258 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e48e44-42b8-4c79-9deb-8c0e8fbeab29 admin admin] PATH_INFO: `/v3/projects/b03f1c05b0834c28926b5af78ae7b148/users/31363447e39e43c8a49ea4e177081c7a/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:41.474431 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e48e44-42b8-4c79-9deb-8c0e8fbeab29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b03f1c05b0834c28926b5af78ae7b148, user_id=31363447e39e43c8a49ea4e177081c7a, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:41.477115 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e48e44-42b8-4c79-9deb-8c0e8fbeab29 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:41.549776 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1331/2651] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:35:41 2022] PUT /identity/v3/projects/b03f1c05b0834c28926b5af78ae7b148/users/31363447e39e43c8a49ea4e177081c7a/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:35:41.560796 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f292c17-8a8a-4742-8edb-1d7d69abfaab None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:41.561113 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f292c17-8a8a-4742-8edb-1d7d69abfaab None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:41.561394 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f292c17-8a8a-4742-8edb-1d7d69abfaab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:41.587390 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-5f292c17-8a8a-4742-8edb-1d7d69abfaab None None] MFA Rules not processed for user `31363447e39e43c8a49ea4e177081c7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:35:41.588685 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-5f292c17-8a8a-4742-8edb-1d7d69abfaab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:41.649768 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1321/2652] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:35:41 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:35:41.654195 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e48e44-42b8-4c79-9deb-8c0e8fbeab29 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:41.713223 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e48e44-42b8-4c79-9deb-8c0e8fbeab29 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:41.717695 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b02ded7-b38f-43bc-82ce-8d76ffefd018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:41.718344 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b02ded7-b38f-43bc-82ce-8d76ffefd018 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:41.718629 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b02ded7-b38f-43bc-82ce-8d76ffefd018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:41.718903 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b02ded7-b38f-43bc-82ce-8d76ffefd018 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:41.719583 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b02ded7-b38f-43bc-82ce-8d76ffefd018 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:41.721492 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b02ded7-b38f-43bc-82ce-8d76ffefd018 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:41.801651 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1332/2653] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:35:41 2022] POST /identity/v3/projects => generated 367 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:35:41.805670 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f292c17-8a8a-4742-8edb-1d7d69abfaab None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:41.816119 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f292c17-8a8a-4742-8edb-1d7d69abfaab None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:41.869229 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af36c1f9-ffeb-4e33-b092-4768277ab8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:41.869889 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36c1f9-ffeb-4e33-b092-4768277ab8bb admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:41.870174 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36c1f9-ffeb-4e33-b092-4768277ab8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:41.870445 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36c1f9-ffeb-4e33-b092-4768277ab8bb admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:41.871128 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af36c1f9-ffeb-4e33-b092-4768277ab8bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:41.873052 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af36c1f9-ffeb-4e33-b092-4768277ab8bb admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:41.947898 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1322/2654] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:35:41 2022] POST /identity/v3/users => generated 290 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:35:41.949817 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b02ded7-b38f-43bc-82ce-8d76ffefd018 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:41.961766 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b02ded7-b38f-43bc-82ce-8d76ffefd018 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:41.967368 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8024e5-bec6-42d1-812d-7c0606801ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:41.968006 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8024e5-bec6-42d1-812d-7c0606801ec6 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:41.968291 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8024e5-bec6-42d1-812d-7c0606801ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:41.968565 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8024e5-bec6-42d1-812d-7c0606801ec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:41.969798 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8024e5-bec6-42d1-812d-7c0606801ec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:41.970864 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8024e5-bec6-42d1-812d-7c0606801ec6 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:41.981857 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1333/2655] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:35:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:35:41.986184 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af36c1f9-ffeb-4e33-b092-4768277ab8bb admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:41.996276 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af36c1f9-ffeb-4e33-b092-4768277ab8bb admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:42.000920 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4b5e5c-0b56-4f4c-8b98-09d3e9f5836b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:42.001827 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b5e5c-0b56-4f4c-8b98-09d3e9f5836b admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:42.002116 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b5e5c-0b56-4f4c-8b98-09d3e9f5836b admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:42.002388 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b5e5c-0b56-4f4c-8b98-09d3e9f5836b admin admin] PATH_INFO: `/v3/projects/2a2cc00a51cb496aa3e09aedefbb5f62/users/cc8c43779bc84eb3bb6f32383c77ffda/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:42.019361 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4b5e5c-0b56-4f4c-8b98-09d3e9f5836b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a2cc00a51cb496aa3e09aedefbb5f62, user_id=cc8c43779bc84eb3bb6f32383c77ffda, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:42.029151 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4b5e5c-0b56-4f4c-8b98-09d3e9f5836b admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:42.098370 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1323/2656] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:35:41 2022] PUT /identity/v3/projects/2a2cc00a51cb496aa3e09aedefbb5f62/users/cc8c43779bc84eb3bb6f32383c77ffda/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:35:42.102531 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8024e5-bec6-42d1-812d-7c0606801ec6 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:42.112487 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8024e5-bec6-42d1-812d-7c0606801ec6 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:42.167539 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6263990-7c85-449a-8805-61b9f1c9db23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:42.168256 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6263990-7c85-449a-8805-61b9f1c9db23 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:42.168545 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6263990-7c85-449a-8805-61b9f1c9db23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:42.169643 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6263990-7c85-449a-8805-61b9f1c9db23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:42.170584 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6263990-7c85-449a-8805-61b9f1c9db23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:42.172421 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6263990-7c85-449a-8805-61b9f1c9db23 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:42.184232 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1334/2657] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:35:42 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:35:42.191673 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4b5e5c-0b56-4f4c-8b98-09d3e9f5836b admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:42.202391 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4b5e5c-0b56-4f4c-8b98-09d3e9f5836b admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:42.208491 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8eb5be-6401-49c7-8d64-a6e95fb0c9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:42.209431 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8eb5be-6401-49c7-8d64-a6e95fb0c9e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:42.209716 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8eb5be-6401-49c7-8d64-a6e95fb0c9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:42.209989 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8eb5be-6401-49c7-8d64-a6e95fb0c9e5 admin admin] PATH_INFO: `/v3/projects/2a2cc00a51cb496aa3e09aedefbb5f62/users/cc8c43779bc84eb3bb6f32383c77ffda/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:42.212406 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8eb5be-6401-49c7-8d64-a6e95fb0c9e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a2cc00a51cb496aa3e09aedefbb5f62, user_id=cc8c43779bc84eb3bb6f32383c77ffda, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:42.215198 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8eb5be-6401-49c7-8d64-a6e95fb0c9e5 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:42.236705 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1324/2658] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:35:42 2022] PUT /identity/v3/projects/2a2cc00a51cb496aa3e09aedefbb5f62/users/cc8c43779bc84eb3bb6f32383c77ffda/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:35:42.249728 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64715ff1-dc44-46e2-9567-9a24a438fb2d None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:42.250015 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64715ff1-dc44-46e2-9567-9a24a438fb2d None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:42.250291 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64715ff1-dc44-46e2-9567-9a24a438fb2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:42.279029 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-64715ff1-dc44-46e2-9567-9a24a438fb2d None None] MFA Rules not processed for user `cc8c43779bc84eb3bb6f32383c77ffda`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:35:42.280403 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-64715ff1-dc44-46e2-9567-9a24a438fb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:42.338561 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8eb5be-6401-49c7-8d64-a6e95fb0c9e5 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:42.340412 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-1d8eb5be-6401-49c7-8d64-a6e95fb0c9e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:42.361275 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1335/2659] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:35:42 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:35:42.380789 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64715ff1-dc44-46e2-9567-9a24a438fb2d None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:42.382467 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-64715ff1-dc44-46e2-9567-9a24a438fb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:42.423654 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8eb5be-6401-49c7-8d64-a6e95fb0c9e5 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:42.429323 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483c1ef-4936-4731-8075-eacf0e81bf32 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff35b68665724754a6413bca0030016f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:42.429974 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483c1ef-4936-4731-8075-eacf0e81bf32 service placement] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:42.430261 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483c1ef-4936-4731-8075-eacf0e81bf32 service placement] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:42.430540 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483c1ef-4936-4731-8075-eacf0e81bf32 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:42.432588 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-0483c1ef-4936-4731-8075-eacf0e81bf32 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:42.437693 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64715ff1-dc44-46e2-9567-9a24a438fb2d None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:42.441696 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8809103-a001-4e0d-81e4-9219e8d9e213 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:42.443020 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8809103-a001-4e0d-81e4-9219e8d9e213 service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:42.443310 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8809103-a001-4e0d-81e4-9219e8d9e213 service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:42.443584 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8809103-a001-4e0d-81e4-9219e8d9e213 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:42.445135 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0483c1ef-4936-4731-8075-eacf0e81bf32 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:42.446721 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0483c1ef-4936-4731-8075-eacf0e81bf32 service placement] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:42.453494 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8809103-a001-4e0d-81e4-9219e8d9e213 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:42.454905 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8809103-a001-4e0d-81e4-9219e8d9e213 service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:42.457500 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1325/2660] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:35:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 07 06:35:42.464794 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1336/2661] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:35:42 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:35:42.748629 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483c1ef-4936-4731-8075-eacf0e81bf32 service placement] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:42.750049 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-0483c1ef-4936-4731-8075-eacf0e81bf32 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:42.764230 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483c1ef-4936-4731-8075-eacf0e81bf32 service placement] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:42.767847 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7874f706-e98e-40b2-92c4-61adebb6100c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:42.768495 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7874f706-e98e-40b2-92c4-61adebb6100c service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:42.768777 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7874f706-e98e-40b2-92c4-61adebb6100c service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:42.769049 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7874f706-e98e-40b2-92c4-61adebb6100c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:42.826812 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7874f706-e98e-40b2-92c4-61adebb6100c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:42.828406 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7874f706-e98e-40b2-92c4-61adebb6100c service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:42.837712 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1326/2662] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:35:42 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:35:47.793005 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8809103-a001-4e0d-81e4-9219e8d9e213 service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:47.861738 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8809103-a001-4e0d-81e4-9219e8d9e213 service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:47.867281 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b927fd5-3bc3-4361-9acc-0e870f6a8a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:47.868229 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b927fd5-3bc3-4361-9acc-0e870f6a8a03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:47.868794 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b927fd5-3bc3-4361-9acc-0e870f6a8a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:47.869080 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b927fd5-3bc3-4361-9acc-0e870f6a8a03 admin admin] PATH_INFO: `/v3/users/31363447e39e43c8a49ea4e177081c7a` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:47.870651 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b927fd5-3bc3-4361-9acc-0e870f6a8a03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31363447e39e43c8a49ea4e177081c7a)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:47.874007 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b927fd5-3bc3-4361-9acc-0e870f6a8a03 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:48.080764 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42597d87-5536-48dd-9230-38c2d14bda13 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:48.085387 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42597d87-5536-48dd-9230-38c2d14bda13 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:48.085387 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42597d87-5536-48dd-9230-38c2d14bda13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:48.100589 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-8b927fd5-3bc3-4361-9acc-0e870f6a8a03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31363447e39e43c8a49ea4e177081c7a'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:48.103093 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-42597d87-5536-48dd-9230-38c2d14bda13 None None] MFA Rules not processed for user `f4435fb14c3844728531af63993f78c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:35:48.105171 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-42597d87-5536-48dd-9230-38c2d14bda13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:48.115982 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-8b927fd5-3bc3-4361-9acc-0e870f6a8a03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31363447e39e43c8a49ea4e177081c7a'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:48.166433 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1327/2663] 10.222.0.24 () {58 vars in 1009 bytes} [Thu Apr 7 06:35:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:35:48.219986 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-8b927fd5-3bc3-4361-9acc-0e870f6a8a03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31363447e39e43c8a49ea4e177081c7a'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:48.219986 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-8b927fd5-3bc3-4361-9acc-0e870f6a8a03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31363447e39e43c8a49ea4e177081c7a'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:48.219986 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-8b927fd5-3bc3-4361-9acc-0e870f6a8a03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31363447e39e43c8a49ea4e177081c7a'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:48.232175 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1337/2664] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:35:47 2022] DELETE /identity/v3/users/31363447e39e43c8a49ea4e177081c7a => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:35:48.236744 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da79a0-9111-43bb-8f2f-18ca4487f886 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:48.246285 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da79a0-9111-43bb-8f2f-18ca4487f886 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:48.246285 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da79a0-9111-43bb-8f2f-18ca4487f886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:48.254670 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-a4da79a0-9111-43bb-8f2f-18ca4487f886 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:35:48.255964 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a4da79a0-9111-43bb-8f2f-18ca4487f886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:48.311450 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1328/2665] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:35:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:35:48.320973 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b927fd5-3bc3-4361-9acc-0e870f6a8a03 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:48.322392 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-8b927fd5-3bc3-4361-9acc-0e870f6a8a03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:48.360707 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4da79a0-9111-43bb-8f2f-18ca4487f886 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:48.362868 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a4da79a0-9111-43bb-8f2f-18ca4487f886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:48.389982 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b927fd5-3bc3-4361-9acc-0e870f6a8a03 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:48.393671 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7283b-08b7-4927-b168-20476e2e815d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:48.394326 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7283b-08b7-4927-b168-20476e2e815d service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:48.394611 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7283b-08b7-4927-b168-20476e2e815d service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:48.394885 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7283b-08b7-4927-b168-20476e2e815d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:48.404424 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f7283b-08b7-4927-b168-20476e2e815d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:48.405873 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f7283b-08b7-4927-b168-20476e2e815d service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:48.416013 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1338/2666] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:35:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:35:48.434715 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4da79a0-9111-43bb-8f2f-18ca4487f886 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:48.439805 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e6af8-26b6-4407-8669-9e788b7269ae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4abbb8c5324b7babd69e3b4473b3e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:48.440465 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e6af8-26b6-4407-8669-9e788b7269ae service swift] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:48.440803 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e6af8-26b6-4407-8669-9e788b7269ae service swift] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:48.441075 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e6af8-26b6-4407-8669-9e788b7269ae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:48.443009 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-6d5e6af8-26b6-4407-8669-9e788b7269ae service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:48.507662 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5e6af8-26b6-4407-8669-9e788b7269ae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:48.509335 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5e6af8-26b6-4407-8669-9e788b7269ae service swift] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:48.517684 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1329/2667] 10.222.0.24 () {60 vars in 1384 bytes} [Thu Apr 7 06:35:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 07 06:35:48.849584 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7283b-08b7-4927-b168-20476e2e815d service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:48.850996 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d1f7283b-08b7-4927-b168-20476e2e815d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:48.864185 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7283b-08b7-4927-b168-20476e2e815d service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:48.869747 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07dc157-79d6-4226-abbf-8d6ecde52c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:48.870618 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07dc157-79d6-4226-abbf-8d6ecde52c66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:48.870908 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07dc157-79d6-4226-abbf-8d6ecde52c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:48.871188 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07dc157-79d6-4226-abbf-8d6ecde52c66 admin admin] PATH_INFO: `/v3/projects/b03f1c05b0834c28926b5af78ae7b148` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:48.872417 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07dc157-79d6-4226-abbf-8d6ecde52c66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b03f1c05b0834c28926b5af78ae7b148)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:48.874331 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07dc157-79d6-4226-abbf-8d6ecde52c66 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:48.989648 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-f07dc157-79d6-4226-abbf-8d6ecde52c66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b03f1c05b0834c28926b5af78ae7b148', 'request_id': 'req-f07dc157-79d6-4226-abbf-8d6ecde52c66'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:48.996216 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-f07dc157-79d6-4226-abbf-8d6ecde52c66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b03f1c05b0834c28926b5af78ae7b148', 'request_id': 'req-f07dc157-79d6-4226-abbf-8d6ecde52c66'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:49.069945 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-f07dc157-79d6-4226-abbf-8d6ecde52c66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b03f1c05b0834c28926b5af78ae7b148', 'request_id': 'req-f07dc157-79d6-4226-abbf-8d6ecde52c66'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:49.080704 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-f07dc157-79d6-4226-abbf-8d6ecde52c66 admin admin] The token cache is being invalidate because project b03f1c05b0834c28926b5af78ae7b148 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:35:49.080995 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-f07dc157-79d6-4226-abbf-8d6ecde52c66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:49.081639 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-f07dc157-79d6-4226-abbf-8d6ecde52c66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:49.083733 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1339/2668] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:35:48 2022] DELETE /identity/v3/projects/b03f1c05b0834c28926b5af78ae7b148 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:35:49.087990 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e6af8-26b6-4407-8669-9e788b7269ae service swift] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:49.098638 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e6af8-26b6-4407-8669-9e788b7269ae service swift] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:49.154545 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdde5aa-3f4c-4402-9c68-438ff1d4f52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:49.155490 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdde5aa-3f4c-4402-9c68-438ff1d4f52e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:49.155870 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdde5aa-3f4c-4402-9c68-438ff1d4f52e admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:49.156211 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdde5aa-3f4c-4402-9c68-438ff1d4f52e admin admin] PATH_INFO: `/v3/users/cc8c43779bc84eb3bb6f32383c77ffda` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:49.157617 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdde5aa-3f4c-4402-9c68-438ff1d4f52e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc8c43779bc84eb3bb6f32383c77ffda)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:49.159697 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdde5aa-3f4c-4402-9c68-438ff1d4f52e admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:49.173133 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07dc157-79d6-4226-abbf-8d6ecde52c66 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:49.174737 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f07dc157-79d6-4226-abbf-8d6ecde52c66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:49.187702 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07dc157-79d6-4226-abbf-8d6ecde52c66 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:49.192882 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b38bcf-87d4-40b8-bf44-bee5f91c1d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:49.193749 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b38bcf-87d4-40b8-bf44-bee5f91c1d3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:49.194035 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b38bcf-87d4-40b8-bf44-bee5f91c1d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:49.194367 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b38bcf-87d4-40b8-bf44-bee5f91c1d3e admin admin] PATH_INFO: `/v3/users/998880a3fc5a4980853c1c21dd834b92` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:49.195493 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b38bcf-87d4-40b8-bf44-bee5f91c1d3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=998880a3fc5a4980853c1c21dd834b92)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:49.197440 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b38bcf-87d4-40b8-bf44-bee5f91c1d3e admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:49.384544 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-dbdde5aa-3f4c-4402-9c68-438ff1d4f52e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc8c43779bc84eb3bb6f32383c77ffda'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:49.385130 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-dbdde5aa-3f4c-4402-9c68-438ff1d4f52e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc8c43779bc84eb3bb6f32383c77ffda'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:49.454601 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-18b38bcf-87d4-40b8-bf44-bee5f91c1d3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '998880a3fc5a4980853c1c21dd834b92'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:49.466342 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-18b38bcf-87d4-40b8-bf44-bee5f91c1d3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '998880a3fc5a4980853c1c21dd834b92'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:49.468812 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-dbdde5aa-3f4c-4402-9c68-438ff1d4f52e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc8c43779bc84eb3bb6f32383c77ffda'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:49.469505 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-dbdde5aa-3f4c-4402-9c68-438ff1d4f52e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc8c43779bc84eb3bb6f32383c77ffda'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:49.482715 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-dbdde5aa-3f4c-4402-9c68-438ff1d4f52e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc8c43779bc84eb3bb6f32383c77ffda'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:49.495453 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1330/2669] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:35:49 2022] DELETE /identity/v3/users/cc8c43779bc84eb3bb6f32383c77ffda => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:35:49.496789 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dafd2d9-a7cc-4fc2-9ce1-8909a2a3ca7e None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:49.497166 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dafd2d9-a7cc-4fc2-9ce1-8909a2a3ca7e None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:49.497442 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dafd2d9-a7cc-4fc2-9ce1-8909a2a3ca7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:49.514370 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-0dafd2d9-a7cc-4fc2-9ce1-8909a2a3ca7e None None] MFA Rules not processed for user `f4435fb14c3844728531af63993f78c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:35:49.515604 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-0dafd2d9-a7cc-4fc2-9ce1-8909a2a3ca7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:49.564179 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-18b38bcf-87d4-40b8-bf44-bee5f91c1d3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '998880a3fc5a4980853c1c21dd834b92'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:49.565200 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-18b38bcf-87d4-40b8-bf44-bee5f91c1d3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '998880a3fc5a4980853c1c21dd834b92'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:49.566195 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-18b38bcf-87d4-40b8-bf44-bee5f91c1d3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '998880a3fc5a4980853c1c21dd834b92'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:49.577601 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1331/2670] 10.222.0.24 () {58 vars in 967 bytes} [Thu Apr 7 06:35:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:35:49.580343 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1340/2671] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:35:49 2022] DELETE /identity/v3/users/998880a3fc5a4980853c1c21dd834b92 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:35:49.584851 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591cb46e-f842-4ae5-9203-94c5f5dd3140 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:49.585614 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591cb46e-f842-4ae5-9203-94c5f5dd3140 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:49.585614 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591cb46e-f842-4ae5-9203-94c5f5dd3140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:49.590485 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b38bcf-87d4-40b8-bf44-bee5f91c1d3e admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:49.591973 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-18b38bcf-87d4-40b8-bf44-bee5f91c1d3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:49.603967 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-591cb46e-f842-4ae5-9203-94c5f5dd3140 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:35:49.605144 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-591cb46e-f842-4ae5-9203-94c5f5dd3140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:49.670089 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1332/2672] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:35:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:35:49.685377 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b38bcf-87d4-40b8-bf44-bee5f91c1d3e admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:49.685377 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33908a66-f1bd-4adf-878c-3a38537f9199 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4abbb8c5324b7babd69e3b4473b3e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:49.685377 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33908a66-f1bd-4adf-878c-3a38537f9199 service swift] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:49.685377 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33908a66-f1bd-4adf-878c-3a38537f9199 service swift] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:49.685801 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33908a66-f1bd-4adf-878c-3a38537f9199 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:49.686138 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591cb46e-f842-4ae5-9203-94c5f5dd3140 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:49.687529 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-591cb46e-f842-4ae5-9203-94c5f5dd3140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:49.743776 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33908a66-f1bd-4adf-878c-3a38537f9199 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:49.750081 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33908a66-f1bd-4adf-878c-3a38537f9199 service swift] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:49.753706 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591cb46e-f842-4ae5-9203-94c5f5dd3140 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:49.754380 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1341/2673] 10.222.0.24 () {60 vars in 1384 bytes} [Thu Apr 7 06:35:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 07 06:35:49.757782 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d6bb1-8aea-47de-a6d1-9ec433f4748b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:49.758451 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d6bb1-8aea-47de-a6d1-9ec433f4748b service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:49.758807 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d6bb1-8aea-47de-a6d1-9ec433f4748b service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:49.759002 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d6bb1-8aea-47de-a6d1-9ec433f4748b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:49.773536 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789d6bb1-8aea-47de-a6d1-9ec433f4748b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:49.775396 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789d6bb1-8aea-47de-a6d1-9ec433f4748b service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:49.785657 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1333/2674] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:35:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 07 06:35:50.048133 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33908a66-f1bd-4adf-878c-3a38537f9199 service swift] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:50.048133 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-33908a66-f1bd-4adf-878c-3a38537f9199 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:50.064951 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33908a66-f1bd-4adf-878c-3a38537f9199 service swift] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:50.071146 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6244971d-0b7d-4728-a26c-2b29a86a54a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:50.072198 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244971d-0b7d-4728-a26c-2b29a86a54a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:50.072654 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244971d-0b7d-4728-a26c-2b29a86a54a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:50.072989 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244971d-0b7d-4728-a26c-2b29a86a54a6 admin admin] PATH_INFO: `/v3/projects/2a2cc00a51cb496aa3e09aedefbb5f62` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:50.074858 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6244971d-0b7d-4728-a26c-2b29a86a54a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a2cc00a51cb496aa3e09aedefbb5f62)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:50.076815 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6244971d-0b7d-4728-a26c-2b29a86a54a6 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:50.162614 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6244971d-0b7d-4728-a26c-2b29a86a54a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a2cc00a51cb496aa3e09aedefbb5f62', 'request_id': 'req-6244971d-0b7d-4728-a26c-2b29a86a54a6'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:50.169320 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6244971d-0b7d-4728-a26c-2b29a86a54a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a2cc00a51cb496aa3e09aedefbb5f62', 'request_id': 'req-6244971d-0b7d-4728-a26c-2b29a86a54a6'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:50.235388 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6244971d-0b7d-4728-a26c-2b29a86a54a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a2cc00a51cb496aa3e09aedefbb5f62', 'request_id': 'req-6244971d-0b7d-4728-a26c-2b29a86a54a6'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:50.246474 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6244971d-0b7d-4728-a26c-2b29a86a54a6 admin admin] The token cache is being invalidate because project 2a2cc00a51cb496aa3e09aedefbb5f62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:35:50.246764 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6244971d-0b7d-4728-a26c-2b29a86a54a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:50.247375 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6244971d-0b7d-4728-a26c-2b29a86a54a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:50.248976 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1342/2675] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:35:50 2022] DELETE /identity/v3/projects/2a2cc00a51cb496aa3e09aedefbb5f62 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:35:50.253990 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27573650-7c52-4361-819c-e585502b1998 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:50.254463 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27573650-7c52-4361-819c-e585502b1998 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:50.254589 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27573650-7c52-4361-819c-e585502b1998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:50.268131 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6244971d-0b7d-4728-a26c-2b29a86a54a6 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:50.269735 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-6244971d-0b7d-4728-a26c-2b29a86a54a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:50.273943 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-27573650-7c52-4361-819c-e585502b1998 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:35:50.275422 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-27573650-7c52-4361-819c-e585502b1998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:50.340801 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6244971d-0b7d-4728-a26c-2b29a86a54a6 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:50.346904 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e0ff62-bc3a-4316-b5ba-3458fcd4e12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:50.347896 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0ff62-bc3a-4316-b5ba-3458fcd4e12e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:50.348251 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0ff62-bc3a-4316-b5ba-3458fcd4e12e admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:50.348596 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0ff62-bc3a-4316-b5ba-3458fcd4e12e admin admin] PATH_INFO: `/v3/projects/de406c5600e64bac8ca23f958b70d280` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:50.349862 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1334/2676] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:35:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:35:50.350485 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e0ff62-bc3a-4316-b5ba-3458fcd4e12e admin admin] RBAC: Authorizing `identity:delete_project(project_id=de406c5600e64bac8ca23f958b70d280)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:50.353130 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e0ff62-bc3a-4316-b5ba-3458fcd4e12e admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:50.358816 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9016d4c-3043-41b4-b213-bdbfb37b2bd1 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:50.359110 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9016d4c-3043-41b4-b213-bdbfb37b2bd1 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:50.359547 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9016d4c-3043-41b4-b213-bdbfb37b2bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:50.378852 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-c9016d4c-3043-41b4-b213-bdbfb37b2bd1 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:35:50.380066 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-c9016d4c-3043-41b4-b213-bdbfb37b2bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:50.388604 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1335/2677] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:35:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:35:50.392871 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9016d4c-3043-41b4-b213-bdbfb37b2bd1 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:50.401822 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9016d4c-3043-41b4-b213-bdbfb37b2bd1 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:50.406382 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b0f7c-97b5-4748-a302-d2e7c17557be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:50.407000 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b0f7c-97b5-4748-a302-d2e7c17557be admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:50.407287 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b0f7c-97b5-4748-a302-d2e7c17557be admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:50.407572 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b0f7c-97b5-4748-a302-d2e7c17557be admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:50.408309 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562b0f7c-97b5-4748-a302-d2e7c17557be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:35:50.408618 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562b0f7c-97b5-4748-a302-d2e7c17557be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:50.410240 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562b0f7c-97b5-4748-a302-d2e7c17557be admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:50.421604 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1336/2678] 10.222.0.24 () {58 vars in 1152 bytes} [Thu Apr 7 06:35:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 07 06:35:50.425600 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b0f7c-97b5-4748-a302-d2e7c17557be admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:50.435317 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b0f7c-97b5-4748-a302-d2e7c17557be admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:50.439863 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b74ff-e151-44e7-bcc8-6156dcdc710f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:50.440469 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b74ff-e151-44e7-bcc8-6156dcdc710f admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:50.440750 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b74ff-e151-44e7-bcc8-6156dcdc710f admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:50.441025 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b74ff-e151-44e7-bcc8-6156dcdc710f admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:50.441691 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b74ff-e151-44e7-bcc8-6156dcdc710f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:50.444124 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b74ff-e151-44e7-bcc8-6156dcdc710f admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:50.476282 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-25e0ff62-bc3a-4316-b5ba-3458fcd4e12e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de406c5600e64bac8ca23f958b70d280', 'request_id': 'req-25e0ff62-bc3a-4316-b5ba-3458fcd4e12e'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:50.482373 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-25e0ff62-bc3a-4316-b5ba-3458fcd4e12e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de406c5600e64bac8ca23f958b70d280', 'request_id': 'req-25e0ff62-bc3a-4316-b5ba-3458fcd4e12e'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:50.546336 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1337/2679] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:35:50 2022] POST /identity/v3/projects => generated 383 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:35:50.547787 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c406d45-98e6-43c3-9e2d-635388e8d1d6 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:50.548084 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c406d45-98e6-43c3-9e2d-635388e8d1d6 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:50.548382 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c406d45-98e6-43c3-9e2d-635388e8d1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:50.565417 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-1c406d45-98e6-43c3-9e2d-635388e8d1d6 None None] MFA Rules not processed for user `f4435fb14c3844728531af63993f78c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:35:50.566587 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-1c406d45-98e6-43c3-9e2d-635388e8d1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:50.573018 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-25e0ff62-bc3a-4316-b5ba-3458fcd4e12e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de406c5600e64bac8ca23f958b70d280', 'request_id': 'req-25e0ff62-bc3a-4316-b5ba-3458fcd4e12e'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:50.584053 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-25e0ff62-bc3a-4316-b5ba-3458fcd4e12e admin admin] The token cache is being invalidate because project de406c5600e64bac8ca23f958b70d280 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:35:50.584341 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-25e0ff62-bc3a-4316-b5ba-3458fcd4e12e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:50.584991 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-25e0ff62-bc3a-4316-b5ba-3458fcd4e12e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:50.586551 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1343/2680] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:35:50 2022] DELETE /identity/v3/projects/de406c5600e64bac8ca23f958b70d280 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:35:50.600338 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e0ff62-bc3a-4316-b5ba-3458fcd4e12e admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:50.600338 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-25e0ff62-bc3a-4316-b5ba-3458fcd4e12e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:50.627316 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1338/2681] 10.222.0.24 () {58 vars in 1009 bytes} [Thu Apr 7 06:35:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:35:50.641414 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c406d45-98e6-43c3-9e2d-635388e8d1d6 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:50.643991 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-1c406d45-98e6-43c3-9e2d-635388e8d1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:50.678244 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e0ff62-bc3a-4316-b5ba-3458fcd4e12e admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:50.730111 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c406d45-98e6-43c3-9e2d-635388e8d1d6 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:50.737128 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f7893-0b22-43ba-960d-89d84af2fa35 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4abbb8c5324b7babd69e3b4473b3e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:50.737807 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f7893-0b22-43ba-960d-89d84af2fa35 service swift] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:50.738100 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f7893-0b22-43ba-960d-89d84af2fa35 service swift] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:50.738512 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f7893-0b22-43ba-960d-89d84af2fa35 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:50.748523 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8f7893-0b22-43ba-960d-89d84af2fa35 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:50.750173 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8f7893-0b22-43ba-960d-89d84af2fa35 service swift] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:50.750636 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c282a-db53-4ea2-a8b1-01c06d2034bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:50.751440 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c282a-db53-4ea2-a8b1-01c06d2034bd admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:50.751915 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c282a-db53-4ea2-a8b1-01c06d2034bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:50.752294 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c282a-db53-4ea2-a8b1-01c06d2034bd admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:50.753124 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c282a-db53-4ea2-a8b1-01c06d2034bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:50.755913 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c282a-db53-4ea2-a8b1-01c06d2034bd admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:50.759875 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1339/2682] 10.222.0.24 () {60 vars in 1384 bytes} [Thu Apr 7 06:35:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 07 06:35:50.763502 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f7893-0b22-43ba-960d-89d84af2fa35 service swift] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:50.765463 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-5f8f7893-0b22-43ba-960d-89d84af2fa35 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:50.782296 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f7893-0b22-43ba-960d-89d84af2fa35 service swift] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:50.788134 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69576b5a-3e74-434d-996b-8b50ae9e039b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:50.789031 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69576b5a-3e74-434d-996b-8b50ae9e039b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:50.789320 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69576b5a-3e74-434d-996b-8b50ae9e039b admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:50.789592 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69576b5a-3e74-434d-996b-8b50ae9e039b admin admin] PATH_INFO: `/v3/users/c1ebae4eee294f3e81f8e9e0cd1c09f9` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:50.790889 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69576b5a-3e74-434d-996b-8b50ae9e039b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1ebae4eee294f3e81f8e9e0cd1c09f9)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:50.793006 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69576b5a-3e74-434d-996b-8b50ae9e039b admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:50.863444 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1344/2683] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:35:50 2022] POST /identity/v3/users => generated 292 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:35:50.868576 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c282a-db53-4ea2-a8b1-01c06d2034bd admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:50.878249 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c282a-db53-4ea2-a8b1-01c06d2034bd admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:50.882858 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68dc52-7128-4287-867e-4ccb5652caa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:50.883502 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68dc52-7128-4287-867e-4ccb5652caa5 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:50.883820 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68dc52-7128-4287-867e-4ccb5652caa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:50.884107 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68dc52-7128-4287-867e-4ccb5652caa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:50.886849 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a68dc52-7128-4287-867e-4ccb5652caa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:50.888470 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a68dc52-7128-4287-867e-4ccb5652caa5 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:50.898844 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1345/2684] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:35:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 07 06:35:50.902555 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68dc52-7128-4287-867e-4ccb5652caa5 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:50.913221 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68dc52-7128-4287-867e-4ccb5652caa5 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:50.917826 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dfc2b3-71a6-4b78-a569-3e3f1432014c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:50.918468 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dfc2b3-71a6-4b78-a569-3e3f1432014c admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:50.918749 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dfc2b3-71a6-4b78-a569-3e3f1432014c admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:50.919032 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dfc2b3-71a6-4b78-a569-3e3f1432014c admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:50.919731 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dfc2b3-71a6-4b78-a569-3e3f1432014c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:50.921326 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dfc2b3-71a6-4b78-a569-3e3f1432014c admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:50.931506 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1346/2685] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:35:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 07 06:35:50.935417 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dfc2b3-71a6-4b78-a569-3e3f1432014c admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:50.944595 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dfc2b3-71a6-4b78-a569-3e3f1432014c admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:50.949125 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b30fa98-479d-4ae0-a119-c84133ac5de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:50.949980 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b30fa98-479d-4ae0-a119-c84133ac5de5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:50.950260 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b30fa98-479d-4ae0-a119-c84133ac5de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:50.950534 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b30fa98-479d-4ae0-a119-c84133ac5de5 admin admin] PATH_INFO: `/v3/projects/d28e673ec617499faef936b5a9ec12e7/users/a1acbf00a3274ec8866e44fe8884b0ce/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:50.964292 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b30fa98-479d-4ae0-a119-c84133ac5de5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d28e673ec617499faef936b5a9ec12e7, user_id=a1acbf00a3274ec8866e44fe8884b0ce, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:50.966937 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b30fa98-479d-4ae0-a119-c84133ac5de5 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:50.982337 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-69576b5a-3e74-434d-996b-8b50ae9e039b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1ebae4eee294f3e81f8e9e0cd1c09f9'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:50.983044 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-69576b5a-3e74-434d-996b-8b50ae9e039b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1ebae4eee294f3e81f8e9e0cd1c09f9'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:51.059311 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1347/2686] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:35:50 2022] PUT /identity/v3/projects/d28e673ec617499faef936b5a9ec12e7/users/a1acbf00a3274ec8866e44fe8884b0ce/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:35:51.069518 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9034e-9195-4b87-9ab6-e31b734de290 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:51.069811 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9034e-9195-4b87-9ab6-e31b734de290 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:51.070092 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9034e-9195-4b87-9ab6-e31b734de290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:51.075863 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-69576b5a-3e74-434d-996b-8b50ae9e039b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1ebae4eee294f3e81f8e9e0cd1c09f9'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:51.076547 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-69576b5a-3e74-434d-996b-8b50ae9e039b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1ebae4eee294f3e81f8e9e0cd1c09f9'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:51.089740 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-69576b5a-3e74-434d-996b-8b50ae9e039b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1ebae4eee294f3e81f8e9e0cd1c09f9'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:51.095612 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-2ad9034e-9195-4b87-9ab6-e31b734de290 None None] MFA Rules not processed for user `a1acbf00a3274ec8866e44fe8884b0ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:35:51.096851 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-2ad9034e-9195-4b87-9ab6-e31b734de290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:51.102374 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1340/2687] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:35:50 2022] DELETE /identity/v3/users/c1ebae4eee294f3e81f8e9e0cd1c09f9 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:35:51.106640 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8763b39-7b9b-47d0-bbd7-1b4ab415cc6f None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:51.106926 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8763b39-7b9b-47d0-bbd7-1b4ab415cc6f None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:51.107197 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8763b39-7b9b-47d0-bbd7-1b4ab415cc6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:51.123538 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-a8763b39-7b9b-47d0-bbd7-1b4ab415cc6f None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:35:51.124746 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a8763b39-7b9b-47d0-bbd7-1b4ab415cc6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:51.163654 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1348/2688] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:35:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:35:51.167883 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad9034e-9195-4b87-9ab6-e31b734de290 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:51.170093 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-2ad9034e-9195-4b87-9ab6-e31b734de290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:51.190841 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1341/2689] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:35:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:35:51.200239 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8763b39-7b9b-47d0-bbd7-1b4ab415cc6f None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:51.202044 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a8763b39-7b9b-47d0-bbd7-1b4ab415cc6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:51.254251 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad9034e-9195-4b87-9ab6-e31b734de290 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:51.259634 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8429837a-40c9-4b25-bc4a-22bd8f059b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:51.260389 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429837a-40c9-4b25-bc4a-22bd8f059b23 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:51.260739 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429837a-40c9-4b25-bc4a-22bd8f059b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:51.261080 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429837a-40c9-4b25-bc4a-22bd8f059b23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:51.261839 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8429837a-40c9-4b25-bc4a-22bd8f059b23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:51.262743 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8763b39-7b9b-47d0-bbd7-1b4ab415cc6f None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:51.264007 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8429837a-40c9-4b25-bc4a-22bd8f059b23 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:51.266466 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71279646-36c8-4961-97bb-5d7aecaf5024 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:51.267120 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71279646-36c8-4961-97bb-5d7aecaf5024 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:51.267408 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71279646-36c8-4961-97bb-5d7aecaf5024 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:51.267686 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71279646-36c8-4961-97bb-5d7aecaf5024 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:51.278222 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71279646-36c8-4961-97bb-5d7aecaf5024 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:51.279843 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71279646-36c8-4961-97bb-5d7aecaf5024 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:51.292369 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1342/2690] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:35:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 07 06:35:51.379127 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1349/2691] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:35:51 2022] POST /identity/v3/projects => generated 381 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:35:51.379451 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71279646-36c8-4961-97bb-5d7aecaf5024 service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:51.384325 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d9549-732f-4a15-a54d-9626b6c779bc None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:51.384619 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d9549-732f-4a15-a54d-9626b6c779bc None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:51.384910 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d9549-732f-4a15-a54d-9626b6c779bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:51.389388 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71279646-36c8-4961-97bb-5d7aecaf5024 service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:51.403012 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-793d9549-732f-4a15-a54d-9626b6c779bc None None] MFA Rules not processed for user `f4435fb14c3844728531af63993f78c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:35:51.405144 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-793d9549-732f-4a15-a54d-9626b6c779bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:51.445654 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d8ef1-5533-4982-8d6f-fe2f0e7bfa52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:51.446280 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d8ef1-5533-4982-8d6f-fe2f0e7bfa52 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:51.446566 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d8ef1-5533-4982-8d6f-fe2f0e7bfa52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:51.446842 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d8ef1-5533-4982-8d6f-fe2f0e7bfa52 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:51.447585 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326d8ef1-5533-4982-8d6f-fe2f0e7bfa52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:51.449563 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326d8ef1-5533-4982-8d6f-fe2f0e7bfa52 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:51.459076 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1350/2692] 10.222.0.24 () {58 vars in 967 bytes} [Thu Apr 7 06:35:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:35:51.471789 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793d9549-732f-4a15-a54d-9626b6c779bc None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:51.473213 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-793d9549-732f-4a15-a54d-9626b6c779bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:51.544674 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793d9549-732f-4a15-a54d-9626b6c779bc None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:51.549825 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f704b9-4330-4198-92ca-4361008eff20 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4abbb8c5324b7babd69e3b4473b3e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:51.550480 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f704b9-4330-4198-92ca-4361008eff20 service swift] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:51.550771 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f704b9-4330-4198-92ca-4361008eff20 service swift] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:51.551050 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f704b9-4330-4198-92ca-4361008eff20 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:51.560539 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1343/2693] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:35:51 2022] POST /identity/v3/users => generated 297 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:35:51.566779 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f704b9-4330-4198-92ca-4361008eff20 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:51.566938 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d8ef1-5533-4982-8d6f-fe2f0e7bfa52 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:51.567052 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f704b9-4330-4198-92ca-4361008eff20 service swift] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:51.572101 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1351/2694] 10.222.0.24 () {60 vars in 1384 bytes} [Thu Apr 7 06:35:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 07 06:35:51.573209 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d8ef1-5533-4982-8d6f-fe2f0e7bfa52 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:51.578453 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10440171-40b1-409d-8f8b-f8a327b177d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:51.579203 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10440171-40b1-409d-8f8b-f8a327b177d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:51.579564 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10440171-40b1-409d-8f8b-f8a327b177d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:51.579944 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10440171-40b1-409d-8f8b-f8a327b177d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:51.580771 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10440171-40b1-409d-8f8b-f8a327b177d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:51.582879 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10440171-40b1-409d-8f8b-f8a327b177d0 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:51.594304 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1344/2695] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:35:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 07 06:35:51.598474 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f704b9-4330-4198-92ca-4361008eff20 service swift] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:51.609236 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f704b9-4330-4198-92ca-4361008eff20 service swift] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:51.613930 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0cd4e4-faaa-4cd5-875e-5a8039b354d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:51.618385 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0cd4e4-faaa-4cd5-875e-5a8039b354d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:51.618385 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0cd4e4-faaa-4cd5-875e-5a8039b354d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:51.618385 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0cd4e4-faaa-4cd5-875e-5a8039b354d0 admin admin] PATH_INFO: `/v3/projects/19645f859fcf45f180ef8258f8595314/users/55ae585c2a794bf4908cdb5c2cca922c/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:51.631232 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0cd4e4-faaa-4cd5-875e-5a8039b354d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19645f859fcf45f180ef8258f8595314, user_id=55ae585c2a794bf4908cdb5c2cca922c, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:51.634141 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0cd4e4-faaa-4cd5-875e-5a8039b354d0 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:51.694607 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10440171-40b1-409d-8f8b-f8a327b177d0 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:51.696479 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-10440171-40b1-409d-8f8b-f8a327b177d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:51.710049 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10440171-40b1-409d-8f8b-f8a327b177d0 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:51.712060 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1352/2696] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:35:51 2022] PUT /identity/v3/projects/19645f859fcf45f180ef8258f8595314/users/55ae585c2a794bf4908cdb5c2cca922c/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:35:51.717936 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0cd4e4-faaa-4cd5-875e-5a8039b354d0 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:51.769317 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f81a3d-f6af-4176-adf3-8fa4ddb8187d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:51.770195 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f81a3d-f6af-4176-adf3-8fa4ddb8187d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:51.771726 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f81a3d-f6af-4176-adf3-8fa4ddb8187d admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:51.771883 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f81a3d-f6af-4176-adf3-8fa4ddb8187d admin admin] PATH_INFO: `/v3/projects/2fe2f83523034bb1af1533a61411028a` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:51.773093 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f81a3d-f6af-4176-adf3-8fa4ddb8187d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fe2f83523034bb1af1533a61411028a)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:51.775104 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f81a3d-f6af-4176-adf3-8fa4ddb8187d admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:51.779244 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0cd4e4-faaa-4cd5-875e-5a8039b354d0 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:51.784774 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ade19ed-23a4-40c6-a23e-90c3896d4f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:51.784774 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade19ed-23a4-40c6-a23e-90c3896d4f26 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:51.785063 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade19ed-23a4-40c6-a23e-90c3896d4f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:51.785293 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade19ed-23a4-40c6-a23e-90c3896d4f26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:51.786056 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ade19ed-23a4-40c6-a23e-90c3896d4f26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:51.787669 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ade19ed-23a4-40c6-a23e-90c3896d4f26 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:51.797811 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1353/2697] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:35:51 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 07 06:35:51.801786 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ade19ed-23a4-40c6-a23e-90c3896d4f26 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:51.812071 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ade19ed-23a4-40c6-a23e-90c3896d4f26 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:51.816880 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab7afdb-4341-4284-8850-b6e48a4d16a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:51.817748 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab7afdb-4341-4284-8850-b6e48a4d16a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:51.818551 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab7afdb-4341-4284-8850-b6e48a4d16a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:51.818826 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab7afdb-4341-4284-8850-b6e48a4d16a7 admin admin] PATH_INFO: `/v3/projects/19645f859fcf45f180ef8258f8595314/users/55ae585c2a794bf4908cdb5c2cca922c/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:51.820810 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab7afdb-4341-4284-8850-b6e48a4d16a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19645f859fcf45f180ef8258f8595314, user_id=55ae585c2a794bf4908cdb5c2cca922c, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:51.823539 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab7afdb-4341-4284-8850-b6e48a4d16a7 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:51.833417 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1354/2698] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:35:51 2022] PUT /identity/v3/projects/19645f859fcf45f180ef8258f8595314/users/55ae585c2a794bf4908cdb5c2cca922c/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:35:51.844124 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f80176-6962-43d2-8e33-4b9bec7070f1 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:51.844435 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f80176-6962-43d2-8e33-4b9bec7070f1 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:51.844709 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f80176-6962-43d2-8e33-4b9bec7070f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:51.871510 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-27f80176-6962-43d2-8e33-4b9bec7070f1 None None] MFA Rules not processed for user `55ae585c2a794bf4908cdb5c2cca922c`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:35:51.872930 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-27f80176-6962-43d2-8e33-4b9bec7070f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:51.881938 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-51f81a3d-f6af-4176-adf3-8fa4ddb8187d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fe2f83523034bb1af1533a61411028a', 'request_id': 'req-51f81a3d-f6af-4176-adf3-8fa4ddb8187d'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:51.887403 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-51f81a3d-f6af-4176-adf3-8fa4ddb8187d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fe2f83523034bb1af1533a61411028a', 'request_id': 'req-51f81a3d-f6af-4176-adf3-8fa4ddb8187d'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:51.952840 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1355/2699] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:35:51 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:35:51.961505 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-51f81a3d-f6af-4176-adf3-8fa4ddb8187d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fe2f83523034bb1af1533a61411028a', 'request_id': 'req-51f81a3d-f6af-4176-adf3-8fa4ddb8187d'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:51.963960 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f80176-6962-43d2-8e33-4b9bec7070f1 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:51.965487 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-27f80176-6962-43d2-8e33-4b9bec7070f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:51.973958 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-51f81a3d-f6af-4176-adf3-8fa4ddb8187d admin admin] The token cache is being invalidate because project 2fe2f83523034bb1af1533a61411028a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:35:51.974336 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-51f81a3d-f6af-4176-adf3-8fa4ddb8187d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:51.975349 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-51f81a3d-f6af-4176-adf3-8fa4ddb8187d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:51.977196 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1345/2700] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:35:51 2022] DELETE /identity/v3/projects/2fe2f83523034bb1af1533a61411028a => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:35:51.983456 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e4f71-e815-49e6-aaca-62f7534c609a None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:51.983862 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e4f71-e815-49e6-aaca-62f7534c609a None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:51.984143 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e4f71-e815-49e6-aaca-62f7534c609a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:52.003167 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-658e4f71-e815-49e6-aaca-62f7534c609a None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:35:52.004449 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-658e4f71-e815-49e6-aaca-62f7534c609a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:52.038637 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f80176-6962-43d2-8e33-4b9bec7070f1 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:52.042849 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab4319-a31a-45bb-9e35-6753ebc0e901 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:52.043502 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab4319-a31a-45bb-9e35-6753ebc0e901 service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:52.046390 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab4319-a31a-45bb-9e35-6753ebc0e901 service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:52.046390 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab4319-a31a-45bb-9e35-6753ebc0e901 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:52.048777 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-6dab4319-a31a-45bb-9e35-6753ebc0e901 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:52.064929 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dab4319-a31a-45bb-9e35-6753ebc0e901 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:52.066527 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dab4319-a31a-45bb-9e35-6753ebc0e901 service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:52.071704 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1346/2701] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:35:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:35:52.077973 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1356/2702] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:35:51 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:35:52.081965 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c7150-0868-4cd4-a0cd-cd5a56f68df3 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:52.082256 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c7150-0868-4cd4-a0cd-cd5a56f68df3 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:52.082537 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c7150-0868-4cd4-a0cd-cd5a56f68df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:52.105038 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-be1c7150-0868-4cd4-a0cd-cd5a56f68df3 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:35:52.106237 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-be1c7150-0868-4cd4-a0cd-cd5a56f68df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:52.115956 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1347/2703] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:35:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:35:52.121069 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab4319-a31a-45bb-9e35-6753ebc0e901 service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:52.132762 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab4319-a31a-45bb-9e35-6753ebc0e901 service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:52.137689 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c79c3c6-ad04-4741-a4af-0088dedcfeae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:52.138460 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c79c3c6-ad04-4741-a4af-0088dedcfeae admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:52.138869 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c79c3c6-ad04-4741-a4af-0088dedcfeae admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:52.139215 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c79c3c6-ad04-4741-a4af-0088dedcfeae admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:52.140210 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c79c3c6-ad04-4741-a4af-0088dedcfeae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:35:52.140597 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c79c3c6-ad04-4741-a4af-0088dedcfeae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:52.142274 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c79c3c6-ad04-4741-a4af-0088dedcfeae admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:52.161050 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1357/2704] 10.222.0.24 () {58 vars in 1152 bytes} [Thu Apr 7 06:35:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:35:52.165739 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1c7150-0868-4cd4-a0cd-cd5a56f68df3 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:52.180492 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1c7150-0868-4cd4-a0cd-cd5a56f68df3 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:52.195320 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e8f31-cc9b-412b-a934-eae42696ff3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:52.195320 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e8f31-cc9b-412b-a934-eae42696ff3f admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:52.195320 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e8f31-cc9b-412b-a934-eae42696ff3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:52.195320 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e8f31-cc9b-412b-a934-eae42696ff3f admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:52.195736 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e8f31-cc9b-412b-a934-eae42696ff3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:52.195864 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c79c3c6-ad04-4741-a4af-0088dedcfeae admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:52.195973 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e8f31-cc9b-412b-a934-eae42696ff3f admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:52.196067 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-1c79c3c6-ad04-4741-a4af-0088dedcfeae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:52.203200 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c79c3c6-ad04-4741-a4af-0088dedcfeae admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:52.206812 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882df789-6119-46b7-8cc8-018bb6035d2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:52.207463 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882df789-6119-46b7-8cc8-018bb6035d2e service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:52.208081 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882df789-6119-46b7-8cc8-018bb6035d2e service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:52.208081 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882df789-6119-46b7-8cc8-018bb6035d2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:52.210362 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-882df789-6119-46b7-8cc8-018bb6035d2e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:52.268011 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882df789-6119-46b7-8cc8-018bb6035d2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:52.269536 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882df789-6119-46b7-8cc8-018bb6035d2e service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:52.279597 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1358/2705] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:35:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 07 06:35:52.295911 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1348/2706] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:35:52 2022] POST /identity/v3/projects => generated 383 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:35:52.300003 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882df789-6119-46b7-8cc8-018bb6035d2e service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:52.311140 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882df789-6119-46b7-8cc8-018bb6035d2e service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:52.370994 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595f9e9-f9ed-44d3-98a9-07a529ef8124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:52.371918 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595f9e9-f9ed-44d3-98a9-07a529ef8124 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:52.372392 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595f9e9-f9ed-44d3-98a9-07a529ef8124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:52.372674 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595f9e9-f9ed-44d3-98a9-07a529ef8124 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:52.373366 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8595f9e9-f9ed-44d3-98a9-07a529ef8124 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:52.375477 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8595f9e9-f9ed-44d3-98a9-07a529ef8124 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:52.487511 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1359/2707] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:35:52 2022] POST /identity/v3/users => generated 292 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:35:52.492038 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e8f31-cc9b-412b-a934-eae42696ff3f admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:52.502207 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e8f31-cc9b-412b-a934-eae42696ff3f admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:52.507658 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef08a7e1-b979-4941-9ac5-cd42780927e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:52.508439 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08a7e1-b979-4941-9ac5-cd42780927e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:52.508718 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08a7e1-b979-4941-9ac5-cd42780927e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:52.508991 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08a7e1-b979-4941-9ac5-cd42780927e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:52.509721 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef08a7e1-b979-4941-9ac5-cd42780927e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:52.511334 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef08a7e1-b979-4941-9ac5-cd42780927e6 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:52.523709 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1349/2708] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:35:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:35:52.527771 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595f9e9-f9ed-44d3-98a9-07a529ef8124 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:52.537928 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595f9e9-f9ed-44d3-98a9-07a529ef8124 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:52.542702 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f4fc3-c950-49de-afa9-a02fe5628fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:52.543391 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f4fc3-c950-49de-afa9-a02fe5628fa7 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:52.543676 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f4fc3-c950-49de-afa9-a02fe5628fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:52.543990 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f4fc3-c950-49de-afa9-a02fe5628fa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:52.544829 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0f4fc3-c950-49de-afa9-a02fe5628fa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:52.546287 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0f4fc3-c950-49de-afa9-a02fe5628fa7 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:52.556588 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1360/2709] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:35:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 07 06:35:52.560612 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef08a7e1-b979-4941-9ac5-cd42780927e6 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:52.571073 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef08a7e1-b979-4941-9ac5-cd42780927e6 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:52.575986 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cecf04f-5772-4296-aa8a-c24f36006e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:52.576946 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cecf04f-5772-4296-aa8a-c24f36006e2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:52.577234 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cecf04f-5772-4296-aa8a-c24f36006e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:52.577529 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cecf04f-5772-4296-aa8a-c24f36006e2a admin admin] PATH_INFO: `/v3/projects/5eb519405b74446698000066d47e0525/users/c2e3424032964bcf92ac4afaf7c073c9/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:52.592491 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cecf04f-5772-4296-aa8a-c24f36006e2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eb519405b74446698000066d47e0525, user_id=c2e3424032964bcf92ac4afaf7c073c9, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:52.595129 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cecf04f-5772-4296-aa8a-c24f36006e2a admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:52.756336 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1350/2710] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:35:52 2022] PUT /identity/v3/projects/5eb519405b74446698000066d47e0525/users/c2e3424032964bcf92ac4afaf7c073c9/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:35:52.774640 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514ed79-a4bd-421a-a4ba-1b1244a8a792 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:52.774936 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514ed79-a4bd-421a-a4ba-1b1244a8a792 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:52.775218 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514ed79-a4bd-421a-a4ba-1b1244a8a792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:52.807887 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-6514ed79-a4bd-421a-a4ba-1b1244a8a792 None None] MFA Rules not processed for user `c2e3424032964bcf92ac4afaf7c073c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:35:52.809489 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-6514ed79-a4bd-421a-a4ba-1b1244a8a792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:52.886830 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1361/2711] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:35:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:35:52.892399 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cecf04f-5772-4296-aa8a-c24f36006e2a admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:52.956605 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cecf04f-5772-4296-aa8a-c24f36006e2a admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:52.961270 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb7985-becc-4d04-a5cf-8e0e8b9897b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:52.961921 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb7985-becc-4d04-a5cf-8e0e8b9897b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:52.962206 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb7985-becc-4d04-a5cf-8e0e8b9897b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:52.962480 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb7985-becc-4d04-a5cf-8e0e8b9897b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:52.963231 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fb7985-becc-4d04-a5cf-8e0e8b9897b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:52.965201 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fb7985-becc-4d04-a5cf-8e0e8b9897b9 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:53.068167 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1351/2712] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:35:52 2022] POST /identity/v3/projects => generated 383 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:35:53.069313 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514ed79-a4bd-421a-a4ba-1b1244a8a792 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:53.080538 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514ed79-a4bd-421a-a4ba-1b1244a8a792 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:53.135568 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec47dd3-ce51-4e52-9c92-f361dcd5c01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:53.136263 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec47dd3-ce51-4e52-9c92-f361dcd5c01c admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:53.136546 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec47dd3-ce51-4e52-9c92-f361dcd5c01c admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:53.136821 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec47dd3-ce51-4e52-9c92-f361dcd5c01c admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:53.137663 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec47dd3-ce51-4e52-9c92-f361dcd5c01c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:53.139559 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec47dd3-ce51-4e52-9c92-f361dcd5c01c admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:53.264178 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1362/2713] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:35:53 2022] POST /identity/v3/users => generated 292 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:35:53.273903 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb7985-becc-4d04-a5cf-8e0e8b9897b9 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:53.284040 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb7985-becc-4d04-a5cf-8e0e8b9897b9 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:53.289247 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0fe1f2-9e48-4317-a8c1-f0fff44906e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:53.289828 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0fe1f2-9e48-4317-a8c1-f0fff44906e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:53.290116 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0fe1f2-9e48-4317-a8c1-f0fff44906e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:53.290396 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0fe1f2-9e48-4317-a8c1-f0fff44906e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:53.291129 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0fe1f2-9e48-4317-a8c1-f0fff44906e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:53.292826 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0fe1f2-9e48-4317-a8c1-f0fff44906e0 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:53.303919 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1352/2714] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:35:53.307713 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec47dd3-ce51-4e52-9c92-f361dcd5c01c admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:53.317933 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec47dd3-ce51-4e52-9c92-f361dcd5c01c admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:53.322780 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d76191d-e8a7-4f05-8bcc-fbe7c43588a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:53.323439 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76191d-e8a7-4f05-8bcc-fbe7c43588a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:53.323729 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76191d-e8a7-4f05-8bcc-fbe7c43588a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:53.324047 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76191d-e8a7-4f05-8bcc-fbe7c43588a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:53.324777 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d76191d-e8a7-4f05-8bcc-fbe7c43588a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:53.326411 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d76191d-e8a7-4f05-8bcc-fbe7c43588a7 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:53.336603 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1363/2715] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:35:53.340542 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0fe1f2-9e48-4317-a8c1-f0fff44906e0 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:53.350760 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0fe1f2-9e48-4317-a8c1-f0fff44906e0 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:53.355303 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a30d99f-e2ad-4239-b125-8b76d68f8a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:53.356222 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30d99f-e2ad-4239-b125-8b76d68f8a29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:53.356513 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30d99f-e2ad-4239-b125-8b76d68f8a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:53.356792 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30d99f-e2ad-4239-b125-8b76d68f8a29 admin admin] PATH_INFO: `/v3/projects/5bf37cdffe984c298b63bb90b7d30806/users/c8a885a8ffcd4cc79d53fc3641789b03/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:53.371634 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a30d99f-e2ad-4239-b125-8b76d68f8a29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bf37cdffe984c298b63bb90b7d30806, user_id=c8a885a8ffcd4cc79d53fc3641789b03, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:53.374397 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a30d99f-e2ad-4239-b125-8b76d68f8a29 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:53.458416 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1353/2716] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:35:53 2022] PUT /identity/v3/projects/5bf37cdffe984c298b63bb90b7d30806/users/c8a885a8ffcd4cc79d53fc3641789b03/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:35:53.469151 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec01a1f-a099-4647-8c3f-7e4b007242bf None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:53.469441 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec01a1f-a099-4647-8c3f-7e4b007242bf None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:53.469740 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec01a1f-a099-4647-8c3f-7e4b007242bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:53.501558 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-0ec01a1f-a099-4647-8c3f-7e4b007242bf None None] MFA Rules not processed for user `c8a885a8ffcd4cc79d53fc3641789b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:35:53.502778 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-0ec01a1f-a099-4647-8c3f-7e4b007242bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:53.564893 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1364/2717] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:35:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:35:53.569313 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a30d99f-e2ad-4239-b125-8b76d68f8a29 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:53.629238 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a30d99f-e2ad-4239-b125-8b76d68f8a29 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:53.633964 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f478272-dcc6-4a88-b099-9155d4dbb366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:53.634616 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f478272-dcc6-4a88-b099-9155d4dbb366 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:53.634904 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f478272-dcc6-4a88-b099-9155d4dbb366 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:53.635179 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f478272-dcc6-4a88-b099-9155d4dbb366 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:53.635905 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f478272-dcc6-4a88-b099-9155d4dbb366 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:53.637833 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f478272-dcc6-4a88-b099-9155d4dbb366 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:53.733142 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1354/2718] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:35:53 2022] POST /identity/v3/projects => generated 383 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:35:53.737425 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec01a1f-a099-4647-8c3f-7e4b007242bf None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:53.748488 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec01a1f-a099-4647-8c3f-7e4b007242bf None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:53.806648 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d060616-892c-4fea-81f0-402309e90d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:53.807321 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d060616-892c-4fea-81f0-402309e90d79 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:53.807608 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d060616-892c-4fea-81f0-402309e90d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:53.807921 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d060616-892c-4fea-81f0-402309e90d79 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:53.808602 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d060616-892c-4fea-81f0-402309e90d79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:53.810506 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d060616-892c-4fea-81f0-402309e90d79 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:53.908389 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1365/2719] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:35:53 2022] POST /identity/v3/users => generated 298 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:35:53.912409 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f478272-dcc6-4a88-b099-9155d4dbb366 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:53.922458 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f478272-dcc6-4a88-b099-9155d4dbb366 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:53.927071 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ebd70-9aca-4089-be19-f7702d35b7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:53.927812 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ebd70-9aca-4089-be19-f7702d35b7ad admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:53.928101 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ebd70-9aca-4089-be19-f7702d35b7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:53.928381 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ebd70-9aca-4089-be19-f7702d35b7ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:53.929104 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ebd70-9aca-4089-be19-f7702d35b7ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:53.930737 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ebd70-9aca-4089-be19-f7702d35b7ad admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:53.941201 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1355/2720] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:35:53.945991 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d060616-892c-4fea-81f0-402309e90d79 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:53.956085 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d060616-892c-4fea-81f0-402309e90d79 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:53.961263 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17534d1-df5f-4417-a7b8-438be2a028e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:53.962130 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17534d1-df5f-4417-a7b8-438be2a028e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:53.962412 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17534d1-df5f-4417-a7b8-438be2a028e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:53.962684 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17534d1-df5f-4417-a7b8-438be2a028e4 admin admin] PATH_INFO: `/v3/projects/bf68de8606ef407caf277779465c9333/users/118d7822cc554e50a55a4b790ddab888/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:53.976702 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17534d1-df5f-4417-a7b8-438be2a028e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf68de8606ef407caf277779465c9333, user_id=118d7822cc554e50a55a4b790ddab888, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:53.979317 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17534d1-df5f-4417-a7b8-438be2a028e4 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:54.104059 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1366/2721] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:35:53 2022] PUT /identity/v3/projects/bf68de8606ef407caf277779465c9333/users/118d7822cc554e50a55a4b790ddab888/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:35:54.107994 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ebd70-9aca-4089-be19-f7702d35b7ad admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:54.118393 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ebd70-9aca-4089-be19-f7702d35b7ad admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:54.172512 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a81b0-3c46-4a1b-a847-f73b567f4446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:54.173185 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a81b0-3c46-4a1b-a847-f73b567f4446 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:54.173472 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a81b0-3c46-4a1b-a847-f73b567f4446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:54.173748 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a81b0-3c46-4a1b-a847-f73b567f4446 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:54.174469 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691a81b0-3c46-4a1b-a847-f73b567f4446 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:54.176199 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691a81b0-3c46-4a1b-a847-f73b567f4446 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:54.189448 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1356/2722] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:35:54.190464 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17534d1-df5f-4417-a7b8-438be2a028e4 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:54.201617 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17534d1-df5f-4417-a7b8-438be2a028e4 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:54.206498 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c796017c-ca52-4b68-b40e-e92976746269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:54.207386 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796017c-ca52-4b68-b40e-e92976746269 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:54.207697 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796017c-ca52-4b68-b40e-e92976746269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:54.207999 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796017c-ca52-4b68-b40e-e92976746269 admin admin] PATH_INFO: `/v3/projects/bf68de8606ef407caf277779465c9333/users/118d7822cc554e50a55a4b790ddab888/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:54.210019 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c796017c-ca52-4b68-b40e-e92976746269 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf68de8606ef407caf277779465c9333, user_id=118d7822cc554e50a55a4b790ddab888, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:54.212746 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c796017c-ca52-4b68-b40e-e92976746269 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:54.223844 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1367/2723] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:35:54 2022] PUT /identity/v3/projects/bf68de8606ef407caf277779465c9333/users/118d7822cc554e50a55a4b790ddab888/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:35:54.233974 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86475c1-a566-498f-be68-9c6fd21c3fb9 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:54.234269 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86475c1-a566-498f-be68-9c6fd21c3fb9 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:54.234548 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86475c1-a566-498f-be68-9c6fd21c3fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:54.264517 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-d86475c1-a566-498f-be68-9c6fd21c3fb9 None None] MFA Rules not processed for user `118d7822cc554e50a55a4b790ddab888`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:35:54.265721 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d86475c1-a566-498f-be68-9c6fd21c3fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:54.268108 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c796017c-ca52-4b68-b40e-e92976746269 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:54.270272 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c796017c-ca52-4b68-b40e-e92976746269 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:54.332018 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1357/2724] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:35:54 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:35:54.335026 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c796017c-ca52-4b68-b40e-e92976746269 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:54.339687 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a97a0f-b0f8-4c62-a77e-8cd43cb73b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:54.340594 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a97a0f-b0f8-4c62-a77e-8cd43cb73b28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:54.340876 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a97a0f-b0f8-4c62-a77e-8cd43cb73b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:54.341152 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a97a0f-b0f8-4c62-a77e-8cd43cb73b28 admin admin] PATH_INFO: `/v3/users/e2d08dc831cf4e8f8b55061799a5d8e4` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:54.342348 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a97a0f-b0f8-4c62-a77e-8cd43cb73b28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2d08dc831cf4e8f8b55061799a5d8e4)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:54.344008 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86475c1-a566-498f-be68-9c6fd21c3fb9 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:54.344521 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a97a0f-b0f8-4c62-a77e-8cd43cb73b28 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:54.397942 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86475c1-a566-498f-be68-9c6fd21c3fb9 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:54.401595 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fcc9ca-1ab4-4a1b-95b6-7e83b3a01789 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:54.402288 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fcc9ca-1ab4-4a1b-95b6-7e83b3a01789 service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:54.402572 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fcc9ca-1ab4-4a1b-95b6-7e83b3a01789 service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:54.402862 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fcc9ca-1ab4-4a1b-95b6-7e83b3a01789 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:54.457571 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fcc9ca-1ab4-4a1b-95b6-7e83b3a01789 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:54.459023 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fcc9ca-1ab4-4a1b-95b6-7e83b3a01789 service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:54.467911 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1358/2725] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:35:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 07 06:35:54.585688 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-48a97a0f-b0f8-4c62-a77e-8cd43cb73b28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2d08dc831cf4e8f8b55061799a5d8e4'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:54.597253 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-48a97a0f-b0f8-4c62-a77e-8cd43cb73b28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2d08dc831cf4e8f8b55061799a5d8e4'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:54.680827 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-48a97a0f-b0f8-4c62-a77e-8cd43cb73b28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2d08dc831cf4e8f8b55061799a5d8e4'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:54.681443 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-48a97a0f-b0f8-4c62-a77e-8cd43cb73b28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2d08dc831cf4e8f8b55061799a5d8e4'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:54.682045 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-48a97a0f-b0f8-4c62-a77e-8cd43cb73b28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2d08dc831cf4e8f8b55061799a5d8e4'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:54.694499 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1368/2726] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:35:54 2022] DELETE /identity/v3/users/e2d08dc831cf4e8f8b55061799a5d8e4 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:35:54.699328 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c89d37-24b2-441d-b701-f54d738f8584 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:54.699620 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c89d37-24b2-441d-b701-f54d738f8584 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:54.699927 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c89d37-24b2-441d-b701-f54d738f8584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:54.717317 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-37c89d37-24b2-441d-b701-f54d738f8584 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:35:54.717496 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-37c89d37-24b2-441d-b701-f54d738f8584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:54.775935 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1359/2727] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:35:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:35:54.785739 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a97a0f-b0f8-4c62-a77e-8cd43cb73b28 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:54.787665 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-48a97a0f-b0f8-4c62-a77e-8cd43cb73b28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:54.843391 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a97a0f-b0f8-4c62-a77e-8cd43cb73b28 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:54.847058 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46033df-5a96-4590-b684-eea1047f8f4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:54.847709 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46033df-5a96-4590-b684-eea1047f8f4c service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:54.848029 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46033df-5a96-4590-b684-eea1047f8f4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:54.848309 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46033df-5a96-4590-b684-eea1047f8f4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:54.857872 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46033df-5a96-4590-b684-eea1047f8f4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:54.859288 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46033df-5a96-4590-b684-eea1047f8f4c service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:54.869345 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1369/2728] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:35:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:35:55.123983 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c89d37-24b2-441d-b701-f54d738f8584 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:55.123983 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-37c89d37-24b2-441d-b701-f54d738f8584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:55.139525 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c89d37-24b2-441d-b701-f54d738f8584 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:55.145092 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb16acc-bf01-4219-9461-d9e33cb8cc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:55.146537 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb16acc-bf01-4219-9461-d9e33cb8cc04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:55.146827 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb16acc-bf01-4219-9461-d9e33cb8cc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:55.147038 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb16acc-bf01-4219-9461-d9e33cb8cc04 admin admin] PATH_INFO: `/v3/projects/d64b8dfa4dd84e508cf00877bb731d5d` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:55.148309 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb16acc-bf01-4219-9461-d9e33cb8cc04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d64b8dfa4dd84e508cf00877bb731d5d)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:55.150394 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb16acc-bf01-4219-9461-d9e33cb8cc04 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:55.314658 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-6eb16acc-bf01-4219-9461-d9e33cb8cc04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd64b8dfa4dd84e508cf00877bb731d5d', 'request_id': 'req-6eb16acc-bf01-4219-9461-d9e33cb8cc04'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:55.320352 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-6eb16acc-bf01-4219-9461-d9e33cb8cc04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd64b8dfa4dd84e508cf00877bb731d5d', 'request_id': 'req-6eb16acc-bf01-4219-9461-d9e33cb8cc04'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:55.413235 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-6eb16acc-bf01-4219-9461-d9e33cb8cc04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd64b8dfa4dd84e508cf00877bb731d5d', 'request_id': 'req-6eb16acc-bf01-4219-9461-d9e33cb8cc04'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:55.424449 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-6eb16acc-bf01-4219-9461-d9e33cb8cc04 admin admin] The token cache is being invalidate because project d64b8dfa4dd84e508cf00877bb731d5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:35:55.424740 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-6eb16acc-bf01-4219-9461-d9e33cb8cc04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:55.425374 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-6eb16acc-bf01-4219-9461-d9e33cb8cc04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:55.426896 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1360/2729] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:35:55 2022] DELETE /identity/v3/projects/d64b8dfa4dd84e508cf00877bb731d5d => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:35:55.577517 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46033df-5a96-4590-b684-eea1047f8f4c service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:55.579015 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e46033df-5a96-4590-b684-eea1047f8f4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:55.593757 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46033df-5a96-4590-b684-eea1047f8f4c service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:55.656250 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e2ba1-3c64-4e71-88a8-7f72a10b69d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:55.657131 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e2ba1-3c64-4e71-88a8-7f72a10b69d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:55.657410 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e2ba1-3c64-4e71-88a8-7f72a10b69d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:55.657678 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e2ba1-3c64-4e71-88a8-7f72a10b69d5 admin admin] PATH_INFO: `/v3/users/a1acbf00a3274ec8866e44fe8884b0ce` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:55.658851 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e2ba1-3c64-4e71-88a8-7f72a10b69d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1acbf00a3274ec8866e44fe8884b0ce)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:55.660799 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e2ba1-3c64-4e71-88a8-7f72a10b69d5 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:55.871098 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d23e2ba1-3c64-4e71-88a8-7f72a10b69d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1acbf00a3274ec8866e44fe8884b0ce'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:55.883243 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d23e2ba1-3c64-4e71-88a8-7f72a10b69d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1acbf00a3274ec8866e44fe8884b0ce'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:55.959754 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d23e2ba1-3c64-4e71-88a8-7f72a10b69d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1acbf00a3274ec8866e44fe8884b0ce'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:55.960393 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d23e2ba1-3c64-4e71-88a8-7f72a10b69d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1acbf00a3274ec8866e44fe8884b0ce'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:55.960993 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d23e2ba1-3c64-4e71-88a8-7f72a10b69d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1acbf00a3274ec8866e44fe8884b0ce'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:55.973194 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1370/2730] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:35:55 2022] DELETE /identity/v3/users/a1acbf00a3274ec8866e44fe8884b0ce => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:35:55.978410 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a07d8-4a56-4857-a9b2-39a2ecefac18 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:55.978712 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a07d8-4a56-4857-a9b2-39a2ecefac18 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:55.978988 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a07d8-4a56-4857-a9b2-39a2ecefac18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:55.996921 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-7a1a07d8-4a56-4857-a9b2-39a2ecefac18 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:35:55.998688 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-7a1a07d8-4a56-4857-a9b2-39a2ecefac18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:56.054265 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1361/2731] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:35:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:35:56.063930 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e2ba1-3c64-4e71-88a8-7f72a10b69d5 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:56.065296 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d23e2ba1-3c64-4e71-88a8-7f72a10b69d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:56.122750 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e2ba1-3c64-4e71-88a8-7f72a10b69d5 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:56.126192 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8680680-967f-4858-92cf-b6209cc4cdd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:56.126832 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8680680-967f-4858-92cf-b6209cc4cdd6 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:56.127114 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8680680-967f-4858-92cf-b6209cc4cdd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:56.127388 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8680680-967f-4858-92cf-b6209cc4cdd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:56.136084 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8680680-967f-4858-92cf-b6209cc4cdd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:56.137485 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8680680-967f-4858-92cf-b6209cc4cdd6 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:56.146933 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1371/2732] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:35:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:35:56.524484 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a07d8-4a56-4857-a9b2-39a2ecefac18 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:56.525869 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-7a1a07d8-4a56-4857-a9b2-39a2ecefac18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:56.551083 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8680680-967f-4858-92cf-b6209cc4cdd6 service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:56.552479 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a8680680-967f-4858-92cf-b6209cc4cdd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:56.566934 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8680680-967f-4858-92cf-b6209cc4cdd6 service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:56.572760 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbcee1f-5ca3-4b25-b642-dba7ec99ebb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:56.574249 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbcee1f-5ca3-4b25-b642-dba7ec99ebb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:56.574857 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbcee1f-5ca3-4b25-b642-dba7ec99ebb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:56.575207 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbcee1f-5ca3-4b25-b642-dba7ec99ebb0 admin admin] PATH_INFO: `/v3/projects/d28e673ec617499faef936b5a9ec12e7` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:56.576829 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbcee1f-5ca3-4b25-b642-dba7ec99ebb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d28e673ec617499faef936b5a9ec12e7)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:56.578681 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbcee1f-5ca3-4b25-b642-dba7ec99ebb0 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:56.583151 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a07d8-4a56-4857-a9b2-39a2ecefac18 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:56.587259 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519937af-7dc0-4427-869e-9d84ab351b5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:56.587948 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519937af-7dc0-4427-869e-9d84ab351b5c service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:56.588231 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519937af-7dc0-4427-869e-9d84ab351b5c service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:56.593840 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519937af-7dc0-4427-869e-9d84ab351b5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:56.593840 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-519937af-7dc0-4427-869e-9d84ab351b5c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:56.647238 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519937af-7dc0-4427-869e-9d84ab351b5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:56.648635 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519937af-7dc0-4427-869e-9d84ab351b5c service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:56.657445 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1362/2733] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:35:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:35:56.687128 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3cbcee1f-5ca3-4b25-b642-dba7ec99ebb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd28e673ec617499faef936b5a9ec12e7', 'request_id': 'req-3cbcee1f-5ca3-4b25-b642-dba7ec99ebb0'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:56.693382 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3cbcee1f-5ca3-4b25-b642-dba7ec99ebb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd28e673ec617499faef936b5a9ec12e7', 'request_id': 'req-3cbcee1f-5ca3-4b25-b642-dba7ec99ebb0'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:56.760953 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3cbcee1f-5ca3-4b25-b642-dba7ec99ebb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd28e673ec617499faef936b5a9ec12e7', 'request_id': 'req-3cbcee1f-5ca3-4b25-b642-dba7ec99ebb0'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:56.772550 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3cbcee1f-5ca3-4b25-b642-dba7ec99ebb0 admin admin] The token cache is being invalidate because project d28e673ec617499faef936b5a9ec12e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:35:56.772842 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3cbcee1f-5ca3-4b25-b642-dba7ec99ebb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:56.773485 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3cbcee1f-5ca3-4b25-b642-dba7ec99ebb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:56.775054 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1372/2734] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:35:56 2022] DELETE /identity/v3/projects/d28e673ec617499faef936b5a9ec12e7 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:35:56.778961 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519937af-7dc0-4427-869e-9d84ab351b5c service cinder] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:56.789417 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519937af-7dc0-4427-869e-9d84ab351b5c service cinder] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:56.843657 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cef8f6-8b85-426f-b455-b60fcfdcbd7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:56.844560 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cef8f6-8b85-426f-b455-b60fcfdcbd7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:56.844852 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cef8f6-8b85-426f-b455-b60fcfdcbd7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:56.845131 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cef8f6-8b85-426f-b455-b60fcfdcbd7a admin admin] PATH_INFO: `/v3/users/55ae585c2a794bf4908cdb5c2cca922c` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:56.846329 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cef8f6-8b85-426f-b455-b60fcfdcbd7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=55ae585c2a794bf4908cdb5c2cca922c)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:56.848303 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cef8f6-8b85-426f-b455-b60fcfdcbd7a admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:57.089705 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-90cef8f6-8b85-426f-b455-b60fcfdcbd7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55ae585c2a794bf4908cdb5c2cca922c'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:57.090366 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-90cef8f6-8b85-426f-b455-b60fcfdcbd7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55ae585c2a794bf4908cdb5c2cca922c'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:57.155475 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-90cef8f6-8b85-426f-b455-b60fcfdcbd7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55ae585c2a794bf4908cdb5c2cca922c'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:57.156055 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-90cef8f6-8b85-426f-b455-b60fcfdcbd7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55ae585c2a794bf4908cdb5c2cca922c'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:57.167843 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-90cef8f6-8b85-426f-b455-b60fcfdcbd7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55ae585c2a794bf4908cdb5c2cca922c'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:57.180010 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1363/2735] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:35:56 2022] DELETE /identity/v3/users/55ae585c2a794bf4908cdb5c2cca922c => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:35:57.654143 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbcee1f-5ca3-4b25-b642-dba7ec99ebb0 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:57.655594 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-3cbcee1f-5ca3-4b25-b642-dba7ec99ebb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:57.669389 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbcee1f-5ca3-4b25-b642-dba7ec99ebb0 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:57.725926 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab927e-af7b-4cef-91ec-41e487791cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:57.726780 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab927e-af7b-4cef-91ec-41e487791cdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:57.727059 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab927e-af7b-4cef-91ec-41e487791cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:57.727351 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab927e-af7b-4cef-91ec-41e487791cdf admin admin] PATH_INFO: `/v3/projects/19645f859fcf45f180ef8258f8595314` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:57.728547 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ab927e-af7b-4cef-91ec-41e487791cdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=19645f859fcf45f180ef8258f8595314)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:57.730464 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ab927e-af7b-4cef-91ec-41e487791cdf admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:57.829369 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-53ab927e-af7b-4cef-91ec-41e487791cdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19645f859fcf45f180ef8258f8595314', 'request_id': 'req-53ab927e-af7b-4cef-91ec-41e487791cdf'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:57.835992 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-53ab927e-af7b-4cef-91ec-41e487791cdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19645f859fcf45f180ef8258f8595314', 'request_id': 'req-53ab927e-af7b-4cef-91ec-41e487791cdf'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:57.886847 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-53ab927e-af7b-4cef-91ec-41e487791cdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19645f859fcf45f180ef8258f8595314', 'request_id': 'req-53ab927e-af7b-4cef-91ec-41e487791cdf'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:57.898148 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-53ab927e-af7b-4cef-91ec-41e487791cdf admin admin] The token cache is being invalidate because project 19645f859fcf45f180ef8258f8595314 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:35:57.898441 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-53ab927e-af7b-4cef-91ec-41e487791cdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:57.899071 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-53ab927e-af7b-4cef-91ec-41e487791cdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:35:57.900661 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1373/2736] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:35:57 2022] DELETE /identity/v3/projects/19645f859fcf45f180ef8258f8595314 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:35:57.905526 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3f81c-0798-424c-85e8-7e3651324583 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:57.906009 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3f81c-0798-424c-85e8-7e3651324583 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:57.906122 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3f81c-0798-424c-85e8-7e3651324583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:57.923900 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-b5f3f81c-0798-424c-85e8-7e3651324583 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:35:57.925067 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b5f3f81c-0798-424c-85e8-7e3651324583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:57.984224 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1364/2737] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:35:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:35:57.993207 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b4ce1-a2a1-4afe-a6de-ef70da7bd4b5 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:57.993655 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b4ce1-a2a1-4afe-a6de-ef70da7bd4b5 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:57.993938 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b4ce1-a2a1-4afe-a6de-ef70da7bd4b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:58.012781 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-a51b4ce1-a2a1-4afe-a6de-ef70da7bd4b5 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:35:58.014022 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a51b4ce1-a2a1-4afe-a6de-ef70da7bd4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:58.023591 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1374/2738] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:35:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:35:58.027906 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f3f81c-0798-424c-85e8-7e3651324583 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:58.038017 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f3f81c-0798-424c-85e8-7e3651324583 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:58.042601 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9069e55f-c924-402a-895f-5a651e62538e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:58.043283 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069e55f-c924-402a-895f-5a651e62538e admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:58.043573 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069e55f-c924-402a-895f-5a651e62538e admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:58.046651 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069e55f-c924-402a-895f-5a651e62538e admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:58.047405 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9069e55f-c924-402a-895f-5a651e62538e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:35:58.047727 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9069e55f-c924-402a-895f-5a651e62538e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:58.049440 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9069e55f-c924-402a-895f-5a651e62538e admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:58.060949 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1365/2739] 10.222.0.24 () {58 vars in 1152 bytes} [Thu Apr 7 06:35:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:35:58.065501 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b4ce1-a2a1-4afe-a6de-ef70da7bd4b5 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:58.074370 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b4ce1-a2a1-4afe-a6de-ef70da7bd4b5 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:58.078988 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d12ed33-df3e-483b-a11a-4292ae71299f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:58.079636 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12ed33-df3e-483b-a11a-4292ae71299f admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:58.079927 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12ed33-df3e-483b-a11a-4292ae71299f admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:58.080203 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12ed33-df3e-483b-a11a-4292ae71299f admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:58.080888 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d12ed33-df3e-483b-a11a-4292ae71299f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:58.087671 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d12ed33-df3e-483b-a11a-4292ae71299f admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:58.124182 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9069e55f-c924-402a-895f-5a651e62538e admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:58.125906 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-9069e55f-c924-402a-895f-5a651e62538e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:58.180949 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9069e55f-c924-402a-895f-5a651e62538e admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:58.184675 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d58511-7fc9-4b5b-a98c-cf4cd5bca3df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:58.185344 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d58511-7fc9-4b5b-a98c-cf4cd5bca3df service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:58.185633 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d58511-7fc9-4b5b-a98c-cf4cd5bca3df service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:58.185936 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d58511-7fc9-4b5b-a98c-cf4cd5bca3df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:58.187730 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d5d58511-7fc9-4b5b-a98c-cf4cd5bca3df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:58.212299 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1375/2740] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:35:58 2022] POST /identity/v3/projects => generated 377 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:35:58.213391 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d12ed33-df3e-483b-a11a-4292ae71299f admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:58.248421 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d58511-7fc9-4b5b-a98c-cf4cd5bca3df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:58.249853 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d58511-7fc9-4b5b-a98c-cf4cd5bca3df service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:58.259803 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1366/2741] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:35:58 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 07 06:35:58.275225 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d12ed33-df3e-483b-a11a-4292ae71299f admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:58.280110 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0640638-2604-45f6-b13c-97c04d2e0c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:58.280809 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0640638-2604-45f6-b13c-97c04d2e0c0c admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:58.281094 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0640638-2604-45f6-b13c-97c04d2e0c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:58.281369 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0640638-2604-45f6-b13c-97c04d2e0c0c admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:58.282078 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0640638-2604-45f6-b13c-97c04d2e0c0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:58.284000 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0640638-2604-45f6-b13c-97c04d2e0c0c admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:58.389698 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1376/2742] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:35:58 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:35:58.393800 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d58511-7fc9-4b5b-a98c-cf4cd5bca3df service cinder] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:58.404864 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d58511-7fc9-4b5b-a98c-cf4cd5bca3df service cinder] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:58.409540 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c2e066-6cb9-4cdb-862e-7ff540c2a703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:58.410222 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2e066-6cb9-4cdb-862e-7ff540c2a703 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:58.413040 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2e066-6cb9-4cdb-862e-7ff540c2a703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:58.413040 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2e066-6cb9-4cdb-862e-7ff540c2a703 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:58.413040 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c2e066-6cb9-4cdb-862e-7ff540c2a703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:58.413312 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c2e066-6cb9-4cdb-862e-7ff540c2a703 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:58.422881 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1367/2743] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:35:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:35:58.426721 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0640638-2604-45f6-b13c-97c04d2e0c0c admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:58.436831 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0640638-2604-45f6-b13c-97c04d2e0c0c admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:58.443405 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afcfe73-6176-4fc7-add6-ce3991d92df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:58.450406 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afcfe73-6176-4fc7-add6-ce3991d92df2 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:58.450406 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afcfe73-6176-4fc7-add6-ce3991d92df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:58.450406 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afcfe73-6176-4fc7-add6-ce3991d92df2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:58.450406 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afcfe73-6176-4fc7-add6-ce3991d92df2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:58.450406 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afcfe73-6176-4fc7-add6-ce3991d92df2 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:58.457366 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1377/2744] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:35:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 07 06:35:58.462127 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c2e066-6cb9-4cdb-862e-7ff540c2a703 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:58.472924 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c2e066-6cb9-4cdb-862e-7ff540c2a703 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:58.477704 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a986c3-e53a-48a7-bd98-59e9a0cf9b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:58.478581 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a986c3-e53a-48a7-bd98-59e9a0cf9b51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:58.478862 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a986c3-e53a-48a7-bd98-59e9a0cf9b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:58.479164 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a986c3-e53a-48a7-bd98-59e9a0cf9b51 admin admin] PATH_INFO: `/v3/projects/7e0f19803e404dba9de823a6b2fea3d1/users/e08716b194f64c5c8bd8bdd26441e146/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:58.495628 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a986c3-e53a-48a7-bd98-59e9a0cf9b51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e0f19803e404dba9de823a6b2fea3d1, user_id=e08716b194f64c5c8bd8bdd26441e146, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:58.497356 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a986c3-e53a-48a7-bd98-59e9a0cf9b51 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:58.600867 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1368/2745] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:35:58 2022] PUT /identity/v3/projects/7e0f19803e404dba9de823a6b2fea3d1/users/e08716b194f64c5c8bd8bdd26441e146/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:35:58.611189 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf824d-cd37-4cba-840e-c2017ffdfde4 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:58.611456 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf824d-cd37-4cba-840e-c2017ffdfde4 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:58.611735 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf824d-cd37-4cba-840e-c2017ffdfde4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:58.638941 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-7bdf824d-cd37-4cba-840e-c2017ffdfde4 None None] MFA Rules not processed for user `e08716b194f64c5c8bd8bdd26441e146`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:35:58.640207 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-7bdf824d-cd37-4cba-840e-c2017ffdfde4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:35:58.701347 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1378/2746] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:35:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:35:58.712348 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a986c3-e53a-48a7-bd98-59e9a0cf9b51 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:35:58.764905 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a986c3-e53a-48a7-bd98-59e9a0cf9b51 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:35:58.768715 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb63b130-4757-42f9-b525-d708987c219b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:35:58.769361 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb63b130-4757-42f9-b525-d708987c219b service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:35:58.769648 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb63b130-4757-42f9-b525-d708987c219b service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:35:58.769924 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb63b130-4757-42f9-b525-d708987c219b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:35:58.778295 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb63b130-4757-42f9-b525-d708987c219b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:35:58.779761 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb63b130-4757-42f9-b525-d708987c219b service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:35:58.788705 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1369/2747] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:35:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:36:05.079496 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdf824d-cd37-4cba-840e-c2017ffdfde4 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:36:05.080937 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-7bdf824d-cd37-4cba-840e-c2017ffdfde4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:36:05.147813 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdf824d-cd37-4cba-840e-c2017ffdfde4 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:36:05.152374 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1a4961-3895-4428-86eb-9913869d53ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:36:05.153254 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a4961-3895-4428-86eb-9913869d53ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:36:05.153535 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a4961-3895-4428-86eb-9913869d53ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:36:05.153812 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a4961-3895-4428-86eb-9913869d53ea admin admin] PATH_INFO: `/v3/users/c2e3424032964bcf92ac4afaf7c073c9` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:36:05.154999 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1a4961-3895-4428-86eb-9913869d53ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2e3424032964bcf92ac4afaf7c073c9)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:36:05.156941 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1a4961-3895-4428-86eb-9913869d53ea admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:36:05.397072 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5a1a4961-3895-4428-86eb-9913869d53ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2e3424032964bcf92ac4afaf7c073c9'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:36:05.408595 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5a1a4961-3895-4428-86eb-9913869d53ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2e3424032964bcf92ac4afaf7c073c9'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:36:05.511795 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5a1a4961-3895-4428-86eb-9913869d53ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2e3424032964bcf92ac4afaf7c073c9'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:36:05.512430 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5a1a4961-3895-4428-86eb-9913869d53ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2e3424032964bcf92ac4afaf7c073c9'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:36:05.513679 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5a1a4961-3895-4428-86eb-9913869d53ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2e3424032964bcf92ac4afaf7c073c9'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:36:05.528165 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1379/2748] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:36:05 2022] DELETE /identity/v3/users/c2e3424032964bcf92ac4afaf7c073c9 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:36:05.532693 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2f505-3c0f-4709-b14d-aa3521f382f6 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:36:05.543455 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2f505-3c0f-4709-b14d-aa3521f382f6 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:36:05.543455 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2f505-3c0f-4709-b14d-aa3521f382f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:36:05.550666 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-1be2f505-3c0f-4709-b14d-aa3521f382f6 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:36:05.551905 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-1be2f505-3c0f-4709-b14d-aa3521f382f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:36:05.607550 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1370/2749] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:36:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:36:05.617469 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1a4961-3895-4428-86eb-9913869d53ea admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:36:05.619042 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-5a1a4961-3895-4428-86eb-9913869d53ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:36:05.674639 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1a4961-3895-4428-86eb-9913869d53ea admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:36:05.678141 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dba6bf-281c-48aa-8f84-cdcdcfeb48c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:36:05.678782 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dba6bf-281c-48aa-8f84-cdcdcfeb48c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:36:05.679068 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dba6bf-281c-48aa-8f84-cdcdcfeb48c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:36:05.679339 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dba6bf-281c-48aa-8f84-cdcdcfeb48c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:36:05.688102 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dba6bf-281c-48aa-8f84-cdcdcfeb48c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:36:05.689603 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dba6bf-281c-48aa-8f84-cdcdcfeb48c9 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:36:05.699327 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1380/2750] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:36:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 07 06:36:06.144139 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be2f505-3c0f-4709-b14d-aa3521f382f6 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:36:06.145574 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-1be2f505-3c0f-4709-b14d-aa3521f382f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:36:06.158671 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be2f505-3c0f-4709-b14d-aa3521f382f6 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:36:06.163318 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08909d3e-95e7-4337-a24c-e4027cd0dccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:36:06.164243 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08909d3e-95e7-4337-a24c-e4027cd0dccc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:36:06.164516 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08909d3e-95e7-4337-a24c-e4027cd0dccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:36:06.164789 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08909d3e-95e7-4337-a24c-e4027cd0dccc admin admin] PATH_INFO: `/v3/projects/5eb519405b74446698000066d47e0525` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:36:06.166047 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08909d3e-95e7-4337-a24c-e4027cd0dccc admin admin] RBAC: Authorizing `identity:delete_project(project_id=5eb519405b74446698000066d47e0525)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:36:06.168832 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08909d3e-95e7-4337-a24c-e4027cd0dccc admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:36:06.286424 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-08909d3e-95e7-4337-a24c-e4027cd0dccc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5eb519405b74446698000066d47e0525', 'request_id': 'req-08909d3e-95e7-4337-a24c-e4027cd0dccc'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:36:06.291772 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-08909d3e-95e7-4337-a24c-e4027cd0dccc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5eb519405b74446698000066d47e0525', 'request_id': 'req-08909d3e-95e7-4337-a24c-e4027cd0dccc'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:36:06.366297 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-08909d3e-95e7-4337-a24c-e4027cd0dccc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5eb519405b74446698000066d47e0525', 'request_id': 'req-08909d3e-95e7-4337-a24c-e4027cd0dccc'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:36:06.377094 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-08909d3e-95e7-4337-a24c-e4027cd0dccc admin admin] The token cache is being invalidate because project 5eb519405b74446698000066d47e0525 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:36:06.377380 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-08909d3e-95e7-4337-a24c-e4027cd0dccc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:36:06.377995 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-08909d3e-95e7-4337-a24c-e4027cd0dccc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:36:06.379567 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1371/2751] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:36:06 2022] DELETE /identity/v3/projects/5eb519405b74446698000066d47e0525 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:36:06.384104 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dba6bf-281c-48aa-8f84-cdcdcfeb48c9 service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:36:06.393617 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dba6bf-281c-48aa-8f84-cdcdcfeb48c9 service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:36:06.448153 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161aba3c-0a8c-4b47-aaec-1c5c8c267bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:36:06.449022 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161aba3c-0a8c-4b47-aaec-1c5c8c267bba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:36:06.449307 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161aba3c-0a8c-4b47-aaec-1c5c8c267bba admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:36:06.449582 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161aba3c-0a8c-4b47-aaec-1c5c8c267bba admin admin] PATH_INFO: `/v3/users/c8a885a8ffcd4cc79d53fc3641789b03` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:36:06.450836 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161aba3c-0a8c-4b47-aaec-1c5c8c267bba admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8a885a8ffcd4cc79d53fc3641789b03)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:36:06.452771 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161aba3c-0a8c-4b47-aaec-1c5c8c267bba admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:36:06.671470 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-161aba3c-0a8c-4b47-aaec-1c5c8c267bba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8a885a8ffcd4cc79d53fc3641789b03'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:36:06.683771 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-161aba3c-0a8c-4b47-aaec-1c5c8c267bba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8a885a8ffcd4cc79d53fc3641789b03'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:36:06.777727 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-161aba3c-0a8c-4b47-aaec-1c5c8c267bba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8a885a8ffcd4cc79d53fc3641789b03'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:36:06.778342 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-161aba3c-0a8c-4b47-aaec-1c5c8c267bba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8a885a8ffcd4cc79d53fc3641789b03'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:36:06.778939 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-161aba3c-0a8c-4b47-aaec-1c5c8c267bba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8a885a8ffcd4cc79d53fc3641789b03'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:36:06.791737 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1381/2752] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:36:06 2022] DELETE /identity/v3/users/c8a885a8ffcd4cc79d53fc3641789b03 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:36:07.184873 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08909d3e-95e7-4337-a24c-e4027cd0dccc admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:36:07.186326 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-08909d3e-95e7-4337-a24c-e4027cd0dccc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:36:07.201994 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08909d3e-95e7-4337-a24c-e4027cd0dccc admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:36:07.256939 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f8c991-31b6-4c13-bfd8-f055c399351c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:36:07.257825 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8c991-31b6-4c13-bfd8-f055c399351c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:36:07.258107 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8c991-31b6-4c13-bfd8-f055c399351c admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:36:07.258378 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8c991-31b6-4c13-bfd8-f055c399351c admin admin] PATH_INFO: `/v3/projects/5bf37cdffe984c298b63bb90b7d30806` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:36:07.259539 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f8c991-31b6-4c13-bfd8-f055c399351c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bf37cdffe984c298b63bb90b7d30806)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:36:07.261472 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f8c991-31b6-4c13-bfd8-f055c399351c admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:36:07.377313 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-c6f8c991-31b6-4c13-bfd8-f055c399351c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bf37cdffe984c298b63bb90b7d30806', 'request_id': 'req-c6f8c991-31b6-4c13-bfd8-f055c399351c'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:36:07.383215 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-c6f8c991-31b6-4c13-bfd8-f055c399351c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bf37cdffe984c298b63bb90b7d30806', 'request_id': 'req-c6f8c991-31b6-4c13-bfd8-f055c399351c'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:36:07.480960 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-c6f8c991-31b6-4c13-bfd8-f055c399351c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bf37cdffe984c298b63bb90b7d30806', 'request_id': 'req-c6f8c991-31b6-4c13-bfd8-f055c399351c'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:36:07.491995 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-c6f8c991-31b6-4c13-bfd8-f055c399351c admin admin] The token cache is being invalidate because project 5bf37cdffe984c298b63bb90b7d30806 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:36:07.492286 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-c6f8c991-31b6-4c13-bfd8-f055c399351c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:36:07.492907 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-c6f8c991-31b6-4c13-bfd8-f055c399351c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:36:07.494426 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1372/2753] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:36:07 2022] DELETE /identity/v3/projects/5bf37cdffe984c298b63bb90b7d30806 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:36:07.498586 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161aba3c-0a8c-4b47-aaec-1c5c8c267bba admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:36:07.504905 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-161aba3c-0a8c-4b47-aaec-1c5c8c267bba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:36:07.513087 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161aba3c-0a8c-4b47-aaec-1c5c8c267bba admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:36:07.566338 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab1046b-8262-4168-91a8-b9f821e6380b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:36:07.567204 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1046b-8262-4168-91a8-b9f821e6380b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:36:07.567491 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1046b-8262-4168-91a8-b9f821e6380b admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:36:07.568292 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1046b-8262-4168-91a8-b9f821e6380b admin admin] PATH_INFO: `/v3/users/118d7822cc554e50a55a4b790ddab888` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:36:07.569480 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab1046b-8262-4168-91a8-b9f821e6380b admin admin] RBAC: Authorizing `identity:delete_user(user_id=118d7822cc554e50a55a4b790ddab888)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:36:07.571422 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab1046b-8262-4168-91a8-b9f821e6380b admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:36:07.773780 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-bab1046b-8262-4168-91a8-b9f821e6380b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '118d7822cc554e50a55a4b790ddab888'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:36:07.785352 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-bab1046b-8262-4168-91a8-b9f821e6380b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '118d7822cc554e50a55a4b790ddab888'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:36:07.863660 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-bab1046b-8262-4168-91a8-b9f821e6380b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '118d7822cc554e50a55a4b790ddab888'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:36:07.864291 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-bab1046b-8262-4168-91a8-b9f821e6380b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '118d7822cc554e50a55a4b790ddab888'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:36:07.865727 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-bab1046b-8262-4168-91a8-b9f821e6380b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '118d7822cc554e50a55a4b790ddab888'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:36:07.878001 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1382/2754] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:36:07 2022] DELETE /identity/v3/users/118d7822cc554e50a55a4b790ddab888 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:36:08.310432 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f8c991-31b6-4c13-bfd8-f055c399351c admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:36:08.311919 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-c6f8c991-31b6-4c13-bfd8-f055c399351c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:36:08.325500 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f8c991-31b6-4c13-bfd8-f055c399351c admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:36:08.381071 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ca2162-abae-4e23-b562-79f4e6e40695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:36:08.381928 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca2162-abae-4e23-b562-79f4e6e40695 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:36:08.382216 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca2162-abae-4e23-b562-79f4e6e40695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:36:08.382492 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca2162-abae-4e23-b562-79f4e6e40695 admin admin] PATH_INFO: `/v3/projects/bf68de8606ef407caf277779465c9333` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:36:08.383688 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ca2162-abae-4e23-b562-79f4e6e40695 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf68de8606ef407caf277779465c9333)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:36:08.385617 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ca2162-abae-4e23-b562-79f4e6e40695 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:36:08.501455 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-e4ca2162-abae-4e23-b562-79f4e6e40695 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf68de8606ef407caf277779465c9333', 'request_id': 'req-e4ca2162-abae-4e23-b562-79f4e6e40695'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:36:08.506673 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-e4ca2162-abae-4e23-b562-79f4e6e40695 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf68de8606ef407caf277779465c9333', 'request_id': 'req-e4ca2162-abae-4e23-b562-79f4e6e40695'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:36:08.572309 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-e4ca2162-abae-4e23-b562-79f4e6e40695 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf68de8606ef407caf277779465c9333', 'request_id': 'req-e4ca2162-abae-4e23-b562-79f4e6e40695'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:36:08.582967 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-e4ca2162-abae-4e23-b562-79f4e6e40695 admin admin] The token cache is being invalidate because project bf68de8606ef407caf277779465c9333 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:36:08.583737 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-e4ca2162-abae-4e23-b562-79f4e6e40695 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:36:08.584380 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-e4ca2162-abae-4e23-b562-79f4e6e40695 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:36:08.585891 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1373/2755] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:36:08 2022] DELETE /identity/v3/projects/bf68de8606ef407caf277779465c9333 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:36:08.590879 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348195d-1f41-4b10-8f06-8763d4897bbf None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:36:08.591373 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348195d-1f41-4b10-8f06-8763d4897bbf None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:36:08.591470 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348195d-1f41-4b10-8f06-8763d4897bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:36:08.612635 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-7348195d-1f41-4b10-8f06-8763d4897bbf None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:36:08.613835 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-7348195d-1f41-4b10-8f06-8763d4897bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:36:08.670905 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1383/2756] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:36:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:36:08.679789 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671abc5-1b43-453c-863b-a529e8cf5477 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:36:08.680084 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671abc5-1b43-453c-863b-a529e8cf5477 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:36:08.680361 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671abc5-1b43-453c-863b-a529e8cf5477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:36:08.698057 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-5671abc5-1b43-453c-863b-a529e8cf5477 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:36:08.699286 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-5671abc5-1b43-453c-863b-a529e8cf5477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:36:08.707100 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1374/2757] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:36:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:36:08.711679 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7348195d-1f41-4b10-8f06-8763d4897bbf None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:36:08.720996 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7348195d-1f41-4b10-8f06-8763d4897bbf None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:36:08.726150 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d4df9-a714-4643-be58-0f432b6bdc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:36:08.726795 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d4df9-a714-4643-be58-0f432b6bdc77 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:36:08.727079 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d4df9-a714-4643-be58-0f432b6bdc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:36:08.727355 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d4df9-a714-4643-be58-0f432b6bdc77 admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:36:08.728736 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16d4df9-a714-4643-be58-0f432b6bdc77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:36:08.729052 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16d4df9-a714-4643-be58-0f432b6bdc77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:36:08.730637 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16d4df9-a714-4643-be58-0f432b6bdc77 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:36:08.741935 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1384/2758] 10.222.0.24 () {58 vars in 1152 bytes} [Thu Apr 7 06:36:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:36:08.745998 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5671abc5-1b43-453c-863b-a529e8cf5477 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:36:08.755590 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5671abc5-1b43-453c-863b-a529e8cf5477 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:36:08.760497 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d7e9ec-0270-4d8e-8ac4-d14daa8866f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:36:08.761146 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7e9ec-0270-4d8e-8ac4-d14daa8866f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:36:08.761431 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7e9ec-0270-4d8e-8ac4-d14daa8866f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:36:08.761707 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7e9ec-0270-4d8e-8ac4-d14daa8866f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:36:08.762402 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d7e9ec-0270-4d8e-8ac4-d14daa8866f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:36:08.764343 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d7e9ec-0270-4d8e-8ac4-d14daa8866f0 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:36:08.905475 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1375/2759] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:36:08 2022] POST /identity/v3/projects => generated 391 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:36:08.909744 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d4df9-a714-4643-be58-0f432b6bdc77 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:36:08.919620 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d4df9-a714-4643-be58-0f432b6bdc77 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:36:08.974285 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad18fc4a-1dfb-4989-b0e1-0a89a76a6787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:36:08.974947 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18fc4a-1dfb-4989-b0e1-0a89a76a6787 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:36:08.975234 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18fc4a-1dfb-4989-b0e1-0a89a76a6787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:36:08.975510 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18fc4a-1dfb-4989-b0e1-0a89a76a6787 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:36:08.976233 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad18fc4a-1dfb-4989-b0e1-0a89a76a6787 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:36:08.978172 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad18fc4a-1dfb-4989-b0e1-0a89a76a6787 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:36:09.069380 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1385/2760] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:36:08 2022] POST /identity/v3/users => generated 296 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:36:09.073497 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d7e9ec-0270-4d8e-8ac4-d14daa8866f0 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:36:09.084246 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d7e9ec-0270-4d8e-8ac4-d14daa8866f0 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:36:09.088787 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9609e38-94b3-4e72-87a1-c7bfe1590349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:36:09.089434 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9609e38-94b3-4e72-87a1-c7bfe1590349 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:36:09.089719 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9609e38-94b3-4e72-87a1-c7bfe1590349 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:36:09.089994 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9609e38-94b3-4e72-87a1-c7bfe1590349 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:36:09.090723 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9609e38-94b3-4e72-87a1-c7bfe1590349 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:36:09.092342 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9609e38-94b3-4e72-87a1-c7bfe1590349 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:36:09.103314 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1376/2761] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:36:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:36:09.115187 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad18fc4a-1dfb-4989-b0e1-0a89a76a6787 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:36:09.126743 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad18fc4a-1dfb-4989-b0e1-0a89a76a6787 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:36:09.132040 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de15bc-2f8d-4508-af34-e51c4675f344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:36:09.132689 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de15bc-2f8d-4508-af34-e51c4675f344 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:36:09.132973 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de15bc-2f8d-4508-af34-e51c4675f344 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:36:09.133250 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de15bc-2f8d-4508-af34-e51c4675f344 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:36:09.133972 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71de15bc-2f8d-4508-af34-e51c4675f344 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:36:09.135535 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71de15bc-2f8d-4508-af34-e51c4675f344 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:36:09.145174 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1386/2762] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:36:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:36:09.149098 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9609e38-94b3-4e72-87a1-c7bfe1590349 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:36:09.158758 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9609e38-94b3-4e72-87a1-c7bfe1590349 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:36:09.163608 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f84335-278a-4848-8e12-508709d77084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:36:09.164518 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f84335-278a-4848-8e12-508709d77084 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:36:09.164910 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f84335-278a-4848-8e12-508709d77084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:36:09.165189 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f84335-278a-4848-8e12-508709d77084 admin admin] PATH_INFO: `/v3/projects/338651a958604d5e9221d95597502f9f/users/5b32f1e0e9b546a6a3e46586464cf642/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:36:09.179988 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f84335-278a-4848-8e12-508709d77084 admin admin] RBAC: Authorizing `identity:create_grant(project_id=338651a958604d5e9221d95597502f9f, user_id=5b32f1e0e9b546a6a3e46586464cf642, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:36:09.182655 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f84335-278a-4848-8e12-508709d77084 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:36:09.257873 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1377/2763] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:36:09 2022] PUT /identity/v3/projects/338651a958604d5e9221d95597502f9f/users/5b32f1e0e9b546a6a3e46586464cf642/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:36:09.268098 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab27e2-df59-4aef-a7dd-11f99ac96808 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:36:09.268359 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab27e2-df59-4aef-a7dd-11f99ac96808 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:36:09.268645 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab27e2-df59-4aef-a7dd-11f99ac96808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:36:09.293964 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-ddab27e2-df59-4aef-a7dd-11f99ac96808 None None] MFA Rules not processed for user `5b32f1e0e9b546a6a3e46586464cf642`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:36:09.295187 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-ddab27e2-df59-4aef-a7dd-11f99ac96808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:36:09.355852 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1387/2764] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:36:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:36:09.370505 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f84335-278a-4848-8e12-508709d77084 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:36:09.372269 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-53f84335-278a-4848-8e12-508709d77084 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:36:09.426066 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f84335-278a-4848-8e12-508709d77084 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:36:09.430095 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e9e338-9b89-40b6-a362-75148b254a7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:36:09.430734 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9e338-9b89-40b6-a362-75148b254a7a service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:36:09.431018 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9e338-9b89-40b6-a362-75148b254a7a service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:36:09.431291 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9e338-9b89-40b6-a362-75148b254a7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:36:09.439304 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e9e338-9b89-40b6-a362-75148b254a7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:36:09.440769 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e9e338-9b89-40b6-a362-75148b254a7a service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:36:09.449833 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1378/2765] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:36:09 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:36:29.065015 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab27e2-df59-4aef-a7dd-11f99ac96808 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:36:29.066418 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-ddab27e2-df59-4aef-a7dd-11f99ac96808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:36:29.128912 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab27e2-df59-4aef-a7dd-11f99ac96808 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:36:29.133517 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ae4d5-53ae-4307-bd15-c94ab50472f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:36:29.134388 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ae4d5-53ae-4307-bd15-c94ab50472f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:36:29.134675 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ae4d5-53ae-4307-bd15-c94ab50472f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:36:29.134954 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ae4d5-53ae-4307-bd15-c94ab50472f1 admin admin] PATH_INFO: `/v3/users/e08716b194f64c5c8bd8bdd26441e146` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:36:29.136174 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1ae4d5-53ae-4307-bd15-c94ab50472f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e08716b194f64c5c8bd8bdd26441e146)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:36:29.138078 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1ae4d5-53ae-4307-bd15-c94ab50472f1 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:36:29.339510 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-0f1ae4d5-53ae-4307-bd15-c94ab50472f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e08716b194f64c5c8bd8bdd26441e146'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:36:29.351385 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-0f1ae4d5-53ae-4307-bd15-c94ab50472f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e08716b194f64c5c8bd8bdd26441e146'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:36:29.412432 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-0f1ae4d5-53ae-4307-bd15-c94ab50472f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e08716b194f64c5c8bd8bdd26441e146'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:36:29.413078 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-0f1ae4d5-53ae-4307-bd15-c94ab50472f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e08716b194f64c5c8bd8bdd26441e146'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:36:29.413694 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-0f1ae4d5-53ae-4307-bd15-c94ab50472f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e08716b194f64c5c8bd8bdd26441e146'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:36:29.426231 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1388/2766] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:36:29 2022] DELETE /identity/v3/users/e08716b194f64c5c8bd8bdd26441e146 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:36:29.430728 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fcdc2f-9b27-4d82-888a-30e3b14b5c24 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:36:29.431234 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fcdc2f-9b27-4d82-888a-30e3b14b5c24 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:36:29.431364 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fcdc2f-9b27-4d82-888a-30e3b14b5c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:36:29.447875 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-08fcdc2f-9b27-4d82-888a-30e3b14b5c24 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:36:29.449056 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-08fcdc2f-9b27-4d82-888a-30e3b14b5c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:36:29.505312 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1379/2767] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:36:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:36:29.514678 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ae4d5-53ae-4307-bd15-c94ab50472f1 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:36:29.516059 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-0f1ae4d5-53ae-4307-bd15-c94ab50472f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:36:29.570175 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ae4d5-53ae-4307-bd15-c94ab50472f1 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:36:29.573751 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde61166-14dc-461f-ae03-3463cfe98856 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:36:29.574386 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde61166-14dc-461f-ae03-3463cfe98856 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:36:29.574688 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde61166-14dc-461f-ae03-3463cfe98856 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:36:29.574946 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde61166-14dc-461f-ae03-3463cfe98856 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:36:29.588236 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde61166-14dc-461f-ae03-3463cfe98856 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:36:29.589703 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde61166-14dc-461f-ae03-3463cfe98856 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:36:29.599341 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1389/2768] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:36:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 07 06:36:29.950434 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fcdc2f-9b27-4d82-888a-30e3b14b5c24 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:36:29.952183 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-08fcdc2f-9b27-4d82-888a-30e3b14b5c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:36:29.966954 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fcdc2f-9b27-4d82-888a-30e3b14b5c24 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:36:29.971605 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d43e7e8-468d-49b7-9620-6e4e540350b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:36:29.972540 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43e7e8-468d-49b7-9620-6e4e540350b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:36:29.972831 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43e7e8-468d-49b7-9620-6e4e540350b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:36:29.973108 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43e7e8-468d-49b7-9620-6e4e540350b3 admin admin] PATH_INFO: `/v3/projects/7e0f19803e404dba9de823a6b2fea3d1` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:36:29.974344 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d43e7e8-468d-49b7-9620-6e4e540350b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e0f19803e404dba9de823a6b2fea3d1)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:36:29.976429 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d43e7e8-468d-49b7-9620-6e4e540350b3 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:36:30.106281 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-2d43e7e8-468d-49b7-9620-6e4e540350b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e0f19803e404dba9de823a6b2fea3d1', 'request_id': 'req-2d43e7e8-468d-49b7-9620-6e4e540350b3'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:36:30.111488 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-2d43e7e8-468d-49b7-9620-6e4e540350b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e0f19803e404dba9de823a6b2fea3d1', 'request_id': 'req-2d43e7e8-468d-49b7-9620-6e4e540350b3'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:36:30.193794 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-2d43e7e8-468d-49b7-9620-6e4e540350b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e0f19803e404dba9de823a6b2fea3d1', 'request_id': 'req-2d43e7e8-468d-49b7-9620-6e4e540350b3'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:36:30.205094 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-2d43e7e8-468d-49b7-9620-6e4e540350b3 admin admin] The token cache is being invalidate because project 7e0f19803e404dba9de823a6b2fea3d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:36:30.205412 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-2d43e7e8-468d-49b7-9620-6e4e540350b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:36:30.206284 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-2d43e7e8-468d-49b7-9620-6e4e540350b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:36:30.209169 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1380/2769] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:36:29 2022] DELETE /identity/v3/projects/7e0f19803e404dba9de823a6b2fea3d1 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:36:30.212929 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f0b812-5c21-4423-9662-e046a1f3f1f0 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:36:30.213404 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f0b812-5c21-4423-9662-e046a1f3f1f0 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:36:30.213516 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f0b812-5c21-4423-9662-e046a1f3f1f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:36:30.237148 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-75f0b812-5c21-4423-9662-e046a1f3f1f0 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:36:30.237148 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-75f0b812-5c21-4423-9662-e046a1f3f1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:36:30.297472 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1390/2770] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:36:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:36:30.306581 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc1896-8315-4e3d-a7f1-3b428660526b None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:36:30.306867 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc1896-8315-4e3d-a7f1-3b428660526b None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:36:30.307146 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc1896-8315-4e3d-a7f1-3b428660526b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:36:30.325635 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-d7dc1896-8315-4e3d-a7f1-3b428660526b None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:36:30.326852 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d7dc1896-8315-4e3d-a7f1-3b428660526b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:36:30.335392 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1381/2771] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:36:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:36:30.339860 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f0b812-5c21-4423-9662-e046a1f3f1f0 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:36:30.349220 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f0b812-5c21-4423-9662-e046a1f3f1f0 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:36:30.353699 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d66ca-5d69-4f7c-a97c-2936dc08bf35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:36:30.354347 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d66ca-5d69-4f7c-a97c-2936dc08bf35 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:36:30.354626 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d66ca-5d69-4f7c-a97c-2936dc08bf35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:36:30.354904 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d66ca-5d69-4f7c-a97c-2936dc08bf35 admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:36:30.355620 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d66ca-5d69-4f7c-a97c-2936dc08bf35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:36:30.355956 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d66ca-5d69-4f7c-a97c-2936dc08bf35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:36:30.357522 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d66ca-5d69-4f7c-a97c-2936dc08bf35 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:36:30.369738 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1391/2772] 10.222.0.24 () {58 vars in 1152 bytes} [Thu Apr 7 06:36:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:36:30.373725 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc1896-8315-4e3d-a7f1-3b428660526b None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:36:30.383729 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc1896-8315-4e3d-a7f1-3b428660526b None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:36:30.388359 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b540b5-e014-4292-bce6-003e5ffbfe19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:36:30.389005 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b540b5-e014-4292-bce6-003e5ffbfe19 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:36:30.389293 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b540b5-e014-4292-bce6-003e5ffbfe19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:36:30.389571 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b540b5-e014-4292-bce6-003e5ffbfe19 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:36:30.390304 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b540b5-e014-4292-bce6-003e5ffbfe19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:36:30.392231 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b540b5-e014-4292-bce6-003e5ffbfe19 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:36:30.464849 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1382/2773] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:36:30 2022] POST /identity/v3/projects => generated 365 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:36:30.469074 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d66ca-5d69-4f7c-a97c-2936dc08bf35 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:36:30.479353 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d66ca-5d69-4f7c-a97c-2936dc08bf35 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:36:30.534273 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc488a4-6a7a-4c07-9916-aa98c36d7c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:36:30.534939 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc488a4-6a7a-4c07-9916-aa98c36d7c6b admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:36:30.535227 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc488a4-6a7a-4c07-9916-aa98c36d7c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:36:30.536047 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc488a4-6a7a-4c07-9916-aa98c36d7c6b admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:36:30.536798 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc488a4-6a7a-4c07-9916-aa98c36d7c6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:36:30.538711 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc488a4-6a7a-4c07-9916-aa98c36d7c6b admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:36:30.635136 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1392/2774] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:36:30 2022] POST /identity/v3/users => generated 283 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:36:30.639165 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b540b5-e014-4292-bce6-003e5ffbfe19 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:36:30.649212 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b540b5-e014-4292-bce6-003e5ffbfe19 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:36:30.653885 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9c326-4ddb-4714-b227-4c887bc63afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:36:30.654540 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9c326-4ddb-4714-b227-4c887bc63afa admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:36:30.654827 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9c326-4ddb-4714-b227-4c887bc63afa admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:36:30.655104 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9c326-4ddb-4714-b227-4c887bc63afa admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:36:30.655876 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb9c326-4ddb-4714-b227-4c887bc63afa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:36:30.657459 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb9c326-4ddb-4714-b227-4c887bc63afa admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:36:30.668101 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1383/2775] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:36:30.671933 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc488a4-6a7a-4c07-9916-aa98c36d7c6b admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:36:30.682244 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc488a4-6a7a-4c07-9916-aa98c36d7c6b admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:36:30.686847 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8c30f0-fce5-4e9c-b680-b52e6c799ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:36:30.687490 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c30f0-fce5-4e9c-b680-b52e6c799ba9 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:36:30.687802 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c30f0-fce5-4e9c-b680-b52e6c799ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:36:30.688077 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c30f0-fce5-4e9c-b680-b52e6c799ba9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:36:30.688799 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8c30f0-fce5-4e9c-b680-b52e6c799ba9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:36:30.690359 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8c30f0-fce5-4e9c-b680-b52e6c799ba9 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:36:30.700008 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1393/2776] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:36:30.713547 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9c326-4ddb-4714-b227-4c887bc63afa admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:36:30.723586 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9c326-4ddb-4714-b227-4c887bc63afa admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:36:30.728257 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f7f82-7da4-4e55-8031-11977173db1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:36:30.729115 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f7f82-7da4-4e55-8031-11977173db1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:36:30.729411 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f7f82-7da4-4e55-8031-11977173db1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:36:30.729682 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f7f82-7da4-4e55-8031-11977173db1a admin admin] PATH_INFO: `/v3/projects/400a1b0169e44252b21e0ed455c83efa/users/e09795a9e20745578e640e6cae4aa376/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:36:30.745674 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805f7f82-7da4-4e55-8031-11977173db1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=400a1b0169e44252b21e0ed455c83efa, user_id=e09795a9e20745578e640e6cae4aa376, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:36:30.748566 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805f7f82-7da4-4e55-8031-11977173db1a admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:36:30.823606 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1384/2777] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:36:30 2022] PUT /identity/v3/projects/400a1b0169e44252b21e0ed455c83efa/users/e09795a9e20745578e640e6cae4aa376/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:36:30.834400 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189c18b-0445-4416-b7b4-0a818d4ca5d7 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:36:30.834750 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189c18b-0445-4416-b7b4-0a818d4ca5d7 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:36:30.834971 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189c18b-0445-4416-b7b4-0a818d4ca5d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:36:30.861149 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-f189c18b-0445-4416-b7b4-0a818d4ca5d7 None None] MFA Rules not processed for user `e09795a9e20745578e640e6cae4aa376`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:36:30.862392 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f189c18b-0445-4416-b7b4-0a818d4ca5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:36:30.925080 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1394/2778] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:36:30 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:36:30.936182 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f7f82-7da4-4e55-8031-11977173db1a admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:36:30.937880 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-805f7f82-7da4-4e55-8031-11977173db1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:36:30.992415 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f7f82-7da4-4e55-8031-11977173db1a admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:36:30.996057 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab2c74c-a4ec-40c5-9871-d28e93d7557f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc81e8151cc4dd2a79d3c6c9d9ceaeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:36:30.996697 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab2c74c-a4ec-40c5-9871-d28e93d7557f service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:36:30.996985 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab2c74c-a4ec-40c5-9871-d28e93d7557f service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:36:30.997261 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab2c74c-a4ec-40c5-9871-d28e93d7557f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:36:31.005540 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab2c74c-a4ec-40c5-9871-d28e93d7557f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:36:31.006959 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab2c74c-a4ec-40c5-9871-d28e93d7557f service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:36:31.015465 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1385/2779] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:36:30 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:36:31.309701 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f189c18b-0445-4416-b7b4-0a818d4ca5d7 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:36:31.311149 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f189c18b-0445-4416-b7b4-0a818d4ca5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:36:31.373905 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f189c18b-0445-4416-b7b4-0a818d4ca5d7 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:36:31.378633 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb3209-8016-4b18-a433-e28f86970ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:36:31.380092 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb3209-8016-4b18-a433-e28f86970ec7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:36:31.384727 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb3209-8016-4b18-a433-e28f86970ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:36:31.384727 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb3209-8016-4b18-a433-e28f86970ec7 admin admin] PATH_INFO: `/v3/users/5b32f1e0e9b546a6a3e46586464cf642` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:36:31.384727 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fb3209-8016-4b18-a433-e28f86970ec7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b32f1e0e9b546a6a3e46586464cf642)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:36:31.384727 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fb3209-8016-4b18-a433-e28f86970ec7 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:36:31.586009 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d2fb3209-8016-4b18-a433-e28f86970ec7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b32f1e0e9b546a6a3e46586464cf642'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:36:31.599328 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d2fb3209-8016-4b18-a433-e28f86970ec7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b32f1e0e9b546a6a3e46586464cf642'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:36:31.684446 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d2fb3209-8016-4b18-a433-e28f86970ec7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b32f1e0e9b546a6a3e46586464cf642'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:36:31.685107 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d2fb3209-8016-4b18-a433-e28f86970ec7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b32f1e0e9b546a6a3e46586464cf642'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:36:31.685704 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d2fb3209-8016-4b18-a433-e28f86970ec7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b32f1e0e9b546a6a3e46586464cf642'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:36:31.699832 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1395/2780] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:36:31 2022] DELETE /identity/v3/users/5b32f1e0e9b546a6a3e46586464cf642 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:36:31.704091 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2349e-7d2c-44cc-b382-a49d505f7cc2 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:36:31.704574 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2349e-7d2c-44cc-b382-a49d505f7cc2 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:36:31.704673 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2349e-7d2c-44cc-b382-a49d505f7cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:36:31.721927 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-57b2349e-7d2c-44cc-b382-a49d505f7cc2 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:36:31.723124 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-57b2349e-7d2c-44cc-b382-a49d505f7cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:36:31.781244 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1386/2781] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:36:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:36:31.790872 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb3209-8016-4b18-a433-e28f86970ec7 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:36:31.792316 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d2fb3209-8016-4b18-a433-e28f86970ec7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:36:31.849506 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb3209-8016-4b18-a433-e28f86970ec7 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:36:31.853096 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d91a6-a8be-4eb4-8c1f-325aa990f03d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:36:31.853742 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d91a6-a8be-4eb4-8c1f-325aa990f03d service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:36:31.854026 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d91a6-a8be-4eb4-8c1f-325aa990f03d service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:36:31.854303 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d91a6-a8be-4eb4-8c1f-325aa990f03d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:36:31.863085 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565d91a6-a8be-4eb4-8c1f-325aa990f03d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:36:31.865379 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565d91a6-a8be-4eb4-8c1f-325aa990f03d service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:36:31.874795 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1396/2782] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:36:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:36:32.288408 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b2349e-7d2c-44cc-b382-a49d505f7cc2 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:36:32.295806 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-57b2349e-7d2c-44cc-b382-a49d505f7cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:36:32.301546 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b2349e-7d2c-44cc-b382-a49d505f7cc2 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:36:32.306799 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8747abe0-f2d6-44b8-a794-b61dd28d3e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:36:32.307658 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747abe0-f2d6-44b8-a794-b61dd28d3e63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:36:32.307965 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747abe0-f2d6-44b8-a794-b61dd28d3e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:36:32.308234 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747abe0-f2d6-44b8-a794-b61dd28d3e63 admin admin] PATH_INFO: `/v3/projects/338651a958604d5e9221d95597502f9f` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:36:32.309858 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8747abe0-f2d6-44b8-a794-b61dd28d3e63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=338651a958604d5e9221d95597502f9f)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:36:32.311359 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8747abe0-f2d6-44b8-a794-b61dd28d3e63 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:36:32.411909 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-8747abe0-f2d6-44b8-a794-b61dd28d3e63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '338651a958604d5e9221d95597502f9f', 'request_id': 'req-8747abe0-f2d6-44b8-a794-b61dd28d3e63'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:36:32.417256 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-8747abe0-f2d6-44b8-a794-b61dd28d3e63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '338651a958604d5e9221d95597502f9f', 'request_id': 'req-8747abe0-f2d6-44b8-a794-b61dd28d3e63'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:36:32.472885 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-8747abe0-f2d6-44b8-a794-b61dd28d3e63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '338651a958604d5e9221d95597502f9f', 'request_id': 'req-8747abe0-f2d6-44b8-a794-b61dd28d3e63'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:36:32.484262 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-8747abe0-f2d6-44b8-a794-b61dd28d3e63 admin admin] The token cache is being invalidate because project 338651a958604d5e9221d95597502f9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:36:32.484554 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-8747abe0-f2d6-44b8-a794-b61dd28d3e63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:36:32.485180 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-8747abe0-f2d6-44b8-a794-b61dd28d3e63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:36:32.486743 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1387/2783] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:36:32 2022] DELETE /identity/v3/projects/338651a958604d5e9221d95597502f9f => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:36:32.491981 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917024a0-a49b-4913-a83e-0f8ae68bcd7f None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:36:32.492463 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917024a0-a49b-4913-a83e-0f8ae68bcd7f None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:36:32.492571 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917024a0-a49b-4913-a83e-0f8ae68bcd7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:36:32.509331 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-917024a0-a49b-4913-a83e-0f8ae68bcd7f None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:36:32.510506 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-917024a0-a49b-4913-a83e-0f8ae68bcd7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:36:32.568689 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1397/2784] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:36:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:36:32.577315 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1810b0-3eb5-4f31-acb1-a206a3beb9f6 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:36:32.577612 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1810b0-3eb5-4f31-acb1-a206a3beb9f6 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:36:32.577891 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1810b0-3eb5-4f31-acb1-a206a3beb9f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:36:32.596670 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-2d1810b0-3eb5-4f31-acb1-a206a3beb9f6 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:36:32.597867 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-2d1810b0-3eb5-4f31-acb1-a206a3beb9f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:36:32.606379 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1388/2785] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:36:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:36:32.610409 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917024a0-a49b-4913-a83e-0f8ae68bcd7f None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:36:32.620124 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917024a0-a49b-4913-a83e-0f8ae68bcd7f None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:36:32.624749 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404bf643-c066-4260-aca3-bb7cfff95a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:36:32.625400 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404bf643-c066-4260-aca3-bb7cfff95a5c admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:36:32.625683 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404bf643-c066-4260-aca3-bb7cfff95a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:36:32.625957 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404bf643-c066-4260-aca3-bb7cfff95a5c admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:36:32.626683 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404bf643-c066-4260-aca3-bb7cfff95a5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:36:32.626989 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404bf643-c066-4260-aca3-bb7cfff95a5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:36:32.628626 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404bf643-c066-4260-aca3-bb7cfff95a5c admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:36:32.639770 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1398/2786] 10.222.0.24 () {58 vars in 1152 bytes} [Thu Apr 7 06:36:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:36:32.643617 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1810b0-3eb5-4f31-acb1-a206a3beb9f6 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:36:32.653350 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1810b0-3eb5-4f31-acb1-a206a3beb9f6 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:36:32.658168 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed4fd19-bd76-4704-a2b2-f386745a8829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:36:32.658817 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4fd19-bd76-4704-a2b2-f386745a8829 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:36:32.659101 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4fd19-bd76-4704-a2b2-f386745a8829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:36:32.659379 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4fd19-bd76-4704-a2b2-f386745a8829 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:36:32.660139 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed4fd19-bd76-4704-a2b2-f386745a8829 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:36:32.662674 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed4fd19-bd76-4704-a2b2-f386745a8829 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:36:32.773801 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1389/2787] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:36:32 2022] POST /identity/v3/projects => generated 373 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:36:32.781919 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404bf643-c066-4260-aca3-bb7cfff95a5c admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:36:32.791627 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404bf643-c066-4260-aca3-bb7cfff95a5c admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:36:32.846972 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9495c8-f643-4a71-8baf-227b0fea71cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:36:32.847392 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9495c8-f643-4a71-8baf-227b0fea71cb admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:36:32.847685 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9495c8-f643-4a71-8baf-227b0fea71cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:36:32.847990 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9495c8-f643-4a71-8baf-227b0fea71cb admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:36:32.848683 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9495c8-f643-4a71-8baf-227b0fea71cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:36:32.850626 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9495c8-f643-4a71-8baf-227b0fea71cb admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:36:32.944026 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1399/2788] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:36:32 2022] POST /identity/v3/users => generated 287 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:36:32.948032 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed4fd19-bd76-4704-a2b2-f386745a8829 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:36:32.958789 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed4fd19-bd76-4704-a2b2-f386745a8829 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:36:32.963460 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a0b33-8bc5-486d-a474-10d519a0c016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:36:32.964210 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a0b33-8bc5-486d-a474-10d519a0c016 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:36:32.964495 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a0b33-8bc5-486d-a474-10d519a0c016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:36:32.964767 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a0b33-8bc5-486d-a474-10d519a0c016 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:36:32.965489 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318a0b33-8bc5-486d-a474-10d519a0c016 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:36:32.967077 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318a0b33-8bc5-486d-a474-10d519a0c016 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:36:32.978034 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1390/2789] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:36:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:36:32.982000 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9495c8-f643-4a71-8baf-227b0fea71cb admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:36:32.992132 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9495c8-f643-4a71-8baf-227b0fea71cb admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:36:32.997064 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b563fada-601e-4e67-8506-a3359107b2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:36:32.997610 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563fada-601e-4e67-8506-a3359107b2be admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:36:32.997893 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563fada-601e-4e67-8506-a3359107b2be admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:36:32.998206 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563fada-601e-4e67-8506-a3359107b2be admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:36:32.998876 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b563fada-601e-4e67-8506-a3359107b2be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:36:33.000628 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b563fada-601e-4e67-8506-a3359107b2be admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:36:33.013188 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1400/2790] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:36:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:36:33.017114 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a0b33-8bc5-486d-a474-10d519a0c016 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:36:33.027451 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a0b33-8bc5-486d-a474-10d519a0c016 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:36:33.037041 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5979f-2927-4e5e-9938-df5806da087f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:36:33.037922 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5979f-2927-4e5e-9938-df5806da087f admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:36:33.038201 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5979f-2927-4e5e-9938-df5806da087f admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:36:33.038471 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5979f-2927-4e5e-9938-df5806da087f admin admin] PATH_INFO: `/v3/projects/b201a41ba3394cdebeda4fb3574ada20/users/48d1138f80644f52a147dfb4a74cb924/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:36:33.053896 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d5979f-2927-4e5e-9938-df5806da087f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b201a41ba3394cdebeda4fb3574ada20, user_id=48d1138f80644f52a147dfb4a74cb924, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:36:33.056670 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d5979f-2927-4e5e-9938-df5806da087f admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:36:33.126121 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1391/2791] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:36:33 2022] PUT /identity/v3/projects/b201a41ba3394cdebeda4fb3574ada20/users/48d1138f80644f52a147dfb4a74cb924/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:36:33.131779 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9eb133-ecee-4c79-b7a8-b383f6827460 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:36:33.133883 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9eb133-ecee-4c79-b7a8-b383f6827460 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:36:33.133883 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9eb133-ecee-4c79-b7a8-b383f6827460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:36:33.150276 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-3a9eb133-ecee-4c79-b7a8-b383f6827460 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:36:33.151451 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-3a9eb133-ecee-4c79-b7a8-b383f6827460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:36:33.207724 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1401/2792] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:36:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:36:33.217259 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5979f-2927-4e5e-9938-df5806da087f admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:36:33.219067 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-f3d5979f-2927-4e5e-9938-df5806da087f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:36:33.274513 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5979f-2927-4e5e-9938-df5806da087f admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:36:33.278136 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8701db04-0b8e-407d-b140-c9743c78ebc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:36:33.278776 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701db04-0b8e-407d-b140-c9743c78ebc0 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:36:33.279063 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701db04-0b8e-407d-b140-c9743c78ebc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:36:33.279414 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701db04-0b8e-407d-b140-c9743c78ebc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:36:33.288240 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8701db04-0b8e-407d-b140-c9743c78ebc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:36:33.289670 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8701db04-0b8e-407d-b140-c9743c78ebc0 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:36:33.299272 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1392/2793] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:36:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:36:38.763508 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a78790-f8ac-4e19-93fc-9ad219ed83cf None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:36:38.763994 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a78790-f8ac-4e19-93fc-9ad219ed83cf None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:36:38.764103 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a78790-f8ac-4e19-93fc-9ad219ed83cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:36:38.794362 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-89a78790-f8ac-4e19-93fc-9ad219ed83cf None None] MFA Rules not processed for user `48d1138f80644f52a147dfb4a74cb924`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:36:38.795622 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-89a78790-f8ac-4e19-93fc-9ad219ed83cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:36:38.868497 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1402/2794] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:36:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:36:38.872975 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8701db04-0b8e-407d-b140-c9743c78ebc0 service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:36:38.882938 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8701db04-0b8e-407d-b140-c9743c78ebc0 service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:36:38.887699 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279addab-d668-46f3-bdc3-751148f4c362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:36:38.888457 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279addab-d668-46f3-bdc3-751148f4c362 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:36:38.888749 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279addab-d668-46f3-bdc3-751148f4c362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:36:38.889030 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279addab-d668-46f3-bdc3-751148f4c362 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:36:38.889740 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279addab-d668-46f3-bdc3-751148f4c362 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:36:38.891659 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279addab-d668-46f3-bdc3-751148f4c362 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:36:38.987999 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1393/2795] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:36:38 2022] POST /identity/v3/projects => generated 373 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:36:38.991087 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a78790-f8ac-4e19-93fc-9ad219ed83cf None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:36:39.004268 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a78790-f8ac-4e19-93fc-9ad219ed83cf None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:36:39.070553 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb4f231-133d-4377-9a48-984d828b558e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:36:39.071244 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb4f231-133d-4377-9a48-984d828b558e admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:36:39.071566 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb4f231-133d-4377-9a48-984d828b558e admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:36:39.071923 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb4f231-133d-4377-9a48-984d828b558e admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:36:39.072629 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb4f231-133d-4377-9a48-984d828b558e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:36:39.074621 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb4f231-133d-4377-9a48-984d828b558e admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:36:39.211572 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1403/2796] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:36:38 2022] POST /identity/v3/users => generated 293 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:36:39.215773 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279addab-d668-46f3-bdc3-751148f4c362 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:36:39.226374 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279addab-d668-46f3-bdc3-751148f4c362 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:36:39.230954 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00478c2-e891-4a42-835f-2b404c8fa776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:36:39.231629 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00478c2-e891-4a42-835f-2b404c8fa776 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:36:39.232065 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00478c2-e891-4a42-835f-2b404c8fa776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:36:39.232346 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00478c2-e891-4a42-835f-2b404c8fa776 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:36:39.233110 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00478c2-e891-4a42-835f-2b404c8fa776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:36:39.234796 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00478c2-e891-4a42-835f-2b404c8fa776 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:36:39.245399 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1394/2797] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:36:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:36:39.249763 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb4f231-133d-4377-9a48-984d828b558e admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:36:39.259872 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb4f231-133d-4377-9a48-984d828b558e admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:36:39.264581 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d4e61-6a33-4b89-a8a0-4be06885e70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:36:39.270046 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d4e61-6a33-4b89-a8a0-4be06885e70d admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:36:39.270046 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d4e61-6a33-4b89-a8a0-4be06885e70d admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:36:39.270046 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d4e61-6a33-4b89-a8a0-4be06885e70d admin admin] PATH_INFO: `/v3/projects/645c42f1a0464b3b8460688ccf3cfb16/users/878a52701a3d452fb367b9aaf59bec3d/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:36:39.280996 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54d4e61-6a33-4b89-a8a0-4be06885e70d admin admin] RBAC: Authorizing `identity:create_grant(project_id=645c42f1a0464b3b8460688ccf3cfb16, user_id=878a52701a3d452fb367b9aaf59bec3d, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:36:39.283717 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54d4e61-6a33-4b89-a8a0-4be06885e70d admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:36:39.376548 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1404/2798] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:36:39 2022] PUT /identity/v3/projects/645c42f1a0464b3b8460688ccf3cfb16/users/878a52701a3d452fb367b9aaf59bec3d/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:36:39.380838 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00478c2-e891-4a42-835f-2b404c8fa776 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:36:39.390654 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00478c2-e891-4a42-835f-2b404c8fa776 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:36:39.447458 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064abd5d-9060-4a2c-8564-6b9ce6a46cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:36:39.448169 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064abd5d-9060-4a2c-8564-6b9ce6a46cb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:36:39.448453 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064abd5d-9060-4a2c-8564-6b9ce6a46cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:36:39.448760 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064abd5d-9060-4a2c-8564-6b9ce6a46cb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:36:39.449483 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064abd5d-9060-4a2c-8564-6b9ce6a46cb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:36:39.451267 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064abd5d-9060-4a2c-8564-6b9ce6a46cb0 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:36:39.461511 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1395/2799] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:36:39 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:36:39.465707 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d4e61-6a33-4b89-a8a0-4be06885e70d admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:36:39.475930 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d4e61-6a33-4b89-a8a0-4be06885e70d admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:36:39.480822 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183f781-1893-4a03-848b-4851de46d052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:36:39.481739 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183f781-1893-4a03-848b-4851de46d052 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:36:39.482023 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183f781-1893-4a03-848b-4851de46d052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:36:39.482300 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183f781-1893-4a03-848b-4851de46d052 admin admin] PATH_INFO: `/v3/projects/645c42f1a0464b3b8460688ccf3cfb16/users/878a52701a3d452fb367b9aaf59bec3d/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:36:39.484360 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5183f781-1893-4a03-848b-4851de46d052 admin admin] RBAC: Authorizing `identity:create_grant(project_id=645c42f1a0464b3b8460688ccf3cfb16, user_id=878a52701a3d452fb367b9aaf59bec3d, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:36:39.486985 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5183f781-1893-4a03-848b-4851de46d052 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:36:39.497449 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1405/2800] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:36:39 2022] PUT /identity/v3/projects/645c42f1a0464b3b8460688ccf3cfb16/users/878a52701a3d452fb367b9aaf59bec3d/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:36:45.133768 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31b496-9424-4735-8dc7-61f5df4c5f88 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:36:45.134217 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31b496-9424-4735-8dc7-61f5df4c5f88 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:36:45.134416 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31b496-9424-4735-8dc7-61f5df4c5f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:36:45.175246 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-8d31b496-9424-4735-8dc7-61f5df4c5f88 None None] MFA Rules not processed for user `878a52701a3d452fb367b9aaf59bec3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:36:45.175246 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-8d31b496-9424-4735-8dc7-61f5df4c5f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:36:45.246551 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1396/2801] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:36:45 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:36:45.257723 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183f781-1893-4a03-848b-4851de46d052 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:36:45.259615 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-5183f781-1893-4a03-848b-4851de46d052 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:36:45.337383 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183f781-1893-4a03-848b-4851de46d052 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:36:45.350434 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a05ce0-44af-475c-afc5-1ee8c4936cf2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cd81f6620f410db450871fb29961f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:36:45.350434 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a05ce0-44af-475c-afc5-1ee8c4936cf2 service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:36:45.350434 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a05ce0-44af-475c-afc5-1ee8c4936cf2 service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:36:45.350434 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a05ce0-44af-475c-afc5-1ee8c4936cf2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:36:45.402393 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a05ce0-44af-475c-afc5-1ee8c4936cf2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:36:45.404049 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a05ce0-44af-475c-afc5-1ee8c4936cf2 service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:36:45.415294 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1406/2802] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:36:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:36:48.350169 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43998a12-36f5-4f80-88a3-88058ee1ac4a None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:36:48.350708 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43998a12-36f5-4f80-88a3-88058ee1ac4a None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:36:48.350708 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43998a12-36f5-4f80-88a3-88058ee1ac4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:36:48.369120 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-43998a12-36f5-4f80-88a3-88058ee1ac4a None None] MFA Rules not processed for user `48d1138f80644f52a147dfb4a74cb924`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:36:48.372646 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-43998a12-36f5-4f80-88a3-88058ee1ac4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:36:48.377500 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1397/2803] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:36:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:37:21.663118 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a05ce0-44af-475c-afc5-1ee8c4936cf2 service nova] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:37:21.664515 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-18a05ce0-44af-475c-afc5-1ee8c4936cf2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:37:21.729988 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a05ce0-44af-475c-afc5-1ee8c4936cf2 service nova] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:37:21.734658 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10fc4c3-74bf-4380-99b9-1643dcba361d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:37:21.735640 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10fc4c3-74bf-4380-99b9-1643dcba361d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:37:21.736023 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10fc4c3-74bf-4380-99b9-1643dcba361d admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:37:21.736366 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10fc4c3-74bf-4380-99b9-1643dcba361d admin admin] PATH_INFO: `/v3/users/e09795a9e20745578e640e6cae4aa376` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:37:21.737628 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10fc4c3-74bf-4380-99b9-1643dcba361d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e09795a9e20745578e640e6cae4aa376)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:37:21.739619 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10fc4c3-74bf-4380-99b9-1643dcba361d admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:37:21.915598 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a10fc4c3-74bf-4380-99b9-1643dcba361d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e09795a9e20745578e640e6cae4aa376'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:37:21.926960 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a10fc4c3-74bf-4380-99b9-1643dcba361d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e09795a9e20745578e640e6cae4aa376'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:37:21.993651 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a10fc4c3-74bf-4380-99b9-1643dcba361d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e09795a9e20745578e640e6cae4aa376'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:37:21.998406 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a10fc4c3-74bf-4380-99b9-1643dcba361d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e09795a9e20745578e640e6cae4aa376'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:37:21.998406 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a10fc4c3-74bf-4380-99b9-1643dcba361d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e09795a9e20745578e640e6cae4aa376'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:37:22.007330 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1407/2804] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:37:21 2022] DELETE /identity/v3/users/e09795a9e20745578e640e6cae4aa376 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:37:22.011859 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fcec2f-a4dc-43e0-b208-677000278930 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:37:22.012377 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fcec2f-a4dc-43e0-b208-677000278930 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:37:22.012485 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fcec2f-a4dc-43e0-b208-677000278930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:37:22.029222 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-17fcec2f-a4dc-43e0-b208-677000278930 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:37:22.030400 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-17fcec2f-a4dc-43e0-b208-677000278930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:37:22.085160 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1398/2805] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:37:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 07 06:37:22.094616 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10fc4c3-74bf-4380-99b9-1643dcba361d admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:37:22.096024 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a10fc4c3-74bf-4380-99b9-1643dcba361d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:37:22.150911 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10fc4c3-74bf-4380-99b9-1643dcba361d admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:37:22.154595 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0076f064-1640-4eed-a2cc-7239d9fe5d02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:37:22.155239 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076f064-1640-4eed-a2cc-7239d9fe5d02 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:37:22.155526 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076f064-1640-4eed-a2cc-7239d9fe5d02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:37:22.155842 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076f064-1640-4eed-a2cc-7239d9fe5d02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:37:22.165230 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0076f064-1640-4eed-a2cc-7239d9fe5d02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:37:22.166696 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0076f064-1640-4eed-a2cc-7239d9fe5d02 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:37:22.175956 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1408/2806] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:37:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:37:22.564768 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fcec2f-a4dc-43e0-b208-677000278930 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:37:22.566192 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-17fcec2f-a4dc-43e0-b208-677000278930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:37:22.578366 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fcec2f-a4dc-43e0-b208-677000278930 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:37:22.583507 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6691b4-a954-47e2-b591-33f945866de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:37:22.584959 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6691b4-a954-47e2-b591-33f945866de3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:37:22.585248 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6691b4-a954-47e2-b591-33f945866de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:37:22.585532 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6691b4-a954-47e2-b591-33f945866de3 admin admin] PATH_INFO: `/v3/projects/400a1b0169e44252b21e0ed455c83efa` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:37:22.586850 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6691b4-a954-47e2-b591-33f945866de3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=400a1b0169e44252b21e0ed455c83efa)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:37:22.588815 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6691b4-a954-47e2-b591-33f945866de3 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:37:22.689983 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-df6691b4-a954-47e2-b591-33f945866de3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '400a1b0169e44252b21e0ed455c83efa', 'request_id': 'req-df6691b4-a954-47e2-b591-33f945866de3'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:37:22.696033 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-df6691b4-a954-47e2-b591-33f945866de3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '400a1b0169e44252b21e0ed455c83efa', 'request_id': 'req-df6691b4-a954-47e2-b591-33f945866de3'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:37:22.770858 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-df6691b4-a954-47e2-b591-33f945866de3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '400a1b0169e44252b21e0ed455c83efa', 'request_id': 'req-df6691b4-a954-47e2-b591-33f945866de3'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:37:22.783488 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-df6691b4-a954-47e2-b591-33f945866de3 admin admin] The token cache is being invalidate because project 400a1b0169e44252b21e0ed455c83efa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:37:22.789133 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-df6691b4-a954-47e2-b591-33f945866de3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:37:22.789133 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-df6691b4-a954-47e2-b591-33f945866de3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:37:22.789133 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1399/2807] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:37:22 2022] DELETE /identity/v3/projects/400a1b0169e44252b21e0ed455c83efa => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:37:22.791228 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb0ced-00fd-4e0f-a624-ba653d64d0ce None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:37:22.791711 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb0ced-00fd-4e0f-a624-ba653d64d0ce None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:37:22.791864 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb0ced-00fd-4e0f-a624-ba653d64d0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:37:22.810132 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-83bb0ced-00fd-4e0f-a624-ba653d64d0ce None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:37:22.811517 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-83bb0ced-00fd-4e0f-a624-ba653d64d0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:37:22.874931 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1409/2808] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:37:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:37:22.884379 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef4d31-d7e7-4f00-9ec8-a167f92250ee None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:37:22.884688 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef4d31-d7e7-4f00-9ec8-a167f92250ee None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:37:22.885169 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef4d31-d7e7-4f00-9ec8-a167f92250ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:37:22.904160 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-aaef4d31-d7e7-4f00-9ec8-a167f92250ee None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:37:22.905354 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-aaef4d31-d7e7-4f00-9ec8-a167f92250ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:37:22.913619 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1400/2809] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:37:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:37:22.917786 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb0ced-00fd-4e0f-a624-ba653d64d0ce None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:37:22.927343 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb0ced-00fd-4e0f-a624-ba653d64d0ce None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:37:22.931937 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcd8cbf-5840-46d9-8a05-10c7916bb269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:37:22.932584 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd8cbf-5840-46d9-8a05-10c7916bb269 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:37:22.932885 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd8cbf-5840-46d9-8a05-10c7916bb269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:37:22.933143 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd8cbf-5840-46d9-8a05-10c7916bb269 admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:37:22.933889 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcd8cbf-5840-46d9-8a05-10c7916bb269 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:37:22.934195 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcd8cbf-5840-46d9-8a05-10c7916bb269 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:37:22.935867 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcd8cbf-5840-46d9-8a05-10c7916bb269 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:37:22.946936 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1410/2810] 10.222.0.24 () {58 vars in 1152 bytes} [Thu Apr 7 06:37:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:37:22.951120 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaef4d31-d7e7-4f00-9ec8-a167f92250ee None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:37:22.960690 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaef4d31-d7e7-4f00-9ec8-a167f92250ee None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:37:22.965269 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7051fa-66bc-486c-8719-480b50835b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:37:22.965916 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7051fa-66bc-486c-8719-480b50835b45 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:37:22.966201 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7051fa-66bc-486c-8719-480b50835b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:37:22.966479 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7051fa-66bc-486c-8719-480b50835b45 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:37:22.967196 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7051fa-66bc-486c-8719-480b50835b45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:37:22.969120 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7051fa-66bc-486c-8719-480b50835b45 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:37:23.046232 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1401/2811] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:37:22 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:37:23.050362 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcd8cbf-5840-46d9-8a05-10c7916bb269 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:37:23.059994 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcd8cbf-5840-46d9-8a05-10c7916bb269 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:37:23.113103 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd639c-b3e0-4777-98ba-ad5153f107bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:37:23.113773 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd639c-b3e0-4777-98ba-ad5153f107bd admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:37:23.114056 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd639c-b3e0-4777-98ba-ad5153f107bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:37:23.114330 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd639c-b3e0-4777-98ba-ad5153f107bd admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:37:23.115299 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfd639c-b3e0-4777-98ba-ad5153f107bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:37:23.117265 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfd639c-b3e0-4777-98ba-ad5153f107bd admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:37:23.208783 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1411/2812] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:37:23 2022] POST /identity/v3/users => generated 293 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:37:23.213152 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7051fa-66bc-486c-8719-480b50835b45 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:37:23.223190 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7051fa-66bc-486c-8719-480b50835b45 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:37:23.228489 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb7dc1b-4747-4dc7-a34c-02634cb7abcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:37:23.229257 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7dc1b-4747-4dc7-a34c-02634cb7abcb admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:37:23.229544 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7dc1b-4747-4dc7-a34c-02634cb7abcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:37:23.229822 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7dc1b-4747-4dc7-a34c-02634cb7abcb admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:37:23.230545 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb7dc1b-4747-4dc7-a34c-02634cb7abcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:37:23.232198 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb7dc1b-4747-4dc7-a34c-02634cb7abcb admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:37:23.243376 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1402/2813] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:37:23.247219 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd639c-b3e0-4777-98ba-ad5153f107bd admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:37:23.257219 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd639c-b3e0-4777-98ba-ad5153f107bd admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:37:23.261748 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98a00b-84a9-4ded-8f2c-d4ddfd33185e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:37:23.262390 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98a00b-84a9-4ded-8f2c-d4ddfd33185e admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:37:23.262672 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98a00b-84a9-4ded-8f2c-d4ddfd33185e admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:37:23.262943 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98a00b-84a9-4ded-8f2c-d4ddfd33185e admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:37:23.263652 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d98a00b-84a9-4ded-8f2c-d4ddfd33185e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:37:23.265242 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d98a00b-84a9-4ded-8f2c-d4ddfd33185e admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:37:23.275417 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1412/2814] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 07 06:37:23.279874 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb7dc1b-4747-4dc7-a34c-02634cb7abcb admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:37:23.289380 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb7dc1b-4747-4dc7-a34c-02634cb7abcb admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:37:23.293899 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f92846-1a25-44b8-8b89-3184723a7e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:37:23.294762 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f92846-1a25-44b8-8b89-3184723a7e02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:37:23.295048 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f92846-1a25-44b8-8b89-3184723a7e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:37:23.295324 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f92846-1a25-44b8-8b89-3184723a7e02 admin admin] PATH_INFO: `/v3/projects/5bf029a696e342f0b6f7818e2cdcd902/users/2e4802992e264211905f6afd982ee70e/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:37:23.309223 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f92846-1a25-44b8-8b89-3184723a7e02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bf029a696e342f0b6f7818e2cdcd902, user_id=2e4802992e264211905f6afd982ee70e, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:37:23.311864 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f92846-1a25-44b8-8b89-3184723a7e02 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:37:23.410520 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1403/2815] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:37:23 2022] PUT /identity/v3/projects/5bf029a696e342f0b6f7818e2cdcd902/users/2e4802992e264211905f6afd982ee70e/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:37:23.415651 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1991a3-2a4a-4e65-ab67-a3146b214ad7 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:37:23.415974 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1991a3-2a4a-4e65-ab67-a3146b214ad7 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:37:23.416257 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1991a3-2a4a-4e65-ab67-a3146b214ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:37:23.433464 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-1b1991a3-2a4a-4e65-ab67-a3146b214ad7 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:37:23.434657 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-1b1991a3-2a4a-4e65-ab67-a3146b214ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:37:23.491411 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1413/2816] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:37:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:37:23.500927 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f92846-1a25-44b8-8b89-3184723a7e02 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:37:23.502595 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d5f92846-1a25-44b8-8b89-3184723a7e02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:37:23.556799 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f92846-1a25-44b8-8b89-3184723a7e02 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:37:23.560428 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b851d-80c8-4f88-a6f8-d367be801438 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:37:23.561066 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b851d-80c8-4f88-a6f8-d367be801438 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:37:23.561350 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b851d-80c8-4f88-a6f8-d367be801438 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:37:23.561623 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b851d-80c8-4f88-a6f8-d367be801438 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:37:23.570907 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69b851d-80c8-4f88-a6f8-d367be801438 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:37:23.572379 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69b851d-80c8-4f88-a6f8-d367be801438 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:37:23.581526 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1404/2817] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:37:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:37:29.097670 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb885a1-2ba4-4dad-b68d-ebfd71a26c6c None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:37:29.098249 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb885a1-2ba4-4dad-b68d-ebfd71a26c6c None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:37:29.098466 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb885a1-2ba4-4dad-b68d-ebfd71a26c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:37:29.127736 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-4eb885a1-2ba4-4dad-b68d-ebfd71a26c6c None None] MFA Rules not processed for user `2e4802992e264211905f6afd982ee70e`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:37:29.129310 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-4eb885a1-2ba4-4dad-b68d-ebfd71a26c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:37:29.204301 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1414/2818] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:37:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:37:29.208802 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b851d-80c8-4f88-a6f8-d367be801438 service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:37:29.218539 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b851d-80c8-4f88-a6f8-d367be801438 service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:37:29.223258 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a534e67-4df3-4b6c-9027-5e4b7e167065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:37:29.224148 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a534e67-4df3-4b6c-9027-5e4b7e167065 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:37:29.225077 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a534e67-4df3-4b6c-9027-5e4b7e167065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:37:29.225355 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a534e67-4df3-4b6c-9027-5e4b7e167065 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:37:29.226063 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a534e67-4df3-4b6c-9027-5e4b7e167065 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:37:29.227975 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a534e67-4df3-4b6c-9027-5e4b7e167065 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:37:29.342816 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1405/2819] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:37:29 2022] POST /identity/v3/projects => generated 385 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:37:29.347123 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb885a1-2ba4-4dad-b68d-ebfd71a26c6c None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:37:29.358503 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb885a1-2ba4-4dad-b68d-ebfd71a26c6c None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:37:29.414314 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f8ce6-0974-48f0-9ccd-9a09143d1028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:37:29.415043 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f8ce6-0974-48f0-9ccd-9a09143d1028 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:37:29.415328 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f8ce6-0974-48f0-9ccd-9a09143d1028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:37:29.415602 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f8ce6-0974-48f0-9ccd-9a09143d1028 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:37:29.416348 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f8ce6-0974-48f0-9ccd-9a09143d1028 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:37:29.418278 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f8ce6-0974-48f0-9ccd-9a09143d1028 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:37:29.491632 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1415/2820] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:37:29 2022] POST /identity/v3/users => generated 299 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:37:29.495643 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a534e67-4df3-4b6c-9027-5e4b7e167065 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:37:29.506481 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a534e67-4df3-4b6c-9027-5e4b7e167065 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:37:29.511235 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe12ad-afdf-4e3c-90af-cf0ac969c287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:37:29.511926 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe12ad-afdf-4e3c-90af-cf0ac969c287 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:37:29.512214 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe12ad-afdf-4e3c-90af-cf0ac969c287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:37:29.512488 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe12ad-afdf-4e3c-90af-cf0ac969c287 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:37:29.513240 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafe12ad-afdf-4e3c-90af-cf0ac969c287 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:37:29.514828 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafe12ad-afdf-4e3c-90af-cf0ac969c287 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:37:29.525865 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1406/2821] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:37:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:37:29.530038 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f8ce6-0974-48f0-9ccd-9a09143d1028 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:37:29.540375 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f8ce6-0974-48f0-9ccd-9a09143d1028 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:37:29.544959 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb21fe1-8814-4f67-a9b6-8f9e225da3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:37:29.545831 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb21fe1-8814-4f67-a9b6-8f9e225da3a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:37:29.546118 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb21fe1-8814-4f67-a9b6-8f9e225da3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:37:29.546397 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb21fe1-8814-4f67-a9b6-8f9e225da3a8 admin admin] PATH_INFO: `/v3/projects/15efb0719ab14d9ebfd788968fc100d2/users/dcf4889e31714ddb96b4ca6e0189d2f4/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:37:29.560376 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb21fe1-8814-4f67-a9b6-8f9e225da3a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15efb0719ab14d9ebfd788968fc100d2, user_id=dcf4889e31714ddb96b4ca6e0189d2f4, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:37:29.563048 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb21fe1-8814-4f67-a9b6-8f9e225da3a8 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:37:29.645468 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1416/2822] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:37:29 2022] PUT /identity/v3/projects/15efb0719ab14d9ebfd788968fc100d2/users/dcf4889e31714ddb96b4ca6e0189d2f4/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:37:29.649945 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe12ad-afdf-4e3c-90af-cf0ac969c287 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:37:29.659775 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe12ad-afdf-4e3c-90af-cf0ac969c287 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:37:29.715695 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea5ffd-71c7-410c-9e09-439b65781515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:37:29.716403 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea5ffd-71c7-410c-9e09-439b65781515 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:37:29.716691 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea5ffd-71c7-410c-9e09-439b65781515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:37:29.716968 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea5ffd-71c7-410c-9e09-439b65781515 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:37:29.717704 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bea5ffd-71c7-410c-9e09-439b65781515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:37:29.719390 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bea5ffd-71c7-410c-9e09-439b65781515 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:37:29.730573 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1407/2823] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:37:29 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:37:29.734526 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb21fe1-8814-4f67-a9b6-8f9e225da3a8 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:37:29.745262 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb21fe1-8814-4f67-a9b6-8f9e225da3a8 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:37:29.749995 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ba3d7d-0292-414e-933f-804e7c7af83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:37:29.750875 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba3d7d-0292-414e-933f-804e7c7af83f admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:37:29.751154 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba3d7d-0292-414e-933f-804e7c7af83f admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:37:29.751424 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba3d7d-0292-414e-933f-804e7c7af83f admin admin] PATH_INFO: `/v3/projects/15efb0719ab14d9ebfd788968fc100d2/users/dcf4889e31714ddb96b4ca6e0189d2f4/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:37:29.753402 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ba3d7d-0292-414e-933f-804e7c7af83f admin admin] RBAC: Authorizing `identity:create_grant(project_id=15efb0719ab14d9ebfd788968fc100d2, user_id=dcf4889e31714ddb96b4ca6e0189d2f4, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:37:29.756547 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ba3d7d-0292-414e-933f-804e7c7af83f admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:37:29.769874 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1417/2824] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:37:29 2022] PUT /identity/v3/projects/15efb0719ab14d9ebfd788968fc100d2/users/dcf4889e31714ddb96b4ca6e0189d2f4/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 07 06:37:35.512242 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f156a02-4a48-456d-8832-aef122d3fadc None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:37:35.514576 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f156a02-4a48-456d-8832-aef122d3fadc None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:37:35.514758 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f156a02-4a48-456d-8832-aef122d3fadc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:37:35.547703 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-2f156a02-4a48-456d-8832-aef122d3fadc None None] MFA Rules not processed for user `dcf4889e31714ddb96b4ca6e0189d2f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:37:35.549189 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-2f156a02-4a48-456d-8832-aef122d3fadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:37:35.641751 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1408/2825] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:37:35 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:37:35.657667 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ba3d7d-0292-414e-933f-804e7c7af83f admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:37:35.662958 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b7ba3d7d-0292-414e-933f-804e7c7af83f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:37:35.736612 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ba3d7d-0292-414e-933f-804e7c7af83f admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:37:35.741378 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9a5fb7-e183-4cff-ae58-2ca4dbe13826 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca88debdfcc4a9d918e3b0138a9add1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:37:35.742041 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a5fb7-e183-4cff-ae58-2ca4dbe13826 service glance] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:37:35.742373 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a5fb7-e183-4cff-ae58-2ca4dbe13826 service glance] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:37:35.742662 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a5fb7-e183-4cff-ae58-2ca4dbe13826 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:37:35.806428 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f156a02-4a48-456d-8832-aef122d3fadc None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:37:35.807946 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-2f156a02-4a48-456d-8832-aef122d3fadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:37:35.821268 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9a5fb7-e183-4cff-ae58-2ca4dbe13826 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:37:35.823009 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9a5fb7-e183-4cff-ae58-2ca4dbe13826 service glance] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:37:35.836229 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1418/2826] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:37:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:37:35.888693 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f156a02-4a48-456d-8832-aef122d3fadc None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:37:35.899403 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9066d94-6dc8-40cf-af9c-b96793c6f916 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:37:35.900242 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9066d94-6dc8-40cf-af9c-b96793c6f916 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:37:35.900535 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9066d94-6dc8-40cf-af9c-b96793c6f916 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:37:35.900893 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9066d94-6dc8-40cf-af9c-b96793c6f916 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:37:35.903071 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d9066d94-6dc8-40cf-af9c-b96793c6f916 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:37:35.976421 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9066d94-6dc8-40cf-af9c-b96793c6f916 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:37:35.979343 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9066d94-6dc8-40cf-af9c-b96793c6f916 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:37:35.994397 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1409/2827] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:37:35 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:37:36.173387 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd854277-08a9-45de-abf3-71b3da6dbe3a None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:37:36.173680 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd854277-08a9-45de-abf3-71b3da6dbe3a None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:37:36.173962 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd854277-08a9-45de-abf3-71b3da6dbe3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:37:36.194123 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-dd854277-08a9-45de-abf3-71b3da6dbe3a None None] MFA Rules not processed for user `f4435fb14c3844728531af63993f78c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:37:36.195351 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-dd854277-08a9-45de-abf3-71b3da6dbe3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:37:36.271944 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1419/2828] 10.222.0.24 () {58 vars in 1009 bytes} [Thu Apr 7 06:37:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:37:36.465602 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9066d94-6dc8-40cf-af9c-b96793c6f916 service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:37:36.467620 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d9066d94-6dc8-40cf-af9c-b96793c6f916 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:37:36.545459 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9066d94-6dc8-40cf-af9c-b96793c6f916 service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:37:36.552190 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eeecb5-a664-4d22-8ca3-940917081585 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4abbb8c5324b7babd69e3b4473b3e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:37:36.553479 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eeecb5-a664-4d22-8ca3-940917081585 service swift] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:37:36.553812 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eeecb5-a664-4d22-8ca3-940917081585 service swift] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:37:36.554097 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eeecb5-a664-4d22-8ca3-940917081585 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:37:36.564075 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eeecb5-a664-4d22-8ca3-940917081585 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:37:36.574706 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eeecb5-a664-4d22-8ca3-940917081585 service swift] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:37:36.578396 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1410/2829] 10.222.0.24 () {60 vars in 1384 bytes} [Thu Apr 7 06:37:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 07 06:37:47.368032 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bdffa8-beff-45a7-8c5b-0242cd3d8eaa None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:37:47.368577 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bdffa8-beff-45a7-8c5b-0242cd3d8eaa None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:37:47.368577 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bdffa8-beff-45a7-8c5b-0242cd3d8eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:37:47.385727 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-b3bdffa8-beff-45a7-8c5b-0242cd3d8eaa None None] MFA Rules not processed for user `2e4802992e264211905f6afd982ee70e`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:37:47.386947 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b3bdffa8-beff-45a7-8c5b-0242cd3d8eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:37:47.393848 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1420/2830] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:37:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:37:47.429040 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eeecb5-a664-4d22-8ca3-940917081585 service swift] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:37:47.438054 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eeecb5-a664-4d22-8ca3-940917081585 service swift] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:37:47.441613 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7eb71c-b378-44b2-bfed-d972843cc72b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca88debdfcc4a9d918e3b0138a9add1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:37:47.442246 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7eb71c-b378-44b2-bfed-d972843cc72b service glance] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:37:47.442535 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7eb71c-b378-44b2-bfed-d972843cc72b service glance] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:37:47.442812 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7eb71c-b378-44b2-bfed-d972843cc72b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:37:47.444628 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-bd7eb71c-b378-44b2-bfed-d972843cc72b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:37:47.512240 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7eb71c-b378-44b2-bfed-d972843cc72b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:37:47.513669 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7eb71c-b378-44b2-bfed-d972843cc72b service glance] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:37:47.524476 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1411/2831] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:37:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:37:47.748865 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bdffa8-beff-45a7-8c5b-0242cd3d8eaa None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:37:47.758630 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bdffa8-beff-45a7-8c5b-0242cd3d8eaa None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:37:47.762291 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc94ef-4d35-4c5b-8a03-45d7b7a2c20c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:37:47.762940 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc94ef-4d35-4c5b-8a03-45d7b7a2c20c service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:37:47.763346 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc94ef-4d35-4c5b-8a03-45d7b7a2c20c service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:37:47.763628 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc94ef-4d35-4c5b-8a03-45d7b7a2c20c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:37:47.765428 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-64cc94ef-4d35-4c5b-8a03-45d7b7a2c20c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:37:47.775627 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc94ef-4d35-4c5b-8a03-45d7b7a2c20c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:37:47.777068 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc94ef-4d35-4c5b-8a03-45d7b7a2c20c service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:37:47.784916 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1421/2832] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:37:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:37:48.189685 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7eb71c-b378-44b2-bfed-d972843cc72b service glance] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:37:48.199150 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7eb71c-b378-44b2-bfed-d972843cc72b service glance] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:37:48.203173 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7689ff-5d0e-42d8-a38f-f1b23628ec46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:37:48.203411 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7689ff-5d0e-42d8-a38f-f1b23628ec46 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:37:48.203693 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7689ff-5d0e-42d8-a38f-f1b23628ec46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:37:48.204002 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7689ff-5d0e-42d8-a38f-f1b23628ec46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:37:48.205788 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-0e7689ff-5d0e-42d8-a38f-f1b23628ec46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:37:48.219364 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7689ff-5d0e-42d8-a38f-f1b23628ec46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:37:48.220900 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7689ff-5d0e-42d8-a38f-f1b23628ec46 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:37:48.234264 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1412/2833] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:37:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:37:51.237426 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d454f-b05b-4245-a856-4cf98c66846a None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:37:51.237925 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d454f-b05b-4245-a856-4cf98c66846a None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:37:51.238049 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d454f-b05b-4245-a856-4cf98c66846a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:37:51.257002 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-4d8d454f-b05b-4245-a856-4cf98c66846a None None] MFA Rules not processed for user `f4435fb14c3844728531af63993f78c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:37:51.257992 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-4d8d454f-b05b-4245-a856-4cf98c66846a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:37:51.265516 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1422/2834] 10.222.0.24 () {58 vars in 1009 bytes} [Thu Apr 7 06:37:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:37:51.282315 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7689ff-5d0e-42d8-a38f-f1b23628ec46 service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:37:51.301042 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7689ff-5d0e-42d8-a38f-f1b23628ec46 service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:37:51.315146 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7066b5-479a-457c-8aa1-80a08dbfc4e1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4abbb8c5324b7babd69e3b4473b3e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:37:51.322774 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7066b5-479a-457c-8aa1-80a08dbfc4e1 service swift] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:37:51.322774 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7066b5-479a-457c-8aa1-80a08dbfc4e1 service swift] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:37:51.322774 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7066b5-479a-457c-8aa1-80a08dbfc4e1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:37:51.329296 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7066b5-479a-457c-8aa1-80a08dbfc4e1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:37:51.330919 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7066b5-479a-457c-8aa1-80a08dbfc4e1 service swift] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:37:51.341292 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1413/2835] 10.222.0.24 () {60 vars in 1384 bytes} [Thu Apr 7 06:37:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 07 06:37:59.620027 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d454f-b05b-4245-a856-4cf98c66846a None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:37:59.635491 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d454f-b05b-4245-a856-4cf98c66846a None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:37:59.639476 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1da649-0a1f-4588-817e-4235fb2c684f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:37:59.640173 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1da649-0a1f-4588-817e-4235fb2c684f service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:37:59.640465 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1da649-0a1f-4588-817e-4235fb2c684f service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:37:59.640741 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1da649-0a1f-4588-817e-4235fb2c684f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:37:59.642510 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-0c1da649-0a1f-4588-817e-4235fb2c684f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:37:59.652214 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1da649-0a1f-4588-817e-4235fb2c684f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:37:59.653617 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1da649-0a1f-4588-817e-4235fb2c684f service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:37:59.662453 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1423/2836] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:37:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:38:17.866530 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7066b5-479a-457c-8aa1-80a08dbfc4e1 service swift] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:38:17.875701 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7066b5-479a-457c-8aa1-80a08dbfc4e1 service swift] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:38:17.879361 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c047f-56e7-4d9c-a64b-2d1491c619bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:38:17.880552 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c047f-56e7-4d9c-a64b-2d1491c619bd service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:38:17.880838 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c047f-56e7-4d9c-a64b-2d1491c619bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:38:17.881114 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c047f-56e7-4d9c-a64b-2d1491c619bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:38:17.889937 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376c047f-56e7-4d9c-a64b-2d1491c619bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:38:17.891357 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376c047f-56e7-4d9c-a64b-2d1491c619bd service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:38:17.901090 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1414/2837] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:38:17 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:38:19.985998 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1da649-0a1f-4588-817e-4235fb2c684f service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:38:19.987415 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-0c1da649-0a1f-4588-817e-4235fb2c684f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:38:20.015241 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1da649-0a1f-4588-817e-4235fb2c684f service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:38:20.015241 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863021bc-baa7-46f9-94e1-74dd79fc7bc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cd81f6620f410db450871fb29961f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:38:20.015241 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863021bc-baa7-46f9-94e1-74dd79fc7bc9 service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:38:20.015241 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863021bc-baa7-46f9-94e1-74dd79fc7bc9 service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:38:20.016091 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863021bc-baa7-46f9-94e1-74dd79fc7bc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:38:20.017557 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-863021bc-baa7-46f9-94e1-74dd79fc7bc9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:38:20.030512 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863021bc-baa7-46f9-94e1-74dd79fc7bc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:38:20.032160 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863021bc-baa7-46f9-94e1-74dd79fc7bc9 service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:38:20.043616 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1424/2838] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:38:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:39:37.721540 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c047f-56e7-4d9c-a64b-2d1491c619bd service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:39:37.793009 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c047f-56e7-4d9c-a64b-2d1491c619bd service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:39:37.799692 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6914e6bc-3bfd-4783-b529-64c2d5d62a91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cd81f6620f410db450871fb29961f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:39:37.800386 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914e6bc-3bfd-4783-b529-64c2d5d62a91 service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:39:37.800769 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914e6bc-3bfd-4783-b529-64c2d5d62a91 service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:39:37.801441 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914e6bc-3bfd-4783-b529-64c2d5d62a91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:39:37.803033 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-6914e6bc-3bfd-4783-b529-64c2d5d62a91 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:39:37.856935 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6914e6bc-3bfd-4783-b529-64c2d5d62a91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:39:37.859076 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6914e6bc-3bfd-4783-b529-64c2d5d62a91 service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:39:37.873470 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1415/2839] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:39:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:39:49.287724 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5406f62-49a5-49f6-86b5-189f57ee1d8c None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:39:49.288265 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5406f62-49a5-49f6-86b5-189f57ee1d8c None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:39:49.288382 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5406f62-49a5-49f6-86b5-189f57ee1d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:39:49.305887 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-f5406f62-49a5-49f6-86b5-189f57ee1d8c None None] MFA Rules not processed for user `f4435fb14c3844728531af63993f78c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:39:49.306997 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f5406f62-49a5-49f6-86b5-189f57ee1d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:39:49.314023 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1425/2840] 10.222.0.24 () {58 vars in 967 bytes} [Thu Apr 7 06:39:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:39:49.353267 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6914e6bc-3bfd-4783-b529-64c2d5d62a91 service nova] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:39:49.364352 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6914e6bc-3bfd-4783-b529-64c2d5d62a91 service nova] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:39:49.370398 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a37c7-de1a-4ada-8182-5a84778ea5a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4abbb8c5324b7babd69e3b4473b3e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:39:49.371040 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a37c7-de1a-4ada-8182-5a84778ea5a9 service swift] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:39:49.371331 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a37c7-de1a-4ada-8182-5a84778ea5a9 service swift] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:39:49.371611 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a37c7-de1a-4ada-8182-5a84778ea5a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:39:49.380112 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40a37c7-de1a-4ada-8182-5a84778ea5a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:39:49.381732 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40a37c7-de1a-4ada-8182-5a84778ea5a9 service swift] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:39:49.390194 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1416/2841] 10.222.0.24 () {60 vars in 1384 bytes} [Thu Apr 7 06:39:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 07 06:39:51.329192 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5406f62-49a5-49f6-86b5-189f57ee1d8c None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:39:51.349374 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5406f62-49a5-49f6-86b5-189f57ee1d8c None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:39:51.353758 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c634fc62-949c-4496-b1bd-3194a967746d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:39:51.354511 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634fc62-949c-4496-b1bd-3194a967746d service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:39:51.354798 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634fc62-949c-4496-b1bd-3194a967746d service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:39:51.355077 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634fc62-949c-4496-b1bd-3194a967746d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:39:51.356893 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c634fc62-949c-4496-b1bd-3194a967746d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:39:51.379513 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c634fc62-949c-4496-b1bd-3194a967746d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:39:51.380992 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c634fc62-949c-4496-b1bd-3194a967746d service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:39:51.389412 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1426/2842] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:39:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:39:51.539495 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a37c7-de1a-4ada-8182-5a84778ea5a9 service swift] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:39:51.549714 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a37c7-de1a-4ada-8182-5a84778ea5a9 service swift] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:39:51.553809 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f0b17-e36b-4dc3-b436-50b9f0341ce7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:39:51.554514 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f0b17-e36b-4dc3-b436-50b9f0341ce7 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:39:51.554801 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f0b17-e36b-4dc3-b436-50b9f0341ce7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:39:51.555081 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f0b17-e36b-4dc3-b436-50b9f0341ce7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:39:51.556910 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-001f0b17-e36b-4dc3-b436-50b9f0341ce7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:39:51.574459 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f0b17-e36b-4dc3-b436-50b9f0341ce7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:39:51.575964 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f0b17-e36b-4dc3-b436-50b9f0341ce7 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:39:51.588590 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1417/2843] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:39:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:39:51.688391 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c634fc62-949c-4496-b1bd-3194a967746d service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:39:51.689865 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c634fc62-949c-4496-b1bd-3194a967746d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:39:51.757431 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c634fc62-949c-4496-b1bd-3194a967746d service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:39:51.762421 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1743f4-974a-4761-9b49-870bcd56a0d0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff35b68665724754a6413bca0030016f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:39:51.763083 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1743f4-974a-4761-9b49-870bcd56a0d0 service placement] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:39:51.763367 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1743f4-974a-4761-9b49-870bcd56a0d0 service placement] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:39:51.763642 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1743f4-974a-4761-9b49-870bcd56a0d0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:39:51.765459 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-ef1743f4-974a-4761-9b49-870bcd56a0d0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:39:51.781629 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1743f4-974a-4761-9b49-870bcd56a0d0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:39:51.783228 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1743f4-974a-4761-9b49-870bcd56a0d0 service placement] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:39:51.793292 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1427/2844] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:39:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:39:53.207779 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f0b17-e36b-4dc3-b436-50b9f0341ce7 service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:39:53.219612 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f0b17-e36b-4dc3-b436-50b9f0341ce7 service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:39:53.225320 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad75b5a8-6092-4df3-a388-7400811e69a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cd81f6620f410db450871fb29961f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:39:53.225965 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75b5a8-6092-4df3-a388-7400811e69a7 service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:39:53.226267 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75b5a8-6092-4df3-a388-7400811e69a7 service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:39:53.226523 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75b5a8-6092-4df3-a388-7400811e69a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:39:53.229200 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-ad75b5a8-6092-4df3-a388-7400811e69a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:39:53.243214 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad75b5a8-6092-4df3-a388-7400811e69a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:39:53.244907 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad75b5a8-6092-4df3-a388-7400811e69a7 service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:39:53.255682 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1418/2845] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:39:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:39:57.862043 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1743f4-974a-4761-9b49-870bcd56a0d0 service placement] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:39:57.940207 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1743f4-974a-4761-9b49-870bcd56a0d0 service placement] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:39:57.945114 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86dbe6d-02f7-46b1-9c34-82ddaf59af96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:39:57.945973 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86dbe6d-02f7-46b1-9c34-82ddaf59af96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:39:57.946252 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86dbe6d-02f7-46b1-9c34-82ddaf59af96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:39:57.946524 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86dbe6d-02f7-46b1-9c34-82ddaf59af96 admin admin] PATH_INFO: `/v3/users/2e4802992e264211905f6afd982ee70e` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:39:57.947682 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86dbe6d-02f7-46b1-9c34-82ddaf59af96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e4802992e264211905f6afd982ee70e)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:39:57.949603 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86dbe6d-02f7-46b1-9c34-82ddaf59af96 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:39:58.157993 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a86dbe6d-02f7-46b1-9c34-82ddaf59af96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e4802992e264211905f6afd982ee70e'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:39:58.170132 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a86dbe6d-02f7-46b1-9c34-82ddaf59af96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e4802992e264211905f6afd982ee70e'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:39:58.257718 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a86dbe6d-02f7-46b1-9c34-82ddaf59af96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e4802992e264211905f6afd982ee70e'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:39:58.258276 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a86dbe6d-02f7-46b1-9c34-82ddaf59af96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e4802992e264211905f6afd982ee70e'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:39:58.258913 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a86dbe6d-02f7-46b1-9c34-82ddaf59af96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e4802992e264211905f6afd982ee70e'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:39:58.271270 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1428/2846] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:39:57 2022] DELETE /identity/v3/users/2e4802992e264211905f6afd982ee70e => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:39:58.529308 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad75b5a8-6092-4df3-a388-7400811e69a7 service nova] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:39:58.540110 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad75b5a8-6092-4df3-a388-7400811e69a7 service nova] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:39:58.593261 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da40ac54-07eb-42cf-92ac-d46018d838c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:39:58.594121 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da40ac54-07eb-42cf-92ac-d46018d838c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:39:58.594409 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da40ac54-07eb-42cf-92ac-d46018d838c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:39:58.594686 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da40ac54-07eb-42cf-92ac-d46018d838c0 admin admin] PATH_INFO: `/v3/projects/5bf029a696e342f0b6f7818e2cdcd902` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:39:58.595900 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da40ac54-07eb-42cf-92ac-d46018d838c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bf029a696e342f0b6f7818e2cdcd902)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:39:58.597800 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da40ac54-07eb-42cf-92ac-d46018d838c0 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:39:58.704782 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-da40ac54-07eb-42cf-92ac-d46018d838c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bf029a696e342f0b6f7818e2cdcd902', 'request_id': 'req-da40ac54-07eb-42cf-92ac-d46018d838c0'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:39:58.710114 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-da40ac54-07eb-42cf-92ac-d46018d838c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bf029a696e342f0b6f7818e2cdcd902', 'request_id': 'req-da40ac54-07eb-42cf-92ac-d46018d838c0'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:39:58.779309 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-da40ac54-07eb-42cf-92ac-d46018d838c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bf029a696e342f0b6f7818e2cdcd902', 'request_id': 'req-da40ac54-07eb-42cf-92ac-d46018d838c0'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:39:58.803232 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-da40ac54-07eb-42cf-92ac-d46018d838c0 admin admin] The token cache is being invalidate because project 5bf029a696e342f0b6f7818e2cdcd902 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:39:58.804292 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-da40ac54-07eb-42cf-92ac-d46018d838c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:39:58.804925 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-da40ac54-07eb-42cf-92ac-d46018d838c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:39:58.806475 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1419/2847] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:39:58 2022] DELETE /identity/v3/projects/5bf029a696e342f0b6f7818e2cdcd902 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:39:58.810474 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86dbe6d-02f7-46b1-9c34-82ddaf59af96 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:39:58.811922 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a86dbe6d-02f7-46b1-9c34-82ddaf59af96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:39:58.824821 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86dbe6d-02f7-46b1-9c34-82ddaf59af96 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:39:58.879913 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a0136-5f43-4e6d-857e-1602c9f9d927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:39:58.880783 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a0136-5f43-4e6d-857e-1602c9f9d927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:39:58.881072 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a0136-5f43-4e6d-857e-1602c9f9d927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:39:58.881350 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a0136-5f43-4e6d-857e-1602c9f9d927 admin admin] PATH_INFO: `/v3/users/dcf4889e31714ddb96b4ca6e0189d2f4` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:39:58.882554 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9a0136-5f43-4e6d-857e-1602c9f9d927 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcf4889e31714ddb96b4ca6e0189d2f4)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:39:58.884508 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9a0136-5f43-4e6d-857e-1602c9f9d927 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:39:59.067329 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-1c9a0136-5f43-4e6d-857e-1602c9f9d927 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcf4889e31714ddb96b4ca6e0189d2f4'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:39:59.078758 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-1c9a0136-5f43-4e6d-857e-1602c9f9d927 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcf4889e31714ddb96b4ca6e0189d2f4'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:39:59.150177 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-1c9a0136-5f43-4e6d-857e-1602c9f9d927 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcf4889e31714ddb96b4ca6e0189d2f4'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:39:59.150825 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-1c9a0136-5f43-4e6d-857e-1602c9f9d927 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcf4889e31714ddb96b4ca6e0189d2f4'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:39:59.151446 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-1c9a0136-5f43-4e6d-857e-1602c9f9d927 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcf4889e31714ddb96b4ca6e0189d2f4'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:39:59.164060 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1429/2848] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:39:58 2022] DELETE /identity/v3/users/dcf4889e31714ddb96b4ca6e0189d2f4 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:39:59.378300 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da40ac54-07eb-42cf-92ac-d46018d838c0 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:39:59.379857 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-da40ac54-07eb-42cf-92ac-d46018d838c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:39:59.393030 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da40ac54-07eb-42cf-92ac-d46018d838c0 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:39:59.451603 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca45e4-6537-42f8-b1c1-9b2fabcc3d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:39:59.452515 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca45e4-6537-42f8-b1c1-9b2fabcc3d8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:39:59.452855 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca45e4-6537-42f8-b1c1-9b2fabcc3d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:39:59.453159 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca45e4-6537-42f8-b1c1-9b2fabcc3d8d admin admin] PATH_INFO: `/v3/projects/15efb0719ab14d9ebfd788968fc100d2` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:39:59.454421 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ca45e4-6537-42f8-b1c1-9b2fabcc3d8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=15efb0719ab14d9ebfd788968fc100d2)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:39:59.457029 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ca45e4-6537-42f8-b1c1-9b2fabcc3d8d admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:39:59.628904 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-68ca45e4-6537-42f8-b1c1-9b2fabcc3d8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15efb0719ab14d9ebfd788968fc100d2', 'request_id': 'req-68ca45e4-6537-42f8-b1c1-9b2fabcc3d8d'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:39:59.634771 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-68ca45e4-6537-42f8-b1c1-9b2fabcc3d8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15efb0719ab14d9ebfd788968fc100d2', 'request_id': 'req-68ca45e4-6537-42f8-b1c1-9b2fabcc3d8d'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:39:59.716474 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-68ca45e4-6537-42f8-b1c1-9b2fabcc3d8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15efb0719ab14d9ebfd788968fc100d2', 'request_id': 'req-68ca45e4-6537-42f8-b1c1-9b2fabcc3d8d'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:39:59.727779 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-68ca45e4-6537-42f8-b1c1-9b2fabcc3d8d admin admin] The token cache is being invalidate because project 15efb0719ab14d9ebfd788968fc100d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:39:59.730267 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-68ca45e4-6537-42f8-b1c1-9b2fabcc3d8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:39:59.730267 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-68ca45e4-6537-42f8-b1c1-9b2fabcc3d8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:39:59.730267 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1420/2849] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:39:59 2022] DELETE /identity/v3/projects/15efb0719ab14d9ebfd788968fc100d2 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:39:59.735137 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0c8b7-b230-4065-8a60-1aec1bc7a90c None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:39:59.735437 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0c8b7-b230-4065-8a60-1aec1bc7a90c None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:39:59.735715 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0c8b7-b230-4065-8a60-1aec1bc7a90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:39:59.791894 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-caa0c8b7-b230-4065-8a60-1aec1bc7a90c None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:39:59.793080 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-caa0c8b7-b230-4065-8a60-1aec1bc7a90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:39:59.855906 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1430/2850] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:39:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:39:59.857660 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e79e9d-f7f0-4a85-8b2b-ddee3231b280 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:39:59.857957 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e79e9d-f7f0-4a85-8b2b-ddee3231b280 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:39:59.858290 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e79e9d-f7f0-4a85-8b2b-ddee3231b280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:39:59.876779 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-38e79e9d-f7f0-4a85-8b2b-ddee3231b280 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:39:59.877971 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-38e79e9d-f7f0-4a85-8b2b-ddee3231b280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:39:59.886994 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1421/2851] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:39:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:39:59.890969 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0c8b7-b230-4065-8a60-1aec1bc7a90c None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:39:59.900591 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0c8b7-b230-4065-8a60-1aec1bc7a90c None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:39:59.905129 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a958a37-2d61-4155-adfb-3e235024922f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:39:59.905788 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a958a37-2d61-4155-adfb-3e235024922f admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:39:59.906074 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a958a37-2d61-4155-adfb-3e235024922f admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:39:59.906346 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a958a37-2d61-4155-adfb-3e235024922f admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:39:59.907081 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a958a37-2d61-4155-adfb-3e235024922f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 07 06:39:59.907379 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a958a37-2d61-4155-adfb-3e235024922f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:39:59.909006 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a958a37-2d61-4155-adfb-3e235024922f admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:39:59.922107 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1431/2852] 10.222.0.24 () {58 vars in 1152 bytes} [Thu Apr 7 06:39:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 07 06:39:59.926480 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e79e9d-f7f0-4a85-8b2b-ddee3231b280 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:39:59.936618 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e79e9d-f7f0-4a85-8b2b-ddee3231b280 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:39:59.941624 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ddfbb8-dbd8-40b8-8e29-ae33c34faba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:39:59.942321 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ddfbb8-dbd8-40b8-8e29-ae33c34faba2 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:39:59.942629 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ddfbb8-dbd8-40b8-8e29-ae33c34faba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:39:59.942913 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ddfbb8-dbd8-40b8-8e29-ae33c34faba2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:39:59.943661 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ddfbb8-dbd8-40b8-8e29-ae33c34faba2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:39:59.945680 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ddfbb8-dbd8-40b8-8e29-ae33c34faba2 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:40:00.055630 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1422/2853] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:39:59 2022] POST /identity/v3/projects => generated 379 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 07 06:40:00.059584 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a958a37-2d61-4155-adfb-3e235024922f admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:40:00.069455 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a958a37-2d61-4155-adfb-3e235024922f admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:40:00.122804 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e529ab-ea5a-4a19-9d41-5d49e1e284c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:40:00.123474 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e529ab-ea5a-4a19-9d41-5d49e1e284c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:40:00.123782 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e529ab-ea5a-4a19-9d41-5d49e1e284c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:40:00.124069 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e529ab-ea5a-4a19-9d41-5d49e1e284c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:40:00.124748 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e529ab-ea5a-4a19-9d41-5d49e1e284c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:40:00.126649 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e529ab-ea5a-4a19-9d41-5d49e1e284c0 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:40:00.225603 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1432/2854] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:40:00 2022] POST /identity/v3/users => generated 290 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:40:00.229668 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ddfbb8-dbd8-40b8-8e29-ae33c34faba2 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:40:00.240012 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ddfbb8-dbd8-40b8-8e29-ae33c34faba2 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:40:00.245240 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cafea09-6511-4eda-acd1-fb6b6d4e5607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:40:00.245896 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cafea09-6511-4eda-acd1-fb6b6d4e5607 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:40:00.246185 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cafea09-6511-4eda-acd1-fb6b6d4e5607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:40:00.246490 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cafea09-6511-4eda-acd1-fb6b6d4e5607 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:40:00.247210 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cafea09-6511-4eda-acd1-fb6b6d4e5607 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:40:00.248838 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cafea09-6511-4eda-acd1-fb6b6d4e5607 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:40:00.258992 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1423/2855] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 07 06:40:00.262934 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e529ab-ea5a-4a19-9d41-5d49e1e284c0 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:40:00.272875 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e529ab-ea5a-4a19-9d41-5d49e1e284c0 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:40:00.277759 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdbd6d6-b885-4c9b-874b-03656845e617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:40:00.278459 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdbd6d6-b885-4c9b-874b-03656845e617 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:40:00.280121 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdbd6d6-b885-4c9b-874b-03656845e617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:40:00.280418 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdbd6d6-b885-4c9b-874b-03656845e617 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:40:00.281290 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdbd6d6-b885-4c9b-874b-03656845e617 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:40:00.283632 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdbd6d6-b885-4c9b-874b-03656845e617 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:40:00.298566 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1433/2856] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 07 06:40:00.302671 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cafea09-6511-4eda-acd1-fb6b6d4e5607 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:40:00.313216 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cafea09-6511-4eda-acd1-fb6b6d4e5607 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:40:00.317981 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45e4d1-b69b-42b3-be42-dfc7a1af14cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:40:00.318865 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45e4d1-b69b-42b3-be42-dfc7a1af14cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:40:00.319149 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45e4d1-b69b-42b3-be42-dfc7a1af14cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:40:00.319425 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45e4d1-b69b-42b3-be42-dfc7a1af14cf admin admin] PATH_INFO: `/v3/projects/d9852c8d59554cdc966a35c3cd2fb0f0/users/8f9deae3ae564b538eb25b4a3fcc1080/roles/7abd6a5977df4ff4a5476c2d95a1934b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:40:00.333285 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df45e4d1-b69b-42b3-be42-dfc7a1af14cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9852c8d59554cdc966a35c3cd2fb0f0, user_id=8f9deae3ae564b538eb25b4a3fcc1080, role_id=7abd6a5977df4ff4a5476c2d95a1934b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:40:00.336443 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df45e4d1-b69b-42b3-be42-dfc7a1af14cf admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:40:00.402112 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1424/2857] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:40:00 2022] PUT /identity/v3/projects/d9852c8d59554cdc966a35c3cd2fb0f0/users/8f9deae3ae564b538eb25b4a3fcc1080/roles/7abd6a5977df4ff4a5476c2d95a1934b => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:40:00.407025 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f38664-0d10-4ad4-a026-78f9d63ea969 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:40:00.407324 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f38664-0d10-4ad4-a026-78f9d63ea969 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:40:00.407604 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f38664-0d10-4ad4-a026-78f9d63ea969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:40:00.426138 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-c5f38664-0d10-4ad4-a026-78f9d63ea969 None None] MFA Rules not processed for user `91c1e479128840248c7c0e4e51af60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:40:00.427364 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c5f38664-0d10-4ad4-a026-78f9d63ea969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:40:00.482885 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1434/2858] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:40:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:40:00.492527 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45e4d1-b69b-42b3-be42-dfc7a1af14cf admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:40:00.494167 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-df45e4d1-b69b-42b3-be42-dfc7a1af14cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:40:00.549519 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45e4d1-b69b-42b3-be42-dfc7a1af14cf admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:40:00.553144 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a232b449-1801-419c-92a3-94b9735a7cc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:40:00.553808 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a232b449-1801-419c-92a3-94b9735a7cc7 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:40:00.554094 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a232b449-1801-419c-92a3-94b9735a7cc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:40:00.554371 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a232b449-1801-419c-92a3-94b9735a7cc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:40:00.563128 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a232b449-1801-419c-92a3-94b9735a7cc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:40:00.564574 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a232b449-1801-419c-92a3-94b9735a7cc7 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:40:00.573718 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1425/2859] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:40:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:40:06.294274 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb801d-d29e-4b68-b8c7-b551a6e4d518 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:40:06.294775 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb801d-d29e-4b68-b8c7-b551a6e4d518 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:40:06.294865 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb801d-d29e-4b68-b8c7-b551a6e4d518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:40:06.321916 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-9ddb801d-d29e-4b68-b8c7-b551a6e4d518 None None] MFA Rules not processed for user `8f9deae3ae564b538eb25b4a3fcc1080`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:40:06.323133 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-9ddb801d-d29e-4b68-b8c7-b551a6e4d518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:40:06.387767 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1435/2860] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:40:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:40:06.392449 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a232b449-1801-419c-92a3-94b9735a7cc7 service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:40:06.403380 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a232b449-1801-419c-92a3-94b9735a7cc7 service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:40:06.408064 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8994839-4585-48a6-b517-94ba29a19260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:40:06.408729 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8994839-4585-48a6-b517-94ba29a19260 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:40:06.409017 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8994839-4585-48a6-b517-94ba29a19260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:40:06.409297 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8994839-4585-48a6-b517-94ba29a19260 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:40:06.410000 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8994839-4585-48a6-b517-94ba29a19260 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:40:06.411936 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8994839-4585-48a6-b517-94ba29a19260 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:40:06.541454 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1426/2861] 10.222.0.24 () {60 vars in 1152 bytes} [Thu Apr 7 06:40:06 2022] POST /identity/v3/projects => generated 379 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:40:06.547372 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddb801d-d29e-4b68-b8c7-b551a6e4d518 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:40:06.562045 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddb801d-d29e-4b68-b8c7-b551a6e4d518 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:40:06.622728 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca8f4b2-8988-4900-bcb3-d77741feff0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:40:06.623415 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8f4b2-8988-4900-bcb3-d77741feff0a admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:40:06.623700 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8f4b2-8988-4900-bcb3-d77741feff0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:40:06.624017 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8f4b2-8988-4900-bcb3-d77741feff0a admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:40:06.624707 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca8f4b2-8988-4900-bcb3-d77741feff0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:40:06.626627 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca8f4b2-8988-4900-bcb3-d77741feff0a admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:40:06.728149 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1436/2862] 10.222.0.24 () {60 vars in 1143 bytes} [Thu Apr 7 06:40:06 2022] POST /identity/v3/users => generated 296 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 07 06:40:06.732242 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8994839-4585-48a6-b517-94ba29a19260 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:40:06.743372 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8994839-4585-48a6-b517-94ba29a19260 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:40:06.748151 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cf72e4-7d6e-4359-8967-c90912ebd7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:40:06.748906 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf72e4-7d6e-4359-8967-c90912ebd7e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:40:06.749198 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf72e4-7d6e-4359-8967-c90912ebd7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:40:06.749480 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf72e4-7d6e-4359-8967-c90912ebd7e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:40:06.750249 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cf72e4-7d6e-4359-8967-c90912ebd7e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:40:06.751962 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cf72e4-7d6e-4359-8967-c90912ebd7e9 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:40:06.764492 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1427/2863] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 07 06:40:06.768700 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca8f4b2-8988-4900-bcb3-d77741feff0a admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:40:06.780683 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca8f4b2-8988-4900-bcb3-d77741feff0a admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:40:06.785406 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf4f801-227a-4c1c-a770-f8409321dec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:40:06.786299 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4f801-227a-4c1c-a770-f8409321dec7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:40:06.786583 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4f801-227a-4c1c-a770-f8409321dec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:40:06.786859 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4f801-227a-4c1c-a770-f8409321dec7 admin admin] PATH_INFO: `/v3/projects/25fd1d37dad74476936af856fce4db1e/users/7d635281cb4e4feaab883b76020bbce8/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:40:06.802368 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf4f801-227a-4c1c-a770-f8409321dec7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25fd1d37dad74476936af856fce4db1e, user_id=7d635281cb4e4feaab883b76020bbce8, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:40:06.805193 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf4f801-227a-4c1c-a770-f8409321dec7 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:40:06.899604 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1437/2864] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:40:06 2022] PUT /identity/v3/projects/25fd1d37dad74476936af856fce4db1e/users/7d635281cb4e4feaab883b76020bbce8/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:40:06.902768 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cf72e4-7d6e-4359-8967-c90912ebd7e9 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:40:06.913182 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cf72e4-7d6e-4359-8967-c90912ebd7e9 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:40:06.974400 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd956521-6f19-4d92-a86e-2d504e984903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:40:06.975428 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd956521-6f19-4d92-a86e-2d504e984903 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:40:06.975717 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd956521-6f19-4d92-a86e-2d504e984903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:40:06.976028 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd956521-6f19-4d92-a86e-2d504e984903 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:40:06.976828 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd956521-6f19-4d92-a86e-2d504e984903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:40:06.978433 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd956521-6f19-4d92-a86e-2d504e984903 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:40:06.989066 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1428/2865] 10.222.0.24 () {58 vars in 1121 bytes} [Thu Apr 7 06:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 07 06:40:06.993633 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf4f801-227a-4c1c-a770-f8409321dec7 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:40:07.004422 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf4f801-227a-4c1c-a770-f8409321dec7 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:40:07.011560 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab0069-e98c-478b-a113-3c6d389531fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:40:07.012523 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab0069-e98c-478b-a113-3c6d389531fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:40:07.012806 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab0069-e98c-478b-a113-3c6d389531fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:40:07.013082 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab0069-e98c-478b-a113-3c6d389531fc admin admin] PATH_INFO: `/v3/projects/25fd1d37dad74476936af856fce4db1e/users/7d635281cb4e4feaab883b76020bbce8/roles/0fab680bc76f4a73826e9beb59e8129b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:40:07.015079 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab0069-e98c-478b-a113-3c6d389531fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=25fd1d37dad74476936af856fce4db1e, user_id=7d635281cb4e4feaab883b76020bbce8, role_id=0fab680bc76f4a73826e9beb59e8129b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:40:07.017841 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab0069-e98c-478b-a113-3c6d389531fc admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:40:07.029458 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1438/2866] 10.222.0.24 () {60 vars in 1482 bytes} [Thu Apr 7 06:40:06 2022] PUT /identity/v3/projects/25fd1d37dad74476936af856fce4db1e/users/7d635281cb4e4feaab883b76020bbce8/roles/0fab680bc76f4a73826e9beb59e8129b => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:40:12.290471 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a855653-81ac-4276-878c-5d25d6c55d89 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:40:12.291015 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a855653-81ac-4276-878c-5d25d6c55d89 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:40:12.291124 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a855653-81ac-4276-878c-5d25d6c55d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:40:12.318180 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-5a855653-81ac-4276-878c-5d25d6c55d89 None None] MFA Rules not processed for user `7d635281cb4e4feaab883b76020bbce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:40:12.319979 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-5a855653-81ac-4276-878c-5d25d6c55d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:40:12.388597 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1429/2867] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:40:12 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:40:12.399405 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab0069-e98c-478b-a113-3c6d389531fc admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:40:12.401226 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-45ab0069-e98c-478b-a113-3c6d389531fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:40:12.483064 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab0069-e98c-478b-a113-3c6d389531fc admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:40:12.488960 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7191731b-21c1-4dd6-a421-b1016b36d50d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cd81f6620f410db450871fb29961f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:40:12.489873 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7191731b-21c1-4dd6-a421-b1016b36d50d service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:40:12.490161 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7191731b-21c1-4dd6-a421-b1016b36d50d service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:40:12.490964 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7191731b-21c1-4dd6-a421-b1016b36d50d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:40:12.546233 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7191731b-21c1-4dd6-a421-b1016b36d50d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:40:12.547926 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7191731b-21c1-4dd6-a421-b1016b36d50d service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:40:12.557506 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1439/2868] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:40:12 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:40:32.079412 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fdd90-4bc6-4342-9860-dd20ef40f92f None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:40:32.079857 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fdd90-4bc6-4342-9860-dd20ef40f92f None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:40:32.080011 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fdd90-4bc6-4342-9860-dd20ef40f92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:40:32.097329 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-8f2fdd90-4bc6-4342-9860-dd20ef40f92f None None] MFA Rules not processed for user `8f9deae3ae564b538eb25b4a3fcc1080`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:40:32.098516 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-8f2fdd90-4bc6-4342-9860-dd20ef40f92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:40:32.105282 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1430/2869] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:40:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:40:32.406610 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7191731b-21c1-4dd6-a421-b1016b36d50d service nova] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:40:32.408071 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-7191731b-21c1-4dd6-a421-b1016b36d50d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:40:32.462828 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7191731b-21c1-4dd6-a421-b1016b36d50d service nova] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:40:32.466434 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb3f120-56c8-4a42-afc0-ec1128ab705f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:40:32.467073 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3f120-56c8-4a42-afc0-ec1128ab705f service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:40:32.467360 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3f120-56c8-4a42-afc0-ec1128ab705f service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:40:32.467635 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3f120-56c8-4a42-afc0-ec1128ab705f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:40:32.469421 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-fbb3f120-56c8-4a42-afc0-ec1128ab705f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:40:32.478600 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb3f120-56c8-4a42-afc0-ec1128ab705f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:40:32.480114 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb3f120-56c8-4a42-afc0-ec1128ab705f service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:40:32.487875 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1440/2870] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:40:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:40:47.078849 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2fdd90-4bc6-4342-9860-dd20ef40f92f None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:40:47.080528 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-8f2fdd90-4bc6-4342-9860-dd20ef40f92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:40:47.164961 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2fdd90-4bc6-4342-9860-dd20ef40f92f None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:40:47.170557 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473f001-c639-4602-b2cb-48d4f7aa297c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff35b68665724754a6413bca0030016f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:40:47.171203 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473f001-c639-4602-b2cb-48d4f7aa297c service placement] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:40:47.171479 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473f001-c639-4602-b2cb-48d4f7aa297c service placement] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:40:47.171770 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473f001-c639-4602-b2cb-48d4f7aa297c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:40:47.173532 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-1473f001-c639-4602-b2cb-48d4f7aa297c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:40:47.185257 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1473f001-c639-4602-b2cb-48d4f7aa297c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:40:47.188432 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1473f001-c639-4602-b2cb-48d4f7aa297c service placement] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:40:47.201050 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1431/2871] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:40:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:40:50.758305 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb3f120-56c8-4a42-afc0-ec1128ab705f service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:40:50.767219 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb3f120-56c8-4a42-afc0-ec1128ab705f service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:40:50.770825 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74891c6a-bb4c-4d73-a7dc-5fdce15ad4f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:40:50.771633 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74891c6a-bb4c-4d73-a7dc-5fdce15ad4f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:40:50.771953 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74891c6a-bb4c-4d73-a7dc-5fdce15ad4f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:40:50.772261 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74891c6a-bb4c-4d73-a7dc-5fdce15ad4f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:40:50.781401 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74891c6a-bb4c-4d73-a7dc-5fdce15ad4f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:40:50.782829 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74891c6a-bb4c-4d73-a7dc-5fdce15ad4f1 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:40:50.792016 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1441/2872] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:40:50 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:41:34.589789 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473f001-c639-4602-b2cb-48d4f7aa297c service placement] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:41:34.599414 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473f001-c639-4602-b2cb-48d4f7aa297c service placement] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:41:34.602993 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010acdfe-4b9d-4f85-a7d3-bf6a6732c43d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:41:34.606905 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010acdfe-4b9d-4f85-a7d3-bf6a6732c43d service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:41:34.606905 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010acdfe-4b9d-4f85-a7d3-bf6a6732c43d service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:41:34.606905 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010acdfe-4b9d-4f85-a7d3-bf6a6732c43d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:41:34.606905 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-010acdfe-4b9d-4f85-a7d3-bf6a6732c43d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:41:34.665440 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010acdfe-4b9d-4f85-a7d3-bf6a6732c43d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:41:34.666846 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010acdfe-4b9d-4f85-a7d3-bf6a6732c43d service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:41:34.676593 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1432/2873] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:41:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:41:41.763858 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74891c6a-bb4c-4d73-a7dc-5fdce15ad4f1 service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:41:41.765449 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-74891c6a-bb4c-4d73-a7dc-5fdce15ad4f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:41:41.779978 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74891c6a-bb4c-4d73-a7dc-5fdce15ad4f1 service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:41:41.784538 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699857bd-a1d2-4c75-9304-e5e4f1ae184d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:41:41.785391 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699857bd-a1d2-4c75-9304-e5e4f1ae184d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:41:41.785678 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699857bd-a1d2-4c75-9304-e5e4f1ae184d admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:41:41.785984 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699857bd-a1d2-4c75-9304-e5e4f1ae184d admin admin] PATH_INFO: `/v3/users/48d1138f80644f52a147dfb4a74cb924` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:41:41.787254 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699857bd-a1d2-4c75-9304-e5e4f1ae184d admin admin] RBAC: Authorizing `identity:delete_user(user_id=48d1138f80644f52a147dfb4a74cb924)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:41:41.789238 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699857bd-a1d2-4c75-9304-e5e4f1ae184d admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:41:41.930634 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-699857bd-a1d2-4c75-9304-e5e4f1ae184d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48d1138f80644f52a147dfb4a74cb924'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:41:41.942189 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-699857bd-a1d2-4c75-9304-e5e4f1ae184d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48d1138f80644f52a147dfb4a74cb924'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:41:42.002728 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-699857bd-a1d2-4c75-9304-e5e4f1ae184d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48d1138f80644f52a147dfb4a74cb924'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:41:42.003337 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-699857bd-a1d2-4c75-9304-e5e4f1ae184d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48d1138f80644f52a147dfb4a74cb924'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:41:42.003963 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-699857bd-a1d2-4c75-9304-e5e4f1ae184d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48d1138f80644f52a147dfb4a74cb924'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:41:42.016067 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1442/2874] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:41:41 2022] DELETE /identity/v3/users/48d1138f80644f52a147dfb4a74cb924 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:41:42.259093 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010acdfe-4b9d-4f85-a7d3-bf6a6732c43d service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:41:42.269042 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010acdfe-4b9d-4f85-a7d3-bf6a6732c43d service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:41:42.323898 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03c3678-6576-41fc-af4f-d01dac7882ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:41:42.324750 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03c3678-6576-41fc-af4f-d01dac7882ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:41:42.325039 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03c3678-6576-41fc-af4f-d01dac7882ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:41:42.325314 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03c3678-6576-41fc-af4f-d01dac7882ed admin admin] PATH_INFO: `/v3/projects/b201a41ba3394cdebeda4fb3574ada20` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:41:42.326486 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03c3678-6576-41fc-af4f-d01dac7882ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=b201a41ba3394cdebeda4fb3574ada20)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:41:42.328419 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03c3678-6576-41fc-af4f-d01dac7882ed admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:41:42.433453 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-a03c3678-6576-41fc-af4f-d01dac7882ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b201a41ba3394cdebeda4fb3574ada20', 'request_id': 'req-a03c3678-6576-41fc-af4f-d01dac7882ed'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:41:42.438671 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-a03c3678-6576-41fc-af4f-d01dac7882ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b201a41ba3394cdebeda4fb3574ada20', 'request_id': 'req-a03c3678-6576-41fc-af4f-d01dac7882ed'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:41:42.496941 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-a03c3678-6576-41fc-af4f-d01dac7882ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b201a41ba3394cdebeda4fb3574ada20', 'request_id': 'req-a03c3678-6576-41fc-af4f-d01dac7882ed'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:41:42.507703 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-a03c3678-6576-41fc-af4f-d01dac7882ed admin admin] The token cache is being invalidate because project b201a41ba3394cdebeda4fb3574ada20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:41:42.511793 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-a03c3678-6576-41fc-af4f-d01dac7882ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:41:42.511793 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-a03c3678-6576-41fc-af4f-d01dac7882ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:41:42.511793 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1433/2875] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:41:42 2022] DELETE /identity/v3/projects/b201a41ba3394cdebeda4fb3574ada20 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:41:42.514389 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699857bd-a1d2-4c75-9304-e5e4f1ae184d admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:41:42.515777 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-699857bd-a1d2-4c75-9304-e5e4f1ae184d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:41:42.529246 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699857bd-a1d2-4c75-9304-e5e4f1ae184d admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:41:42.584759 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e6eb1-9456-4c11-baac-a40b9ce42dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:41:42.585623 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e6eb1-9456-4c11-baac-a40b9ce42dc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:41:42.585909 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e6eb1-9456-4c11-baac-a40b9ce42dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:41:42.586187 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e6eb1-9456-4c11-baac-a40b9ce42dc4 admin admin] PATH_INFO: `/v3/users/878a52701a3d452fb367b9aaf59bec3d` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:41:42.587359 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41e6eb1-9456-4c11-baac-a40b9ce42dc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=878a52701a3d452fb367b9aaf59bec3d)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:41:42.589305 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41e6eb1-9456-4c11-baac-a40b9ce42dc4 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:41:42.749394 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-e41e6eb1-9456-4c11-baac-a40b9ce42dc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '878a52701a3d452fb367b9aaf59bec3d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:41:42.762838 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-e41e6eb1-9456-4c11-baac-a40b9ce42dc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '878a52701a3d452fb367b9aaf59bec3d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:41:42.839873 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-e41e6eb1-9456-4c11-baac-a40b9ce42dc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '878a52701a3d452fb367b9aaf59bec3d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:41:42.840483 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-e41e6eb1-9456-4c11-baac-a40b9ce42dc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '878a52701a3d452fb367b9aaf59bec3d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:41:42.841093 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-e41e6eb1-9456-4c11-baac-a40b9ce42dc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '878a52701a3d452fb367b9aaf59bec3d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:41:42.853282 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1443/2876] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:41:42 2022] DELETE /identity/v3/users/878a52701a3d452fb367b9aaf59bec3d => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:41:43.107017 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03c3678-6576-41fc-af4f-d01dac7882ed admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:41:43.108512 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a03c3678-6576-41fc-af4f-d01dac7882ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:41:43.122249 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03c3678-6576-41fc-af4f-d01dac7882ed admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:41:43.177344 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23527c1-d03c-4787-a786-1b0d65fd258e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:41:43.178208 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23527c1-d03c-4787-a786-1b0d65fd258e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:41:43.178492 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23527c1-d03c-4787-a786-1b0d65fd258e admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:41:43.178768 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23527c1-d03c-4787-a786-1b0d65fd258e admin admin] PATH_INFO: `/v3/projects/645c42f1a0464b3b8460688ccf3cfb16` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:41:43.179996 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23527c1-d03c-4787-a786-1b0d65fd258e admin admin] RBAC: Authorizing `identity:delete_project(project_id=645c42f1a0464b3b8460688ccf3cfb16)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:41:43.181922 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23527c1-d03c-4787-a786-1b0d65fd258e admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:41:43.311618 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-c23527c1-d03c-4787-a786-1b0d65fd258e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '645c42f1a0464b3b8460688ccf3cfb16', 'request_id': 'req-c23527c1-d03c-4787-a786-1b0d65fd258e'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:41:43.317594 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-c23527c1-d03c-4787-a786-1b0d65fd258e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '645c42f1a0464b3b8460688ccf3cfb16', 'request_id': 'req-c23527c1-d03c-4787-a786-1b0d65fd258e'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:41:43.382852 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-c23527c1-d03c-4787-a786-1b0d65fd258e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '645c42f1a0464b3b8460688ccf3cfb16', 'request_id': 'req-c23527c1-d03c-4787-a786-1b0d65fd258e'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:41:43.394000 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-c23527c1-d03c-4787-a786-1b0d65fd258e admin admin] The token cache is being invalidate because project 645c42f1a0464b3b8460688ccf3cfb16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:41:43.394288 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-c23527c1-d03c-4787-a786-1b0d65fd258e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:41:43.394908 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-c23527c1-d03c-4787-a786-1b0d65fd258e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:41:43.396511 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1434/2877] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:41:43 2022] DELETE /identity/v3/projects/645c42f1a0464b3b8460688ccf3cfb16 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:42:50.582492 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e6eb1-9456-4c11-baac-a40b9ce42dc4 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:42:50.583999 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e41e6eb1-9456-4c11-baac-a40b9ce42dc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:42:50.639929 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e6eb1-9456-4c11-baac-a40b9ce42dc4 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:42:50.686293 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5e578-042f-43cb-8449-cabc241f71e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:42:50.686937 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5e578-042f-43cb-8449-cabc241f71e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:42:50.687222 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5e578-042f-43cb-8449-cabc241f71e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:42:50.687557 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5e578-042f-43cb-8449-cabc241f71e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:42:50.689394 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-4fd5e578-042f-43cb-8449-cabc241f71e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:42:50.767965 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd5e578-042f-43cb-8449-cabc241f71e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:42:50.769385 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd5e578-042f-43cb-8449-cabc241f71e0 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:42:50.789592 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1444/2878] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:42:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:42:51.966444 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23527c1-d03c-4787-a786-1b0d65fd258e admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:42:51.967979 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-c23527c1-d03c-4787-a786-1b0d65fd258e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:42:51.982832 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23527c1-d03c-4787-a786-1b0d65fd258e admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:42:51.983563 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449089d5-4f25-4506-861b-d2c7224f6cd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:42:51.984236 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449089d5-4f25-4506-861b-d2c7224f6cd4 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:42:51.984526 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449089d5-4f25-4506-861b-d2c7224f6cd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:42:51.984804 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449089d5-4f25-4506-861b-d2c7224f6cd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:42:51.986513 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-449089d5-4f25-4506-861b-d2c7224f6cd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:42:52.000462 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449089d5-4f25-4506-861b-d2c7224f6cd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:42:52.001882 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449089d5-4f25-4506-861b-d2c7224f6cd4 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:42:52.013285 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1435/2879] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:42:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:42:55.453424 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8269e6a2-eff5-4163-ae99-2ccaa39eaf4a None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:42:55.453928 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8269e6a2-eff5-4163-ae99-2ccaa39eaf4a None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:42:55.454038 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8269e6a2-eff5-4163-ae99-2ccaa39eaf4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:42:55.470357 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-8269e6a2-eff5-4163-ae99-2ccaa39eaf4a None None] MFA Rules not processed for user `8f9deae3ae564b538eb25b4a3fcc1080`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:42:55.471542 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-8269e6a2-eff5-4163-ae99-2ccaa39eaf4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:42:55.523392 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1445/2880] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:42:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:43:00.173080 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449089d5-4f25-4506-861b-d2c7224f6cd4 service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:43:00.174711 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-449089d5-4f25-4506-861b-d2c7224f6cd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:43:00.185837 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449089d5-4f25-4506-861b-d2c7224f6cd4 service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:43:00.189698 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34139e9a-0a05-435e-b8a7-9891f597566c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:43:00.190352 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34139e9a-0a05-435e-b8a7-9891f597566c service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:43:00.190730 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34139e9a-0a05-435e-b8a7-9891f597566c service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:43:00.191021 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34139e9a-0a05-435e-b8a7-9891f597566c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:43:00.192869 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-34139e9a-0a05-435e-b8a7-9891f597566c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:43:00.203548 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34139e9a-0a05-435e-b8a7-9891f597566c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:43:00.205058 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34139e9a-0a05-435e-b8a7-9891f597566c service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:43:00.214914 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1436/2881] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:43:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:45:03.441583 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b921be-c419-462c-88da-935ddfd55858 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:45:03.442108 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b921be-c419-462c-88da-935ddfd55858 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:45:03.442218 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b921be-c419-462c-88da-935ddfd55858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:45:03.459898 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-53b921be-c419-462c-88da-935ddfd55858 None None] MFA Rules not processed for user `8f9deae3ae564b538eb25b4a3fcc1080`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 07 06:45:03.462202 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-53b921be-c419-462c-88da-935ddfd55858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:45:03.468104 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1446/2882] 10.222.0.24 () {58 vars in 957 bytes} [Thu Apr 7 06:45:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 07 06:45:04.480632 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34139e9a-0a05-435e-b8a7-9891f597566c service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:45:04.482161 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-34139e9a-0a05-435e-b8a7-9891f597566c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:45:04.549835 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34139e9a-0a05-435e-b8a7-9891f597566c service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:45:04.554845 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d21fe4-086d-4ef6-bc58-17c25be3d446 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff35b68665724754a6413bca0030016f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:45:04.555484 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d21fe4-086d-4ef6-bc58-17c25be3d446 service placement] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:45:04.555793 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d21fe4-086d-4ef6-bc58-17c25be3d446 service placement] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:45:04.556073 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d21fe4-086d-4ef6-bc58-17c25be3d446 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:45:04.557844 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-78d21fe4-086d-4ef6-bc58-17c25be3d446 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:45:04.568843 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d21fe4-086d-4ef6-bc58-17c25be3d446 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:45:04.570420 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d21fe4-086d-4ef6-bc58-17c25be3d446 service placement] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:45:04.580069 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1437/2883] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:45:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:45:08.371862 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b921be-c419-462c-88da-935ddfd55858 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:45:08.373327 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-53b921be-c419-462c-88da-935ddfd55858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:45:08.393249 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b921be-c419-462c-88da-935ddfd55858 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:45:08.400819 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0bba80-5833-4f07-8d30-d0f70e04a7ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cd81f6620f410db450871fb29961f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:45:08.401551 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0bba80-5833-4f07-8d30-d0f70e04a7ed service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:45:08.406010 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0bba80-5833-4f07-8d30-d0f70e04a7ed service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:45:08.406010 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0bba80-5833-4f07-8d30-d0f70e04a7ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:45:08.406010 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-5c0bba80-5833-4f07-8d30-d0f70e04a7ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:45:08.419695 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0bba80-5833-4f07-8d30-d0f70e04a7ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:45:08.421210 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0bba80-5833-4f07-8d30-d0f70e04a7ed service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:45:08.433572 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1447/2884] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:45:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 07 06:45:12.414882 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d21fe4-086d-4ef6-bc58-17c25be3d446 service placement] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:45:12.427554 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d21fe4-086d-4ef6-bc58-17c25be3d446 service placement] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:45:12.432910 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217dd19-1a23-4185-91d7-89ff63404687 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cd81f6620f410db450871fb29961f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:45:12.433538 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217dd19-1a23-4185-91d7-89ff63404687 service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:45:12.433820 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217dd19-1a23-4185-91d7-89ff63404687 service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:45:12.434092 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217dd19-1a23-4185-91d7-89ff63404687 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:45:12.435958 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-8217dd19-1a23-4185-91d7-89ff63404687 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:45:12.446932 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8217dd19-1a23-4185-91d7-89ff63404687 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:45:12.448569 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8217dd19-1a23-4185-91d7-89ff63404687 service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:45:12.457212 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1438/2885] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:45:12 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:45:18.755035 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0bba80-5833-4f07-8d30-d0f70e04a7ed service nova] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:45:18.769755 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0bba80-5833-4f07-8d30-d0f70e04a7ed service nova] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:45:18.775363 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e2496-1918-4e62-a2dc-8d4c995162a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cd81f6620f410db450871fb29961f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:45:18.776085 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e2496-1918-4e62-a2dc-8d4c995162a6 service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:45:18.776372 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e2496-1918-4e62-a2dc-8d4c995162a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:45:18.776742 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e2496-1918-4e62-a2dc-8d4c995162a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:45:18.778502 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-7a4e2496-1918-4e62-a2dc-8d4c995162a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:45:18.792211 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4e2496-1918-4e62-a2dc-8d4c995162a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:45:18.793999 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4e2496-1918-4e62-a2dc-8d4c995162a6 service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:45:18.805686 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1448/2886] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:45:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 07 06:45:23.102088 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217dd19-1a23-4185-91d7-89ff63404687 service nova] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:45:23.114182 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217dd19-1a23-4185-91d7-89ff63404687 service nova] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:45:23.119675 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3bce78-4674-4a36-9053-392cf7cfe116 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cd81f6620f410db450871fb29961f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:45:23.120370 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3bce78-4674-4a36-9053-392cf7cfe116 service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:45:23.120654 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3bce78-4674-4a36-9053-392cf7cfe116 service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:45:23.120936 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3bce78-4674-4a36-9053-392cf7cfe116 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:45:23.122700 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-db3bce78-4674-4a36-9053-392cf7cfe116 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:45:23.134634 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3bce78-4674-4a36-9053-392cf7cfe116 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:45:23.136251 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3bce78-4674-4a36-9053-392cf7cfe116 service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:45:23.146686 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1439/2887] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:45:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:45:52.349594 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e2496-1918-4e62-a2dc-8d4c995162a6 service nova] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:45:52.361194 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e2496-1918-4e62-a2dc-8d4c995162a6 service nova] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:45:52.366296 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee9e43-bed5-4a2d-a905-38a7abf7eb8b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff35b68665724754a6413bca0030016f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:45:52.366927 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee9e43-bed5-4a2d-a905-38a7abf7eb8b service placement] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:45:52.367210 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee9e43-bed5-4a2d-a905-38a7abf7eb8b service placement] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:45:52.367485 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee9e43-bed5-4a2d-a905-38a7abf7eb8b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:45:52.369222 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-3eee9e43-bed5-4a2d-a905-38a7abf7eb8b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:45:52.380166 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee9e43-bed5-4a2d-a905-38a7abf7eb8b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:45:52.381721 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee9e43-bed5-4a2d-a905-38a7abf7eb8b service placement] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:45:52.391352 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1449/2888] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:45:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:47:18.450994 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3bce78-4674-4a36-9053-392cf7cfe116 service nova] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:47:18.460360 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3bce78-4674-4a36-9053-392cf7cfe116 service nova] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:47:18.463993 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a2768-d30d-43a8-bc3f-3f06bbcf9f3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7f549fd26e4642828d4f476aef0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:47:18.464628 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a2768-d30d-43a8-bc3f-3f06bbcf9f3a service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:47:18.464918 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a2768-d30d-43a8-bc3f-3f06bbcf9f3a service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:47:18.465196 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a2768-d30d-43a8-bc3f-3f06bbcf9f3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:47:18.466960 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-f83a2768-d30d-43a8-bc3f-3f06bbcf9f3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:47:18.528068 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83a2768-d30d-43a8-bc3f-3f06bbcf9f3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:47:18.529551 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83a2768-d30d-43a8-bc3f-3f06bbcf9f3a service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:47:18.538978 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1440/2889] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:47:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 07 06:47:25.578891 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee9e43-bed5-4a2d-a905-38a7abf7eb8b service placement] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:47:25.580457 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-3eee9e43-bed5-4a2d-a905-38a7abf7eb8b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:47:25.594541 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee9e43-bed5-4a2d-a905-38a7abf7eb8b service placement] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:47:25.598993 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae80b50-bdda-40b4-afb3-0b240eaabd12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:47:25.599956 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae80b50-bdda-40b4-afb3-0b240eaabd12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:47:25.600238 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae80b50-bdda-40b4-afb3-0b240eaabd12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:47:25.600509 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae80b50-bdda-40b4-afb3-0b240eaabd12 admin admin] PATH_INFO: `/v3/users/8f9deae3ae564b538eb25b4a3fcc1080` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:47:25.601677 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae80b50-bdda-40b4-afb3-0b240eaabd12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f9deae3ae564b538eb25b4a3fcc1080)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:47:25.603578 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae80b50-bdda-40b4-afb3-0b240eaabd12 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:47:25.773875 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-9ae80b50-bdda-40b4-afb3-0b240eaabd12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f9deae3ae564b538eb25b4a3fcc1080'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:47:25.785008 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-9ae80b50-bdda-40b4-afb3-0b240eaabd12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f9deae3ae564b538eb25b4a3fcc1080'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:47:25.862470 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-9ae80b50-bdda-40b4-afb3-0b240eaabd12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f9deae3ae564b538eb25b4a3fcc1080'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:47:25.863337 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-9ae80b50-bdda-40b4-afb3-0b240eaabd12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f9deae3ae564b538eb25b4a3fcc1080'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:47:25.863972 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-9ae80b50-bdda-40b4-afb3-0b240eaabd12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f9deae3ae564b538eb25b4a3fcc1080'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:47:25.876495 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1450/2890] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:47:25 2022] DELETE /identity/v3/users/8f9deae3ae564b538eb25b4a3fcc1080 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:47:26.098521 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a2768-d30d-43a8-bc3f-3f06bbcf9f3a service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:47:26.108271 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a2768-d30d-43a8-bc3f-3f06bbcf9f3a service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:47:26.165015 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f34cbdf-0541-4c89-ab49-295f94b8d3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:47:26.165878 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f34cbdf-0541-4c89-ab49-295f94b8d3a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:47:26.166165 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f34cbdf-0541-4c89-ab49-295f94b8d3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:47:26.166440 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f34cbdf-0541-4c89-ab49-295f94b8d3a7 admin admin] PATH_INFO: `/v3/projects/d9852c8d59554cdc966a35c3cd2fb0f0` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:47:26.167621 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f34cbdf-0541-4c89-ab49-295f94b8d3a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9852c8d59554cdc966a35c3cd2fb0f0)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:47:26.169564 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f34cbdf-0541-4c89-ab49-295f94b8d3a7 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:47:26.289037 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-0f34cbdf-0541-4c89-ab49-295f94b8d3a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9852c8d59554cdc966a35c3cd2fb0f0', 'request_id': 'req-0f34cbdf-0541-4c89-ab49-295f94b8d3a7'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:47:26.294272 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-0f34cbdf-0541-4c89-ab49-295f94b8d3a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9852c8d59554cdc966a35c3cd2fb0f0', 'request_id': 'req-0f34cbdf-0541-4c89-ab49-295f94b8d3a7'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:47:26.369666 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-0f34cbdf-0541-4c89-ab49-295f94b8d3a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9852c8d59554cdc966a35c3cd2fb0f0', 'request_id': 'req-0f34cbdf-0541-4c89-ab49-295f94b8d3a7'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:47:26.383547 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-0f34cbdf-0541-4c89-ab49-295f94b8d3a7 admin admin] The token cache is being invalidate because project d9852c8d59554cdc966a35c3cd2fb0f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:47:26.383547 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-0f34cbdf-0541-4c89-ab49-295f94b8d3a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:47:26.383547 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-0f34cbdf-0541-4c89-ab49-295f94b8d3a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:47:26.384120 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1441/2891] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:47:26 2022] DELETE /identity/v3/projects/d9852c8d59554cdc966a35c3cd2fb0f0 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:47:26.388161 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae80b50-bdda-40b4-afb3-0b240eaabd12 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:47:26.389635 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-9ae80b50-bdda-40b4-afb3-0b240eaabd12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:47:26.403126 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae80b50-bdda-40b4-afb3-0b240eaabd12 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:47:26.457242 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b617d6-6902-4da7-a201-7f7d12a6481b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:47:26.458117 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b617d6-6902-4da7-a201-7f7d12a6481b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:47:26.458404 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b617d6-6902-4da7-a201-7f7d12a6481b admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:47:26.458718 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b617d6-6902-4da7-a201-7f7d12a6481b admin admin] PATH_INFO: `/v3/users/7d635281cb4e4feaab883b76020bbce8` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:47:26.459906 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b617d6-6902-4da7-a201-7f7d12a6481b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d635281cb4e4feaab883b76020bbce8)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:47:26.461815 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b617d6-6902-4da7-a201-7f7d12a6481b admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:47:26.610659 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-90b617d6-6902-4da7-a201-7f7d12a6481b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d635281cb4e4feaab883b76020bbce8'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:47:26.622146 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-90b617d6-6902-4da7-a201-7f7d12a6481b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d635281cb4e4feaab883b76020bbce8'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:47:26.700410 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-90b617d6-6902-4da7-a201-7f7d12a6481b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d635281cb4e4feaab883b76020bbce8'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:47:26.701025 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-90b617d6-6902-4da7-a201-7f7d12a6481b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d635281cb4e4feaab883b76020bbce8'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:47:26.701626 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-90b617d6-6902-4da7-a201-7f7d12a6481b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d635281cb4e4feaab883b76020bbce8'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:47:26.714006 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1451/2892] 10.222.0.24 () {58 vars in 1223 bytes} [Thu Apr 7 06:47:26 2022] DELETE /identity/v3/users/7d635281cb4e4feaab883b76020bbce8 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:47:26.951007 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f34cbdf-0541-4c89-ab49-295f94b8d3a7 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:47:26.952513 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-0f34cbdf-0541-4c89-ab49-295f94b8d3a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:47:26.965596 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f34cbdf-0541-4c89-ab49-295f94b8d3a7 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:47:27.028715 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ab920-5bef-43e5-89e3-ec0faa0f222e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c1e479128840248c7c0e4e51af60ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166c17adce104ad88442ca1e7dd22799', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:47:27.029593 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ab920-5bef-43e5-89e3-ec0faa0f222e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:47:27.029878 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ab920-5bef-43e5-89e3-ec0faa0f222e admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:47:27.030155 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ab920-5bef-43e5-89e3-ec0faa0f222e admin admin] PATH_INFO: `/v3/projects/25fd1d37dad74476936af856fce4db1e` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:47:27.031348 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85ab920-5bef-43e5-89e3-ec0faa0f222e admin admin] RBAC: Authorizing `identity:delete_project(project_id=25fd1d37dad74476936af856fce4db1e)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:47:27.033337 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85ab920-5bef-43e5-89e3-ec0faa0f222e admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:47:27.128410 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-f85ab920-5bef-43e5-89e3-ec0faa0f222e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25fd1d37dad74476936af856fce4db1e', 'request_id': 'req-f85ab920-5bef-43e5-89e3-ec0faa0f222e'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:47:27.134337 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-f85ab920-5bef-43e5-89e3-ec0faa0f222e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25fd1d37dad74476936af856fce4db1e', 'request_id': 'req-f85ab920-5bef-43e5-89e3-ec0faa0f222e'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:47:27.203125 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-f85ab920-5bef-43e5-89e3-ec0faa0f222e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25fd1d37dad74476936af856fce4db1e', 'request_id': 'req-f85ab920-5bef-43e5-89e3-ec0faa0f222e'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:47:27.214392 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-f85ab920-5bef-43e5-89e3-ec0faa0f222e admin admin] The token cache is being invalidate because project 25fd1d37dad74476936af856fce4db1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 07 06:47:27.214682 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-f85ab920-5bef-43e5-89e3-ec0faa0f222e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:47:27.215349 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-f85ab920-5bef-43e5-89e3-ec0faa0f222e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 07 06:47:27.216909 dv-cinder-831776-6-iscsi devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1442/2893] 10.222.0.24 () {58 vars in 1232 bytes} [Thu Apr 7 06:47:26 2022] DELETE /identity/v3/projects/25fd1d37dad74476936af856fce4db1e => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 07 06:50:57.008031 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b617d6-6902-4da7-a201-7f7d12a6481b admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 07 06:50:57.009397 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-90b617d6-6902-4da7-a201-7f7d12a6481b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:50:57.141763 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b617d6-6902-4da7-a201-7f7d12a6481b admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 07 06:50:57.198281 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e726a318-3604-45fa-ab30-ba6bcd64f7dc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff35b68665724754a6413bca0030016f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de88f2c333ae49cfa7fff7fa1ed0022c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 07 06:50:57.198928 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726a318-3604-45fa-ab30-ba6bcd64f7dc service placement] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 07 06:50:57.199216 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726a318-3604-45fa-ab30-ba6bcd64f7dc service placement] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 07 06:50:57.199495 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726a318-3604-45fa-ab30-ba6bcd64f7dc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 07 06:50:57.201297 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e726a318-3604-45fa-ab30-ba6bcd64f7dc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 07 06:50:57.212128 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e726a318-3604-45fa-ab30-ba6bcd64f7dc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 07 06:50:57.213694 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e726a318-3604-45fa-ab30-ba6bcd64f7dc service placement] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 07 06:50:57.223351 dv-cinder-831776-6-iscsi devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1452/2894] 10.222.0.24 () {60 vars in 1365 bytes} [Thu Apr 7 06:50:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)